2022-09-07T19:13:16.398 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-07T19:13:16.400 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi/7018366 --name pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/direct_io}} -- /home/teuthworker/archive/pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi/7018366/orig.config.yaml 2022-09-07T19:13:16.474 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-09-07T19:13:16.566 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi/7018366 branch: wip-pdonnell-testing-20220907.015905 description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/direct_io}} email: pdonnell@redhat.com first_in_suite: false job_id: '7018366' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20220907.015905 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 152194198413033811b31149de909a7ec5852a7f subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 152194198413033811b31149de909a7ec5852a7f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20220907.015905 sha1: 152194198413033811b31149de909a7ec5852a7f owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 152194198413033811b31149de909a7ec5852a7f sleep_before_teardown: 0 suite: fs:workload suite_branch: wip-pdonnell-testing-20220907.015905 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_152194198413033811b31149de909a7ec5852a7f/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 152194198413033811b31149de909a7ec5852a7f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6UeStwkdqTyXBBX73jQU9ewFkgl279/YudsiFqnaXovwn63ho0IqPy3jD+UF9DW7/EmPho+s//myQPtY8s1UB4yCZn+TJHv0VNtZvLgXelQ2tUyP+Dd8FYFOOsW9PFADyJHn5/OfrE/MA0gG2p7wRChek3GxCry648T3tlWPxqnGpBL/6oDLxYFfSZavb/UaHa7I+ChK1AxUos8zHNWzozUxSe1atac6nltUqEYsPMbMaA8n+zl5IqiNMApe/mX0kac0YXV5IVH/SsLrwxqWO7qe5lh02GP3B2Z4CpZlx8gA1BtW1LcotuELgx9ZxtRyZa8AbBuJRW8t89yqGQaHnoVVjSzwhHeG5KBuoCoJZEzLV4+Uec4eqoNAxg5hNkRkyDOZYEeXnB65ffBjJ8xyidfSqTJ6wiFVliKzBCrU9D1X3hHGHL6qZVxmfDcEkZqIpTNGuMcPtEK3d2fqmGmYN2ndxFSWYDow76TxM7g3W4RykyMx8Jb780tp4oUsy6Ok= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHx/O1rlHTnc0zCG6OiX1jp5Z5cy4kZr53KNBMEgALdUcvDjtsNUuHcbCLFYk3X3yIOKRds7Nadpph8XEOUj3Wg= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCrOtEPv5Ti8eW7ysTQY1yiKsz+QI+Dq8SlGTmJy89XV79BBHIGTkRBqgs4Uc8qe1pukdFk8fmcZ4ufkmfgAKCo= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b58f2c18636eb10faa77ed3614abd00cb85dfc2c timestamp: 2022-09-07_05:00:36 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1713 2022-09-07T19:13:16.567 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_152194198413033811b31149de909a7ec5852a7f/qa; will attempt to use it 2022-09-07T19:13:16.568 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_152194198413033811b31149de909a7ec5852a7f/qa/tasks 2022-09-07T19:13:16.568 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-09-07T19:13:16.573 INFO:teuthology.task.internal:Checking packages... 2022-09-07T19:13:16.602 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '152194198413033811b31149de909a7ec5852a7f' 2022-09-07T19:13:16.603 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-09-07T19:13:16.603 INFO:teuthology.packaging:ref: None 2022-09-07T19:13:16.604 INFO:teuthology.packaging:tag: None 2022-09-07T19:13:16.604 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20220907.015905 2022-09-07T19:13:16.604 INFO:teuthology.packaging:sha1: 152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:13:16.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20220907.015905 2022-09-07T19:13:16.767 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-14857.g15219419 2022-09-07T19:13:16.768 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-09-07T19:13:16.779 INFO:teuthology.task.internal:no buildpackages task found 2022-09-07T19:13:16.780 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-09-07T19:13:16.814 INFO:teuthology.task.internal:Saving configuration 2022-09-07T19:13:16.837 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-09-07T19:13:16.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-07T19:13:16.909 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi/7018366', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-07 19:07:55.483508', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHusMT57t1qQH6mH797AAZKqQnYb2LbnQqKqCRrMeYUkybeyI3gOoxPjjdUID9CO4ToFFSOt3LkzDWhYNrCS8AE='} 2022-09-07T19:13:16.934 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi/7018366', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-07 19:07:55.482485', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHx/O1rlHTnc0zCG6OiX1jp5Z5cy4kZr53KNBMEgALdUcvDjtsNUuHcbCLFYk3X3yIOKRds7Nadpph8XEOUj3Wg='} 2022-09-07T19:13:16.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-07_05:00:36-fs:workload-wip-pdonnell-testing-20220907.015905-distro-default-smithi/7018366', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-07 19:07:55.481019', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCrOtEPv5Ti8eW7ysTQY1yiKsz+QI+Dq8SlGTmJy89XV79BBHIGTkRBqgs4Uc8qe1pukdFk8fmcZ4ufkmfgAKCo='} 2022-09-07T19:13:16.963 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-09-07T19:13:16.974 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2022-09-07T19:13:16.974 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2022-09-07T19:13:16.975 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2022-09-07T19:13:16.975 INFO:teuthology.run_tasks:Running task console_log... 2022-09-07T19:13:17.124 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ffe555840>, signals=[15]) 2022-09-07T19:13:17.125 INFO:teuthology.run_tasks:Running task internal.connect... 2022-09-07T19:13:17.137 INFO:teuthology.task.internal:Opening connections... 2022-09-07T19:13:17.137 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:13:17.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:13:17.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2022-09-07T19:13:17.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:13:17.325 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2022-09-07T19:13:17.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:13:17.420 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-09-07T19:13:17.431 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2022-09-07T19:13:17.452 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2022-09-07T19:13:17.453 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2022-09-07T19:13:17.511 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2022-09-07T19:13:17.511 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2022-09-07T19:13:17.511 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2022-09-07T19:13:17.512 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2022-09-07T19:13:17.512 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2022-09-07T19:13:17.512 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2022-09-07T19:13:17.512 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-07T19:13:17.512 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2022-09-07T19:13:17.513 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-07T19:13:17.513 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2022-09-07T19:13:17.513 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-07T19:13:17.513 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-07T19:13:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:13:17.514 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-07T19:13:17.514 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-07T19:13:17.514 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-07T19:13:17.514 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-07T19:13:17.515 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2022-09-07T19:13:17.538 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2022-09-07T19:13:17.559 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2022-09-07T19:13:17.560 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2022-09-07T19:13:17.620 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2022-09-07T19:13:17.621 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2022-09-07T19:13:17.621 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2022-09-07T19:13:17.622 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2022-09-07T19:13:17.622 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2022-09-07T19:13:17.623 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2022-09-07T19:13:17.623 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-07T19:13:17.624 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2022-09-07T19:13:17.624 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-07T19:13:17.625 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2022-09-07T19:13:17.625 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-07T19:13:17.625 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-07T19:13:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:13:17.626 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-07T19:13:17.627 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-07T19:13:17.627 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-07T19:13:17.628 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-07T19:13:17.628 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-09-07T19:13:17.650 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2022-09-07T19:13:17.672 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2022-09-07T19:13:17.672 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2022-09-07T19:13:17.733 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2022-09-07T19:13:17.733 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.6 (Ootpa)" 2022-09-07T19:13:17.734 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2022-09-07T19:13:17.734 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2022-09-07T19:13:17.735 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.6" 2022-09-07T19:13:17.735 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2022-09-07T19:13:17.736 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-07T19:13:17.736 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2022-09-07T19:13:17.737 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-07T19:13:17.737 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2022-09-07T19:13:17.737 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-07T19:13:17.738 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-07T19:13:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:13:17.739 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-07T19:13:17.739 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-07T19:13:17.740 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-07T19:13:17.740 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-07T19:13:17.741 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-09-07T19:13:17.764 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-09-07T19:13:17.779 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-09-07T19:13:17.814 INFO:teuthology.task.internal:Checking for old test directory... 2022-09-07T19:13:17.815 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2022-09-07T19:13:17.818 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2022-09-07T19:13:17.821 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2022-09-07T19:13:17.840 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-09-07T19:13:17.850 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-09-07T19:13:17.851 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2022-09-07T19:13:17.877 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2022-09-07T19:13:17.880 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2022-09-07T19:13:17.917 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-09-07T19:13:18.014 INFO:teuthology.run_tasks:Running task kernel... 2022-09-07T19:13:18.040 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2022-09-07T19:13:18.042 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2022-09-07T19:13:18.042 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2022-09-07T19:13:18.043 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-07T19:13:18.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-07T19:13:18.064 DEBUG:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2022-09-07T19:13:18.159 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterprise 2022-09-07T19:13:18.160 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:13:18.161 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2022-09-07T19:13:18.387 DEBUG:teuthology.task.kernel:sha1 for client.0 is a127ffb7df2a46d9c720771310f2b324a2af81f2 2022-09-07T19:13:18.388 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a127ffb7df2a46d9c720771310f2b324a2af81f2"... 2022-09-07T19:13:18.388 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2022-09-07T19:13:18.408 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-372.9.1.el8.x86_64 2022-09-07T19:13:18.409 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a127ffb7df2a46d9c720771310f2b324a2af81f2 2022-09-07T19:13:18.409 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-09-07T19:13:18.410 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum upgrade -y linux-firmware 2022-09-07T19:13:19.451 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2022-09-07T19:13:19.452 INFO:teuthology.orchestra.run.smithi080.stdout:Unable to read consumer identity 2022-09-07T19:13:19.520 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:13:19.520 INFO:teuthology.orchestra.run.smithi080.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-07T19:13:19.520 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:13:20.837 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2022-09-07T19:13:21.829 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:00 2022-09-07T19:13:24.662 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 395 kB/s | 24 kB 00:00 2022-09-07T19:13:25.333 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2022-09-07T19:13:25.334 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2022-09-07T19:13:25.334 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2022-09-07T19:13:25.474 INFO:teuthology.task.kernel:Downloading kernel a127ffb7df2a46d9c720771310f2b324a2af81f2 on client.0... 2022-09-07T19:13:25.475 DEBUG:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2022-09-07T19:13:25.517 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterprise 2022-09-07T19:13:25.519 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:13:25.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a127ffb7df2a46d9c720771310f2b324a2af81f2 2022-09-07T19:13:25.671 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/a127ffb7df2a46d9c720771310f2b324a2af81f2/centos/8/flavors/default/x86_64/ 2022-09-07T19:13:25.672 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.0.0_rc4_ceph_ga127ffb7df2a-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/a127ffb7df2a46d9c720771310f2b324a2af81f2/centos/8/flavors/default/x86_64/ --input-file=- 2022-09-07T19:13:25.674 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi080.front.sepia.ceph.com to complete... 2022-09-07T19:13:43.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07 19:13:43 URL:https://4.chacra.ceph.com/r/kernel/testing/a127ffb7df2a46d9c720771310f2b324a2af81f2/centos/8/flavors/default/x86_64/kernel-6.0.0_rc4_ceph_ga127ffb7df2a-1.x86_64.rpm [528623720/528623720] -> "/tmp/kernel.x86_64.rpm" [1] 2022-09-07T19:13:43.679 INFO:teuthology.orchestra.run.smithi080.stderr:FINISHED --2022-09-07 19:13:43-- 2022-09-07T19:13:43.679 INFO:teuthology.orchestra.run.smithi080.stderr:Total wall clock time: 18s 2022-09-07T19:13:43.680 INFO:teuthology.orchestra.run.smithi080.stderr:Downloaded: 1 files, 504M in 18s (28.4 MB/s) 2022-09-07T19:13:43.682 INFO:teuthology.task.kernel:Installing kernel a127ffb7df2a46d9c720771310f2b324a2af81f2 on client.0... 2022-09-07T19:13:43.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-09-07T19:13:45.770 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying... ######################################## 2022-09-07T19:13:45.892 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing... ######################################## 2022-09-07T19:13:46.010 INFO:teuthology.orchestra.run.smithi080.stdout:Updating / installing... 2022-09-07T19:14:25.970 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-6.0.0_rc4_ceph_ga127ffb7df2a-1 ######################################## 2022-09-07T19:14:50.190 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-09-07T19:14:50.192 DEBUG:teuthology.orchestra.run.smithi080:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-09-07T19:14:50.266 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/System.map-6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.266 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/config-6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.266 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/vmlinux-6.0.0-rc4-ceph-ga127ffb7df2a.bz2 2022-09-07T19:14:50.267 INFO:teuthology.orchestra.run.smithi080.stdout:/boot/vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.267 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.267 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel 2022-09-07T19:14:50.267 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch 2022-09-07T19:14:50.268 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86 2022-09-07T19:14:50.268 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto 2022-09-07T19:14:50.268 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-09-07T19:14:50.268 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-09-07T19:14:50.269 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-09-07T19:14:50.269 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-09-07T19:14:50.269 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-09-07T19:14:50.269 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-09-07T19:14:50.269 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-09-07T19:14:50.270 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/crc32c-intel.ko 2022-09-07T19:14:50.270 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-09-07T19:14:50.270 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-09-07T19:14:50.271 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-09-07T19:14:50.271 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-09-07T19:14:50.272 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/serpent-avx2.ko 2022-09-07T19:14:50.272 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-09-07T19:14:50.272 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-09-07T19:14:50.272 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-09-07T19:14:50.273 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-09-07T19:14:50.273 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-09-07T19:14:50.273 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-09-07T19:14:50.273 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-09-07T19:14:50.273 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kernel 2022-09-07T19:14:50.274 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kernel/cpu 2022-09-07T19:14:50.274 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kernel/cpu/mce 2022-09-07T19:14:50.274 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-09-07T19:14:50.275 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kvm 2022-09-07T19:14:50.275 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kvm/kvm-amd.ko 2022-09-07T19:14:50.275 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kvm/kvm-intel.ko 2022-09-07T19:14:50.275 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/arch/x86/kvm/kvm.ko 2022-09-07T19:14:50.276 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto 2022-09-07T19:14:50.276 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/ansi_cprng.ko 2022-09-07T19:14:50.276 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/anubis.ko 2022-09-07T19:14:50.276 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/arc4.ko 2022-09-07T19:14:50.276 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx 2022-09-07T19:14:50.277 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx/async_memcpy.ko 2022-09-07T19:14:50.277 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx/async_pq.ko 2022-09-07T19:14:50.277 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx/async_raid6_recov.ko 2022-09-07T19:14:50.277 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx/async_tx.ko 2022-09-07T19:14:50.278 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx/async_xor.ko 2022-09-07T19:14:50.278 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/async_tx/raid6test.ko 2022-09-07T19:14:50.278 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/authenc.ko 2022-09-07T19:14:50.279 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/authencesn.ko 2022-09-07T19:14:50.279 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/blake2b_generic.ko 2022-09-07T19:14:50.279 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/blowfish_common.ko 2022-09-07T19:14:50.279 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/blowfish_generic.ko 2022-09-07T19:14:50.280 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/camellia_generic.ko 2022-09-07T19:14:50.280 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/cast5_generic.ko 2022-09-07T19:14:50.280 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/cast6_generic.ko 2022-09-07T19:14:50.281 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/cast_common.ko 2022-09-07T19:14:50.281 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/ccm.ko 2022-09-07T19:14:50.281 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/cmac.ko 2022-09-07T19:14:50.282 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/crc32_generic.ko 2022-09-07T19:14:50.282 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/crypto_engine.ko 2022-09-07T19:14:50.282 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/crypto_user.ko 2022-09-07T19:14:50.283 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/cts.ko 2022-09-07T19:14:50.283 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/des_generic.ko 2022-09-07T19:14:50.283 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/dh_generic.ko 2022-09-07T19:14:50.283 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/echainiv.ko 2022-09-07T19:14:50.284 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/essiv.ko 2022-09-07T19:14:50.284 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/fcrypt.ko 2022-09-07T19:14:50.284 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/khazad.ko 2022-09-07T19:14:50.284 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/lz4.ko 2022-09-07T19:14:50.285 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/lz4hc.ko 2022-09-07T19:14:50.285 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/md4.ko 2022-09-07T19:14:50.285 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/michael_mic.ko 2022-09-07T19:14:50.285 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/pcbc.ko 2022-09-07T19:14:50.286 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/pcrypt.ko 2022-09-07T19:14:50.286 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/rmd160.ko 2022-09-07T19:14:50.286 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/seed.ko 2022-09-07T19:14:50.286 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/serpent_generic.ko 2022-09-07T19:14:50.287 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/tcrypt.ko 2022-09-07T19:14:50.287 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/tea.ko 2022-09-07T19:14:50.287 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/twofish_common.ko 2022-09-07T19:14:50.287 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/twofish_generic.ko 2022-09-07T19:14:50.287 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/vmac.ko 2022-09-07T19:14:50.288 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/wp512.ko 2022-09-07T19:14:50.288 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/xcbc.ko 2022-09-07T19:14:50.288 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/xor.ko 2022-09-07T19:14:50.288 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/crypto/xxhash_generic.ko 2022-09-07T19:14:50.289 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers 2022-09-07T19:14:50.289 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi 2022-09-07T19:14:50.289 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/acpi_ipmi.ko 2022-09-07T19:14:50.289 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/acpi_pad.ko 2022-09-07T19:14:50.289 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/custom_method.ko 2022-09-07T19:14:50.290 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/ec_sys.ko 2022-09-07T19:14:50.290 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/platform_profile.ko 2022-09-07T19:14:50.290 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/sbs.ko 2022-09-07T19:14:50.290 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/sbshc.ko 2022-09-07T19:14:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/acpi/video.ko 2022-09-07T19:14:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata 2022-09-07T19:14:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/acard-ahci.ko 2022-09-07T19:14:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/ahci_platform.ko 2022-09-07T19:14:50.292 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/ata_generic.ko 2022-09-07T19:14:50.292 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/libahci_platform.ko 2022-09-07T19:14:50.292 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_acpi.ko 2022-09-07T19:14:50.293 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_ali.ko 2022-09-07T19:14:50.293 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_amd.ko 2022-09-07T19:14:50.293 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_artop.ko 2022-09-07T19:14:50.294 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_atiixp.ko 2022-09-07T19:14:50.294 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_atp867x.ko 2022-09-07T19:14:50.294 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_cmd640.ko 2022-09-07T19:14:50.295 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_cmd64x.ko 2022-09-07T19:14:50.295 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_cypress.ko 2022-09-07T19:14:50.295 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_efar.ko 2022-09-07T19:14:50.295 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_hpt366.ko 2022-09-07T19:14:50.296 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_hpt37x.ko 2022-09-07T19:14:50.296 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_hpt3x2n.ko 2022-09-07T19:14:50.296 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_hpt3x3.ko 2022-09-07T19:14:50.296 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_it8213.ko 2022-09-07T19:14:50.297 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_it821x.ko 2022-09-07T19:14:50.297 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_jmicron.ko 2022-09-07T19:14:50.297 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_marvell.ko 2022-09-07T19:14:50.297 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_mpiix.ko 2022-09-07T19:14:50.298 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_netcell.ko 2022-09-07T19:14:50.298 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_ninja32.ko 2022-09-07T19:14:50.298 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_ns87410.ko 2022-09-07T19:14:50.298 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_ns87415.ko 2022-09-07T19:14:50.299 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_oldpiix.ko 2022-09-07T19:14:50.299 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_opti.ko 2022-09-07T19:14:50.299 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_optidma.ko 2022-09-07T19:14:50.299 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_pcmcia.ko 2022-09-07T19:14:50.300 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_pdc2027x.ko 2022-09-07T19:14:50.300 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-09-07T19:14:50.300 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_piccolo.ko 2022-09-07T19:14:50.300 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_rdc.ko 2022-09-07T19:14:50.300 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_sch.ko 2022-09-07T19:14:50.301 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_serverworks.ko 2022-09-07T19:14:50.301 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_sil680.ko 2022-09-07T19:14:50.301 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_sis.ko 2022-09-07T19:14:50.301 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_sl82c105.ko 2022-09-07T19:14:50.302 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_triflex.ko 2022-09-07T19:14:50.302 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pata_via.ko 2022-09-07T19:14:50.302 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/pdc_adma.ko 2022-09-07T19:14:50.303 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_inic162x.ko 2022-09-07T19:14:50.303 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_mv.ko 2022-09-07T19:14:50.303 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_nv.ko 2022-09-07T19:14:50.304 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_promise.ko 2022-09-07T19:14:50.304 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_qstor.ko 2022-09-07T19:14:50.304 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_sil.ko 2022-09-07T19:14:50.304 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_sil24.ko 2022-09-07T19:14:50.305 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_sis.ko 2022-09-07T19:14:50.305 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_svw.ko 2022-09-07T19:14:50.305 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_sx4.ko 2022-09-07T19:14:50.305 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_uli.ko 2022-09-07T19:14:50.306 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_via.ko 2022-09-07T19:14:50.306 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ata/sata_vsc.ko 2022-09-07T19:14:50.306 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/auxdisplay 2022-09-07T19:14:50.306 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/auxdisplay/ks0108.ko 2022-09-07T19:14:50.306 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/base 2022-09-07T19:14:50.307 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/base/regmap 2022-09-07T19:14:50.307 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/base/regmap/regmap-i2c.ko 2022-09-07T19:14:50.307 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/bcma 2022-09-07T19:14:50.307 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/bcma/bcma.ko 2022-09-07T19:14:50.308 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block 2022-09-07T19:14:50.308 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/aoe 2022-09-07T19:14:50.308 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/aoe/aoe.ko 2022-09-07T19:14:50.308 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/brd.ko 2022-09-07T19:14:50.309 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/drbd 2022-09-07T19:14:50.309 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/drbd/drbd.ko 2022-09-07T19:14:50.309 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/floppy.ko 2022-09-07T19:14:50.309 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/loop.ko 2022-09-07T19:14:50.309 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/mtip32xx 2022-09-07T19:14:50.310 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-09-07T19:14:50.310 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/nbd.ko 2022-09-07T19:14:50.310 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/null_blk 2022-09-07T19:14:50.310 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/null_blk/null_blk.ko 2022-09-07T19:14:50.311 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/pktcdvd.ko 2022-09-07T19:14:50.311 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/rbd.ko 2022-09-07T19:14:50.311 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/virtio_blk.ko 2022-09-07T19:14:50.311 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/xen-blkback 2022-09-07T19:14:50.312 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-09-07T19:14:50.312 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/xen-blkfront.ko 2022-09-07T19:14:50.312 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/zram 2022-09-07T19:14:50.312 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/block/zram/zram.ko 2022-09-07T19:14:50.313 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char 2022-09-07T19:14:50.313 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hangcheck-timer.ko 2022-09-07T19:14:50.313 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hw_random 2022-09-07T19:14:50.314 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hw_random/amd-rng.ko 2022-09-07T19:14:50.314 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hw_random/intel-rng.ko 2022-09-07T19:14:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-09-07T19:14:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hw_random/via-rng.ko 2022-09-07T19:14:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/hw_random/virtio-rng.ko 2022-09-07T19:14:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi 2022-09-07T19:14:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-09-07T19:14:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-09-07T19:14:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-09-07T19:14:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi/ipmi_si.ko 2022-09-07T19:14:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-09-07T19:14:50.317 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-09-07T19:14:50.317 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/lp.ko 2022-09-07T19:14:50.317 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/mwave 2022-09-07T19:14:50.317 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/mwave/mwave.ko 2022-09-07T19:14:50.318 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/pcmcia 2022-09-07T19:14:50.318 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-09-07T19:14:50.318 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-09-07T19:14:50.318 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/ppdev.ko 2022-09-07T19:14:50.319 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tlclk.ko 2022-09-07T19:14:50.319 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm 2022-09-07T19:14:50.319 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm/tpm.ko 2022-09-07T19:14:50.319 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm/tpm_atmel.ko 2022-09-07T19:14:50.320 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm/tpm_infineon.ko 2022-09-07T19:14:50.320 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm/tpm_nsc.ko 2022-09-07T19:14:50.320 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm/tpm_tis.ko 2022-09-07T19:14:50.320 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-09-07T19:14:50.321 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/uv_mmtimer.ko 2022-09-07T19:14:50.321 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/char/virtio_console.ko 2022-09-07T19:14:50.321 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq 2022-09-07T19:14:50.321 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-09-07T19:14:50.321 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-09-07T19:14:50.322 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq/p4-clockmod.ko 2022-09-07T19:14:50.322 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-09-07T19:14:50.322 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq/powernow-k8.ko 2022-09-07T19:14:50.323 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/cpufreq/speedstep-lib.ko 2022-09-07T19:14:50.323 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto 2022-09-07T19:14:50.323 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/ccp 2022-09-07T19:14:50.323 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-09-07T19:14:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/ccp/ccp.ko 2022-09-07T19:14:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/padlock-aes.ko 2022-09-07T19:14:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/padlock-sha.ko 2022-09-07T19:14:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/qat 2022-09-07T19:14:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/qat/qat_common 2022-09-07T19:14:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-09-07T19:14:50.326 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/qat/qat_dh895xcc 2022-09-07T19:14:50.326 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-09-07T19:14:50.326 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/virtio 2022-09-07T19:14:50.326 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-09-07T19:14:50.327 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dca 2022-09-07T19:14:50.327 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dca/dca.ko 2022-09-07T19:14:50.327 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/devfreq 2022-09-07T19:14:50.327 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-09-07T19:14:50.328 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dma 2022-09-07T19:14:50.328 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dma/dw 2022-09-07T19:14:50.328 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dma/dw/dw_dmac.ko 2022-09-07T19:14:50.328 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dma/ioat 2022-09-07T19:14:50.329 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/dma/ioat/ioatdma.ko 2022-09-07T19:14:50.329 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac 2022-09-07T19:14:50.329 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/amd64_edac.ko 2022-09-07T19:14:50.329 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/e752x_edac.ko 2022-09-07T19:14:50.330 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/edac_mce_amd.ko 2022-09-07T19:14:50.330 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i3000_edac.ko 2022-09-07T19:14:50.331 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i3200_edac.ko 2022-09-07T19:14:50.331 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i5000_edac.ko 2022-09-07T19:14:50.331 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i5100_edac.ko 2022-09-07T19:14:50.331 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i5400_edac.ko 2022-09-07T19:14:50.332 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i7300_edac.ko 2022-09-07T19:14:50.332 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i7core_edac.ko 2022-09-07T19:14:50.332 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/i82975x_edac.ko 2022-09-07T19:14:50.332 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/ie31200_edac.ko 2022-09-07T19:14:50.332 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/sb_edac.ko 2022-09-07T19:14:50.333 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/edac/x38_edac.ko 2022-09-07T19:14:50.333 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/firmware 2022-09-07T19:14:50.333 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/firmware/edd.ko 2022-09-07T19:14:50.333 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/firmware/iscsi_ibft.ko 2022-09-07T19:14:50.334 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/gpio 2022-09-07T19:14:50.334 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/gpio/gpio-ich.ko 2022-09-07T19:14:50.334 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/gpio/gpio-viperboard.ko 2022-09-07T19:14:50.334 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid 2022-09-07T19:14:50.335 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-appleir.ko 2022-09-07T19:14:50.335 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-aureal.ko 2022-09-07T19:14:50.335 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-axff.ko 2022-09-07T19:14:50.335 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-dr.ko 2022-09-07T19:14:50.335 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-elecom.ko 2022-09-07T19:14:50.336 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-elo.ko 2022-09-07T19:14:50.336 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-emsff.ko 2022-09-07T19:14:50.336 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-gaff.ko 2022-09-07T19:14:50.336 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-gt683r.ko 2022-09-07T19:14:50.337 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-gyration.ko 2022-09-07T19:14:50.337 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-holtek-kbd.ko 2022-09-07T19:14:50.337 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-holtek-mouse.ko 2022-09-07T19:14:50.337 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-holtekff.ko 2022-09-07T19:14:50.337 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-hyperv.ko 2022-09-07T19:14:50.338 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-icade.ko 2022-09-07T19:14:50.338 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-keytouch.ko 2022-09-07T19:14:50.338 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-kye.ko 2022-09-07T19:14:50.338 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-lcpower.ko 2022-09-07T19:14:50.339 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-led.ko 2022-09-07T19:14:50.339 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-lenovo.ko 2022-09-07T19:14:50.339 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-logitech-dj.ko 2022-09-07T19:14:50.339 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-09-07T19:14:50.339 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-multitouch.ko 2022-09-07T19:14:50.340 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-ortek.ko 2022-09-07T19:14:50.340 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-penmount.ko 2022-09-07T19:14:50.340 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-petalynx.ko 2022-09-07T19:14:50.340 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-picolcd.ko 2022-09-07T19:14:50.341 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-pl.ko 2022-09-07T19:14:50.341 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-plantronics.ko 2022-09-07T19:14:50.341 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-primax.ko 2022-09-07T19:14:50.341 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-rmi.ko 2022-09-07T19:14:50.341 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-arvo.ko 2022-09-07T19:14:50.342 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-common.ko 2022-09-07T19:14:50.342 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-isku.ko 2022-09-07T19:14:50.342 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-kone.ko 2022-09-07T19:14:50.342 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-09-07T19:14:50.343 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-konepure.ko 2022-09-07T19:14:50.343 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-09-07T19:14:50.343 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-lua.ko 2022-09-07T19:14:50.343 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-pyra.ko 2022-09-07T19:14:50.343 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-ryos.ko 2022-09-07T19:14:50.344 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat-savu.ko 2022-09-07T19:14:50.344 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-roccat.ko 2022-09-07T19:14:50.344 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-saitek.ko 2022-09-07T19:14:50.344 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-samsung.ko 2022-09-07T19:14:50.345 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-sensor-hub.ko 2022-09-07T19:14:50.345 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-sjoy.ko 2022-09-07T19:14:50.345 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-sony.ko 2022-09-07T19:14:50.345 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-speedlink.ko 2022-09-07T19:14:50.346 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-steelseries.ko 2022-09-07T19:14:50.346 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-sunplus.ko 2022-09-07T19:14:50.346 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-thrustmaster.ko 2022-09-07T19:14:50.346 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-tivo.ko 2022-09-07T19:14:50.347 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-tmff.ko 2022-09-07T19:14:50.347 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-topseed.ko 2022-09-07T19:14:50.347 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-twinhan.ko 2022-09-07T19:14:50.347 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-uclogic.ko 2022-09-07T19:14:50.348 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-waltop.ko 2022-09-07T19:14:50.348 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-wiimote.ko 2022-09-07T19:14:50.348 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-xinmo.ko 2022-09-07T19:14:50.348 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-zpff.ko 2022-09-07T19:14:50.348 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/hid-zydacron.ko 2022-09-07T19:14:50.349 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/uhid.ko 2022-09-07T19:14:50.349 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hid/wacom.ko 2022-09-07T19:14:50.349 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hv 2022-09-07T19:14:50.349 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hv/hv_balloon.ko 2022-09-07T19:14:50.350 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hv/hv_utils.ko 2022-09-07T19:14:50.350 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hv/hv_vmbus.ko 2022-09-07T19:14:50.350 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon 2022-09-07T19:14:50.350 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/abituguru.ko 2022-09-07T19:14:50.351 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/abituguru3.ko 2022-09-07T19:14:50.351 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/acpi_power_meter.ko 2022-09-07T19:14:50.351 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ad7414.ko 2022-09-07T19:14:50.351 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ad7418.ko 2022-09-07T19:14:50.352 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adc128d818.ko 2022-09-07T19:14:50.352 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adm1025.ko 2022-09-07T19:14:50.352 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adm1026.ko 2022-09-07T19:14:50.352 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adm1029.ko 2022-09-07T19:14:50.352 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adm1031.ko 2022-09-07T19:14:50.353 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adm9240.ko 2022-09-07T19:14:50.353 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ads7828.ko 2022-09-07T19:14:50.353 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adt7410.ko 2022-09-07T19:14:50.353 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adt7411.ko 2022-09-07T19:14:50.354 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adt7462.ko 2022-09-07T19:14:50.354 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adt7470.ko 2022-09-07T19:14:50.354 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adt7475.ko 2022-09-07T19:14:50.354 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/adt7x10.ko 2022-09-07T19:14:50.355 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/amc6821.ko 2022-09-07T19:14:50.355 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/applesmc.ko 2022-09-07T19:14:50.355 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/asb100.ko 2022-09-07T19:14:50.355 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/asc7621.ko 2022-09-07T19:14:50.355 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/asus_atk0110.ko 2022-09-07T19:14:50.356 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/atxp1.ko 2022-09-07T19:14:50.356 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/coretemp.ko 2022-09-07T19:14:50.356 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-09-07T19:14:50.356 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/dme1737.ko 2022-09-07T19:14:50.357 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ds1621.ko 2022-09-07T19:14:50.357 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ds620.ko 2022-09-07T19:14:50.357 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/emc1403.ko 2022-09-07T19:14:50.357 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/emc6w201.ko 2022-09-07T19:14:50.357 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/f71805f.ko 2022-09-07T19:14:50.358 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/f71882fg.ko 2022-09-07T19:14:50.358 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/f75375s.ko 2022-09-07T19:14:50.358 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/fam15h_power.ko 2022-09-07T19:14:50.358 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/fschmd.ko 2022-09-07T19:14:50.359 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/g760a.ko 2022-09-07T19:14:50.359 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/g762.ko 2022-09-07T19:14:50.359 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/gl518sm.ko 2022-09-07T19:14:50.359 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/gl520sm.ko 2022-09-07T19:14:50.359 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/hwmon-vid.ko 2022-09-07T19:14:50.360 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/i5500_temp.ko 2022-09-07T19:14:50.360 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/i5k_amb.ko 2022-09-07T19:14:50.360 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ibmaem.ko 2022-09-07T19:14:50.360 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ibmpex.ko 2022-09-07T19:14:50.361 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ina209.ko 2022-09-07T19:14:50.361 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ina2xx.ko 2022-09-07T19:14:50.361 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/it87.ko 2022-09-07T19:14:50.361 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/k10temp.ko 2022-09-07T19:14:50.361 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/k8temp.ko 2022-09-07T19:14:50.362 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lineage-pem.ko 2022-09-07T19:14:50.362 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm63.ko 2022-09-07T19:14:50.362 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm73.ko 2022-09-07T19:14:50.362 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm75.ko 2022-09-07T19:14:50.363 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm77.ko 2022-09-07T19:14:50.363 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm78.ko 2022-09-07T19:14:50.363 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm80.ko 2022-09-07T19:14:50.363 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm83.ko 2022-09-07T19:14:50.364 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm85.ko 2022-09-07T19:14:50.364 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm87.ko 2022-09-07T19:14:50.364 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm90.ko 2022-09-07T19:14:50.364 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm92.ko 2022-09-07T19:14:50.364 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm93.ko 2022-09-07T19:14:50.365 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm95234.ko 2022-09-07T19:14:50.365 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm95241.ko 2022-09-07T19:14:50.365 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/lm95245.ko 2022-09-07T19:14:50.365 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc2945.ko 2022-09-07T19:14:50.365 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc4151.ko 2022-09-07T19:14:50.366 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc4215.ko 2022-09-07T19:14:50.366 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc4222.ko 2022-09-07T19:14:50.366 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc4245.ko 2022-09-07T19:14:50.366 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc4260.ko 2022-09-07T19:14:50.367 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/ltc4261.ko 2022-09-07T19:14:50.367 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max16065.ko 2022-09-07T19:14:50.367 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max1619.ko 2022-09-07T19:14:50.367 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max1668.ko 2022-09-07T19:14:50.368 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max197.ko 2022-09-07T19:14:50.368 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max6639.ko 2022-09-07T19:14:50.368 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max6650.ko 2022-09-07T19:14:50.368 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/max6697.ko 2022-09-07T19:14:50.368 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/mcp3021.ko 2022-09-07T19:14:50.369 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/nct6683.ko 2022-09-07T19:14:50.369 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/nct6775-core.ko 2022-09-07T19:14:50.369 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/nct6775.ko 2022-09-07T19:14:50.369 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/nct7802.ko 2022-09-07T19:14:50.370 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pc87360.ko 2022-09-07T19:14:50.370 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pc87427.ko 2022-09-07T19:14:50.370 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pcf8591.ko 2022-09-07T19:14:50.370 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus 2022-09-07T19:14:50.371 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-09-07T19:14:50.371 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-09-07T19:14:50.371 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-09-07T19:14:50.371 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/max16064.ko 2022-09-07T19:14:50.371 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/max34440.ko 2022-09-07T19:14:50.372 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/max8688.ko 2022-09-07T19:14:50.372 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-09-07T19:14:50.372 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-09-07T19:14:50.372 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-09-07T19:14:50.372 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-09-07T19:14:50.373 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-09-07T19:14:50.373 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-09-07T19:14:50.373 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/powr1220.ko 2022-09-07T19:14:50.373 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/sch5627.ko 2022-09-07T19:14:50.374 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/sch5636.ko 2022-09-07T19:14:50.374 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/sch56xx-common.ko 2022-09-07T19:14:50.374 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/sht15.ko 2022-09-07T19:14:50.374 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/sht21.ko 2022-09-07T19:14:50.375 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/shtc1.ko 2022-09-07T19:14:50.375 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/sis5595.ko 2022-09-07T19:14:50.375 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/smsc47b397.ko 2022-09-07T19:14:50.375 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/smsc47m1.ko 2022-09-07T19:14:50.375 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/smsc47m192.ko 2022-09-07T19:14:50.376 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/thmc50.ko 2022-09-07T19:14:50.376 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/tmp102.ko 2022-09-07T19:14:50.376 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/tmp103.ko 2022-09-07T19:14:50.376 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/tmp401.ko 2022-09-07T19:14:50.377 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/tmp421.ko 2022-09-07T19:14:50.377 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/via-cputemp.ko 2022-09-07T19:14:50.377 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/via686a.ko 2022-09-07T19:14:50.377 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/vt1211.ko 2022-09-07T19:14:50.378 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/vt8231.ko 2022-09-07T19:14:50.378 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83627ehf.ko 2022-09-07T19:14:50.378 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83627hf.ko 2022-09-07T19:14:50.378 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83781d.ko 2022-09-07T19:14:50.378 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83791d.ko 2022-09-07T19:14:50.379 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83792d.ko 2022-09-07T19:14:50.379 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83793.ko 2022-09-07T19:14:50.379 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83795.ko 2022-09-07T19:14:50.379 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83l785ts.ko 2022-09-07T19:14:50.380 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/hwmon/w83l786ng.ko 2022-09-07T19:14:50.380 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c 2022-09-07T19:14:50.380 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/algos 2022-09-07T19:14:50.380 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-09-07T19:14:50.380 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-09-07T19:14:50.381 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses 2022-09-07T19:14:50.381 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-09-07T19:14:50.381 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-09-07T19:14:50.381 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-09-07T19:14:50.382 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2022-09-07T19:14:50.382 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-09-07T19:14:50.382 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-09-07T19:14:50.382 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-09-07T19:14:50.382 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-09-07T19:14:50.383 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-i801.ko 2022-09-07T19:14:50.383 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-isch.ko 2022-09-07T19:14:50.383 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-09-07T19:14:50.383 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-09-07T19:14:50.384 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-09-07T19:14:50.384 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-parport.ko 2022-09-07T19:14:50.384 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-09-07T19:14:50.384 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-09-07T19:14:50.384 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-09-07T19:14:50.385 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-09-07T19:14:50.385 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-09-07T19:14:50.385 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-09-07T19:14:50.385 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-via.ko 2022-09-07T19:14:50.386 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-09-07T19:14:50.386 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-09-07T19:14:50.386 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/i2c-dev.ko 2022-09-07T19:14:50.386 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/i2c-mux.ko 2022-09-07T19:14:50.386 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-09-07T19:14:50.387 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/i2c-smbus.ko 2022-09-07T19:14:50.387 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/i2c/i2c-stub.ko 2022-09-07T19:14:50.387 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband 2022-09-07T19:14:50.387 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core 2022-09-07T19:14:50.388 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/ib_cm.ko 2022-09-07T19:14:50.388 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/ib_core.ko 2022-09-07T19:14:50.388 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/ib_umad.ko 2022-09-07T19:14:50.388 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-09-07T19:14:50.388 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/iw_cm.ko 2022-09-07T19:14:50.389 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/rdma_cm.ko 2022-09-07T19:14:50.389 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-09-07T19:14:50.389 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw 2022-09-07T19:14:50.389 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/cxgb4 2022-09-07T19:14:50.390 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-09-07T19:14:50.390 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/mlx4 2022-09-07T19:14:50.390 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-09-07T19:14:50.390 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/mlx5 2022-09-07T19:14:50.391 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-09-07T19:14:50.391 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/mthca 2022-09-07T19:14:50.391 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-09-07T19:14:50.391 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp 2022-09-07T19:14:50.391 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/ipoib 2022-09-07T19:14:50.392 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-09-07T19:14:50.392 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/iser 2022-09-07T19:14:50.392 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-09-07T19:14:50.392 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/isert 2022-09-07T19:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-09-07T19:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/srp 2022-09-07T19:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-09-07T19:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/srpt 2022-09-07T19:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-09-07T19:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input 2022-09-07T19:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/gameport 2022-09-07T19:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-09-07T19:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/gameport/fm801-gp.ko 2022-09-07T19:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/gameport/gameport.ko 2022-09-07T19:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/gameport/lightning.ko 2022-09-07T19:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/gameport/ns558.ko 2022-09-07T19:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/joydev.ko 2022-09-07T19:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/keyboard 2022-09-07T19:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/keyboard/gpio_keys.ko 2022-09-07T19:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse 2022-09-07T19:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/appletouch.ko 2022-09-07T19:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/bcm5974.ko 2022-09-07T19:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/cyapatp.ko 2022-09-07T19:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/elan_i2c.ko 2022-09-07T19:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/sermouse.ko 2022-09-07T19:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-09-07T19:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/synaptics_usb.ko 2022-09-07T19:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/mouse/vsxxxaa.ko 2022-09-07T19:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/rmi4 2022-09-07T19:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/rmi4/rmi_core.ko 2022-09-07T19:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/serio 2022-09-07T19:14:50.399 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/serio/altera_ps2.ko 2022-09-07T19:14:50.399 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/serio/arc_ps2.ko 2022-09-07T19:14:50.399 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-09-07T19:14:50.399 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/serio/serio_raw.ko 2022-09-07T19:14:50.400 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/input/sparse-keymap.ko 2022-09-07T19:14:50.400 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/iommu 2022-09-07T19:14:50.400 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/iommu/amd 2022-09-07T19:14:50.400 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/iommu/amd/iommu_v2.ko 2022-09-07T19:14:50.400 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds 2022-09-07T19:14:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/leds-blinkm.ko 2022-09-07T19:14:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/leds-lm3530.ko 2022-09-07T19:14:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/leds-lp3944.ko 2022-09-07T19:14:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/leds-ss4200.ko 2022-09-07T19:14:50.402 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger 2022-09-07T19:14:50.402 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-09-07T19:14:50.402 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-09-07T19:14:50.402 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-09-07T19:14:50.402 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-09-07T19:14:50.403 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-09-07T19:14:50.403 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-09-07T19:14:50.403 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-09-07T19:14:50.403 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-09-07T19:14:50.404 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-09-07T19:14:50.404 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md 2022-09-07T19:14:50.404 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/bcache 2022-09-07T19:14:50.404 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/bcache/bcache.ko 2022-09-07T19:14:50.405 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-bio-prison.ko 2022-09-07T19:14:50.405 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-cache-smq.ko 2022-09-07T19:14:50.405 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-cache.ko 2022-09-07T19:14:50.405 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-crypt.ko 2022-09-07T19:14:50.405 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-delay.ko 2022-09-07T19:14:50.406 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-flakey.ko 2022-09-07T19:14:50.406 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-log-userspace.ko 2022-09-07T19:14:50.406 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-multipath.ko 2022-09-07T19:14:50.406 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-queue-length.ko 2022-09-07T19:14:50.407 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-raid.ko 2022-09-07T19:14:50.407 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-round-robin.ko 2022-09-07T19:14:50.407 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-service-time.ko 2022-09-07T19:14:50.407 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-switch.ko 2022-09-07T19:14:50.407 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-thin-pool.ko 2022-09-07T19:14:50.408 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/dm-verity.ko 2022-09-07T19:14:50.408 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/faulty.ko 2022-09-07T19:14:50.408 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/linear.ko 2022-09-07T19:14:50.408 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/multipath.ko 2022-09-07T19:14:50.408 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/persistent-data 2022-09-07T19:14:50.409 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-09-07T19:14:50.409 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/raid0.ko 2022-09-07T19:14:50.409 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/raid1.ko 2022-09-07T19:14:50.409 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/raid10.ko 2022-09-07T19:14:50.410 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/md/raid456.ko 2022-09-07T19:14:50.410 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message 2022-09-07T19:14:50.410 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion 2022-09-07T19:14:50.410 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptbase.ko 2022-09-07T19:14:50.411 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptctl.ko 2022-09-07T19:14:50.411 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptfc.ko 2022-09-07T19:14:50.411 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptlan.ko 2022-09-07T19:14:50.411 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptsas.ko 2022-09-07T19:14:50.411 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptscsih.ko 2022-09-07T19:14:50.412 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/message/fusion/mptspi.ko 2022-09-07T19:14:50.412 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd 2022-09-07T19:14:50.412 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/lpc_ich.ko 2022-09-07T19:14:50.412 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/lpc_sch.ko 2022-09-07T19:14:50.413 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/mfd-core.ko 2022-09-07T19:14:50.413 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/sm501.ko 2022-09-07T19:14:50.413 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/viperboard.ko 2022-09-07T19:14:50.413 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/vx855.ko 2022-09-07T19:14:50.413 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/mfd/wl1273-core.ko 2022-09-07T19:14:50.414 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc 2022-09-07T19:14:50.414 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/altera-stapl 2022-09-07T19:14:50.414 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-09-07T19:14:50.414 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/apds9802als.ko 2022-09-07T19:14:50.415 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/apds990x.ko 2022-09-07T19:14:50.415 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/bh1770glc.ko 2022-09-07T19:14:50.415 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/cb710 2022-09-07T19:14:50.415 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/cb710/cb710.ko 2022-09-07T19:14:50.415 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/eeprom 2022-09-07T19:14:50.416 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/eeprom/at24.ko 2022-09-07T19:14:50.416 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/eeprom/eeprom.ko 2022-09-07T19:14:50.416 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-09-07T19:14:50.416 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/eeprom/max6875.ko 2022-09-07T19:14:50.417 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/enclosure.ko 2022-09-07T19:14:50.417 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/hpilo.ko 2022-09-07T19:14:50.417 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/isl29003.ko 2022-09-07T19:14:50.417 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/isl29020.ko 2022-09-07T19:14:50.417 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/lis3lv02d 2022-09-07T19:14:50.418 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-09-07T19:14:50.418 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-09-07T19:14:50.418 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/mei 2022-09-07T19:14:50.418 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/mei/mei-me.ko 2022-09-07T19:14:50.419 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/mei/mei-txe.ko 2022-09-07T19:14:50.419 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/mei/mei.ko 2022-09-07T19:14:50.419 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/sgi-gru 2022-09-07T19:14:50.419 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/sgi-gru/gru.ko 2022-09-07T19:14:50.420 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/sgi-xp 2022-09-07T19:14:50.420 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/sgi-xp/xp.ko 2022-09-07T19:14:50.420 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/sgi-xp/xpc.ko 2022-09-07T19:14:50.420 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-09-07T19:14:50.420 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/tifm_7xx1.ko 2022-09-07T19:14:50.421 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/tifm_core.ko 2022-09-07T19:14:50.421 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/tsl2550.ko 2022-09-07T19:14:50.421 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/vmw_balloon.ko 2022-09-07T19:14:50.421 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/vmw_vmci 2022-09-07T19:14:50.422 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-09-07T19:14:50.422 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net 2022-09-07T19:14:50.422 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/bonding 2022-09-07T19:14:50.422 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/bonding/bonding.ko 2022-09-07T19:14:50.423 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa 2022-09-07T19:14:50.423 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa/b53 2022-09-07T19:14:50.423 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa/b53/b53_common.ko 2022-09-07T19:14:50.423 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa/bcm-sf2.ko 2022-09-07T19:14:50.423 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa/mv88e6060.ko 2022-09-07T19:14:50.424 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa/mv88e6xxx 2022-09-07T19:14:50.424 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-09-07T19:14:50.424 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/dummy.ko 2022-09-07T19:14:50.424 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/eql.ko 2022-09-07T19:14:50.425 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet 2022-09-07T19:14:50.425 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/3com 2022-09-07T19:14:50.425 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-09-07T19:14:50.425 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-09-07T19:14:50.425 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-09-07T19:14:50.426 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-09-07T19:14:50.426 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/8390 2022-09-07T19:14:50.426 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/8390/8390.ko 2022-09-07T19:14:50.426 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-09-07T19:14:50.427 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-09-07T19:14:50.427 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-09-07T19:14:50.427 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/adaptec 2022-09-07T19:14:50.427 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-09-07T19:14:50.427 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/agere 2022-09-07T19:14:50.428 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/agere/et131x.ko 2022-09-07T19:14:50.428 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/alteon 2022-09-07T19:14:50.428 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-09-07T19:14:50.428 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/altera 2022-09-07T19:14:50.429 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-09-07T19:14:50.429 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/amd 2022-09-07T19:14:50.429 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-09-07T19:14:50.429 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-09-07T19:14:50.429 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-09-07T19:14:50.430 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros 2022-09-07T19:14:50.430 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/alx 2022-09-07T19:14:50.430 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-09-07T19:14:50.430 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atl1c 2022-09-07T19:14:50.431 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-09-07T19:14:50.431 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atl1e 2022-09-07T19:14:50.431 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-09-07T19:14:50.431 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atlx 2022-09-07T19:14:50.431 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-09-07T19:14:50.432 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-09-07T19:14:50.432 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom 2022-09-07T19:14:50.432 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-09-07T19:14:50.432 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-09-07T19:14:50.433 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-09-07T19:14:50.433 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-09-07T19:14:50.433 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-09-07T19:14:50.433 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/genet 2022-09-07T19:14:50.433 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-09-07T19:14:50.434 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-09-07T19:14:50.434 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/brocade 2022-09-07T19:14:50.434 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/brocade/bna 2022-09-07T19:14:50.434 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-09-07T19:14:50.435 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio 2022-09-07T19:14:50.435 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb 2022-09-07T19:14:50.435 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-09-07T19:14:50.435 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-09-07T19:14:50.436 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-09-07T19:14:50.436 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-09-07T19:14:50.436 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-09-07T19:14:50.436 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-09-07T19:14:50.436 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-09-07T19:14:50.437 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-09-07T19:14:50.437 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-09-07T19:14:50.437 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/cisco 2022-09-07T19:14:50.437 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/cisco/enic 2022-09-07T19:14:50.438 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-09-07T19:14:50.438 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec 2022-09-07T19:14:50.438 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip 2022-09-07T19:14:50.438 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-09-07T19:14:50.438 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-09-07T19:14:50.439 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-09-07T19:14:50.439 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-09-07T19:14:50.439 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-09-07T19:14:50.439 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-09-07T19:14:50.440 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dlink 2022-09-07T19:14:50.440 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-09-07T19:14:50.440 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-09-07T19:14:50.440 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/dnet.ko 2022-09-07T19:14:50.440 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/emulex 2022-09-07T19:14:50.441 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/emulex/benet 2022-09-07T19:14:50.441 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-09-07T19:14:50.441 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/ethoc.ko 2022-09-07T19:14:50.441 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/fealnx.ko 2022-09-07T19:14:50.442 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel 2022-09-07T19:14:50.442 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/e100.ko 2022-09-07T19:14:50.442 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/e1000 2022-09-07T19:14:50.442 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-09-07T19:14:50.443 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/e1000e 2022-09-07T19:14:50.443 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-09-07T19:14:50.443 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/fm10k 2022-09-07T19:14:50.443 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-09-07T19:14:50.443 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/i40e 2022-09-07T19:14:50.444 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-09-07T19:14:50.444 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/iavf 2022-09-07T19:14:50.444 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-09-07T19:14:50.444 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/igb 2022-09-07T19:14:50.445 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-09-07T19:14:50.445 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/igbvf 2022-09-07T19:14:50.445 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-09-07T19:14:50.445 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/ixgb 2022-09-07T19:14:50.445 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-09-07T19:14:50.446 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/ixgbe 2022-09-07T19:14:50.446 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-09-07T19:14:50.446 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/ixgbevf 2022-09-07T19:14:50.446 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-09-07T19:14:50.447 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/jme.ko 2022-09-07T19:14:50.447 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/marvell 2022-09-07T19:14:50.447 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-09-07T19:14:50.447 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/marvell/skge.ko 2022-09-07T19:14:50.448 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-09-07T19:14:50.448 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox 2022-09-07T19:14:50.448 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox/mlx4 2022-09-07T19:14:50.448 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-09-07T19:14:50.448 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-09-07T19:14:50.449 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox/mlx5 2022-09-07T19:14:50.449 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-09-07T19:14:50.449 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-09-07T19:14:50.449 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/micrel 2022-09-07T19:14:50.450 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-09-07T19:14:50.450 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/myricom 2022-09-07T19:14:50.450 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/myricom/myri10ge 2022-09-07T19:14:50.450 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-09-07T19:14:50.451 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/natsemi 2022-09-07T19:14:50.451 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-09-07T19:14:50.451 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-09-07T19:14:50.451 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/neterion 2022-09-07T19:14:50.451 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-09-07T19:14:50.452 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/nvidia 2022-09-07T19:14:50.452 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-09-07T19:14:50.452 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/packetengines 2022-09-07T19:14:50.452 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-09-07T19:14:50.452 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-09-07T19:14:50.453 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/qlogic 2022-09-07T19:14:50.453 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/qlogic/netxen 2022-09-07T19:14:50.453 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-09-07T19:14:50.453 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-09-07T19:14:50.454 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-09-07T19:14:50.454 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-09-07T19:14:50.454 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/rdc 2022-09-07T19:14:50.454 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-09-07T19:14:50.455 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/realtek 2022-09-07T19:14:50.455 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-09-07T19:14:50.455 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-09-07T19:14:50.455 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/realtek/atp.ko 2022-09-07T19:14:50.455 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-09-07T19:14:50.456 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/rocker 2022-09-07T19:14:50.456 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-09-07T19:14:50.456 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sfc 2022-09-07T19:14:50.456 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-09-07T19:14:50.457 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/silan 2022-09-07T19:14:50.457 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-09-07T19:14:50.457 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sis 2022-09-07T19:14:50.457 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sis/sis190.ko 2022-09-07T19:14:50.457 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sis/sis900.ko 2022-09-07T19:14:50.458 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/smsc 2022-09-07T19:14:50.458 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-09-07T19:14:50.458 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-09-07T19:14:50.458 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-09-07T19:14:50.459 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-09-07T19:14:50.459 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/stmicro 2022-09-07T19:14:50.459 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/stmicro/stmmac 2022-09-07T19:14:50.459 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-09-07T19:14:50.459 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-09-07T19:14:50.460 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sun 2022-09-07T19:14:50.460 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sun/cassini.ko 2022-09-07T19:14:50.460 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sun/niu.ko 2022-09-07T19:14:50.460 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sun/sungem.ko 2022-09-07T19:14:50.461 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-09-07T19:14:50.461 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/tehuti 2022-09-07T19:14:50.461 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-09-07T19:14:50.461 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/ti 2022-09-07T19:14:50.461 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/ti/tlan.ko 2022-09-07T19:14:50.462 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/via 2022-09-07T19:14:50.462 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-09-07T19:14:50.462 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-09-07T19:14:50.462 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/wiznet 2022-09-07T19:14:50.463 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-09-07T19:14:50.463 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-09-07T19:14:50.463 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/xircom 2022-09-07T19:14:50.463 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-09-07T19:14:50.463 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/geneve.ko 2022-09-07T19:14:50.464 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/hyperv 2022-09-07T19:14:50.464 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-09-07T19:14:50.464 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ieee802154 2022-09-07T19:14:50.464 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ieee802154/fakelb.ko 2022-09-07T19:14:50.465 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ifb.ko 2022-09-07T19:14:50.465 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ipvlan 2022-09-07T19:14:50.465 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ipvlan/ipvlan.ko 2022-09-07T19:14:50.465 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/macvlan.ko 2022-09-07T19:14:50.465 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/macvtap.ko 2022-09-07T19:14:50.466 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/mdio 2022-09-07T19:14:50.466 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/mdio.ko 2022-09-07T19:14:50.466 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-09-07T19:14:50.466 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-09-07T19:14:50.467 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/mii.ko 2022-09-07T19:14:50.467 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/net_failover.ko 2022-09-07T19:14:50.467 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/netconsole.ko 2022-09-07T19:14:50.467 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/nlmon.ko 2022-09-07T19:14:50.468 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/pcs 2022-09-07T19:14:50.468 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-09-07T19:14:50.468 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy 2022-09-07T19:14:50.468 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/amd.ko 2022-09-07T19:14:50.469 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-09-07T19:14:50.469 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/bcm-phy-ptp.ko 2022-09-07T19:14:50.469 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/bcm7xxx.ko 2022-09-07T19:14:50.469 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/bcm87xx.ko 2022-09-07T19:14:50.469 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/broadcom.ko 2022-09-07T19:14:50.470 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/cicada.ko 2022-09-07T19:14:50.470 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/davicom.ko 2022-09-07T19:14:50.470 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/dp83640.ko 2022-09-07T19:14:50.470 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/et1011c.ko 2022-09-07T19:14:50.471 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/icplus.ko 2022-09-07T19:14:50.471 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/lxt.ko 2022-09-07T19:14:50.471 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/marvell.ko 2022-09-07T19:14:50.471 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/micrel.ko 2022-09-07T19:14:50.471 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/national.ko 2022-09-07T19:14:50.472 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/phylink.ko 2022-09-07T19:14:50.472 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/qsemi.ko 2022-09-07T19:14:50.472 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/realtek.ko 2022-09-07T19:14:50.472 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/smsc.ko 2022-09-07T19:14:50.473 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/ste10Xp.ko 2022-09-07T19:14:50.473 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/phy/vitesse.ko 2022-09-07T19:14:50.473 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp 2022-09-07T19:14:50.473 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/bsd_comp.ko 2022-09-07T19:14:50.473 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/ppp_async.ko 2022-09-07T19:14:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/ppp_deflate.ko 2022-09-07T19:14:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/ppp_generic.ko 2022-09-07T19:14:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/ppp_mppe.ko 2022-09-07T19:14:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/ppp_synctty.ko 2022-09-07T19:14:50.475 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/pppoe.ko 2022-09-07T19:14:50.475 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/pppox.ko 2022-09-07T19:14:50.475 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/ppp/pptp.ko 2022-09-07T19:14:50.475 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/slip 2022-09-07T19:14:50.475 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/slip/slhc.ko 2022-09-07T19:14:50.476 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/slip/slip.ko 2022-09-07T19:14:50.476 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/sungem_phy.ko 2022-09-07T19:14:50.476 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/tap.ko 2022-09-07T19:14:50.476 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team 2022-09-07T19:14:50.477 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team/team.ko 2022-09-07T19:14:50.477 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team/team_mode_activebackup.ko 2022-09-07T19:14:50.477 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team/team_mode_broadcast.ko 2022-09-07T19:14:50.477 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-09-07T19:14:50.478 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team/team_mode_random.ko 2022-09-07T19:14:50.478 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-09-07T19:14:50.478 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/tun.ko 2022-09-07T19:14:50.478 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/veth.ko 2022-09-07T19:14:50.478 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/virtio_net.ko 2022-09-07T19:14:50.479 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/vmxnet3 2022-09-07T19:14:50.479 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-09-07T19:14:50.479 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/vxlan 2022-09-07T19:14:50.479 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/vxlan/vxlan.ko 2022-09-07T19:14:50.480 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/xen-netback 2022-09-07T19:14:50.480 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/xen-netback/xen-netback.ko 2022-09-07T19:14:50.480 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/net/xen-netfront.ko 2022-09-07T19:14:50.480 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ntb 2022-09-07T19:14:50.480 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ntb/ntb.ko 2022-09-07T19:14:50.481 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/nvme 2022-09-07T19:14:50.481 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/nvme/host 2022-09-07T19:14:50.481 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/nvme/host/nvme-core.ko 2022-09-07T19:14:50.481 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/nvme/host/nvme.ko 2022-09-07T19:14:50.482 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/parport 2022-09-07T19:14:50.482 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/parport/parport.ko 2022-09-07T19:14:50.482 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/parport/parport_cs.ko 2022-09-07T19:14:50.482 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/parport/parport_pc.ko 2022-09-07T19:14:50.482 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/parport/parport_serial.ko 2022-09-07T19:14:50.483 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pci 2022-09-07T19:14:50.483 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pci/hotplug 2022-09-07T19:14:50.483 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-09-07T19:14:50.483 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pci/pcie 2022-09-07T19:14:50.484 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pci/pcie/aer_inject.ko 2022-09-07T19:14:50.484 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pci/xen-pcifront.ko 2022-09-07T19:14:50.484 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pcmcia 2022-09-07T19:14:50.484 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pcmcia/i82092.ko 2022-09-07T19:14:50.484 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pcmcia/pd6729.ko 2022-09-07T19:14:50.485 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pcmcia/yenta_socket.ko 2022-09-07T19:14:50.485 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pinctrl 2022-09-07T19:14:50.485 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pinctrl/intel 2022-09-07T19:14:50.485 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-09-07T19:14:50.486 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform 2022-09-07T19:14:50.486 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86 2022-09-07T19:14:50.486 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/acer-wmi.ko 2022-09-07T19:14:50.486 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/acerhdf.ko 2022-09-07T19:14:50.486 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/apple-gmux.ko 2022-09-07T19:14:50.487 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/asus-laptop.ko 2022-09-07T19:14:50.487 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-09-07T19:14:50.487 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/asus-wmi.ko 2022-09-07T19:14:50.487 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/classmate-laptop.ko 2022-09-07T19:14:50.488 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-09-07T19:14:50.488 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-09-07T19:14:50.488 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-09-07T19:14:50.488 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-09-07T19:14:50.488 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/hdaps.ko 2022-09-07T19:14:50.489 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/hp-wmi.ko 2022-09-07T19:14:50.489 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/hp_accel.ko 2022-09-07T19:14:50.489 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/intel 2022-09-07T19:14:50.489 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-09-07T19:14:50.490 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/intel_ips.ko 2022-09-07T19:14:50.490 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/msi-wmi.ko 2022-09-07T19:14:50.490 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/mxm-wmi.ko 2022-09-07T19:14:50.490 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-09-07T19:14:50.491 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/samsung-laptop.ko 2022-09-07T19:14:50.491 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/samsung-q10.ko 2022-09-07T19:14:50.491 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/topstar-laptop.ko 2022-09-07T19:14:50.491 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-09-07T19:14:50.491 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/toshiba_haps.ko 2022-09-07T19:14:50.492 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/wmi-bmof.ko 2022-09-07T19:14:50.492 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/platform/x86/wmi.ko 2022-09-07T19:14:50.492 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/powercap 2022-09-07T19:14:50.492 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/powercap/intel_rapl_common.ko 2022-09-07T19:14:50.493 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/powercap/intel_rapl_msr.ko 2022-09-07T19:14:50.493 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pps 2022-09-07T19:14:50.493 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pps/clients 2022-09-07T19:14:50.493 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pps/clients/pps-gpio.ko 2022-09-07T19:14:50.493 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pps/clients/pps-ldisc.ko 2022-09-07T19:14:50.494 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pps/clients/pps_parport.ko 2022-09-07T19:14:50.494 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/pps/pps_core.ko 2022-09-07T19:14:50.494 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ptp 2022-09-07T19:14:50.494 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ptp/ptp.ko 2022-09-07T19:14:50.495 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ptp/ptp_kvm.ko 2022-09-07T19:14:50.495 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc 2022-09-07T19:14:50.495 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-bq32k.ko 2022-09-07T19:14:50.495 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-bq4802.ko 2022-09-07T19:14:50.496 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1286.ko 2022-09-07T19:14:50.496 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1307.ko 2022-09-07T19:14:50.496 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1374.ko 2022-09-07T19:14:50.496 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1511.ko 2022-09-07T19:14:50.496 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1553.ko 2022-09-07T19:14:50.497 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1672.ko 2022-09-07T19:14:50.497 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds1742.ko 2022-09-07T19:14:50.497 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds2404.ko 2022-09-07T19:14:50.497 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-ds3232.ko 2022-09-07T19:14:50.498 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-em3027.ko 2022-09-07T19:14:50.498 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-fm3130.ko 2022-09-07T19:14:50.498 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-isl12022.ko 2022-09-07T19:14:50.498 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-isl1208.ko 2022-09-07T19:14:50.498 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-m41t80.ko 2022-09-07T19:14:50.499 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-m48t35.ko 2022-09-07T19:14:50.499 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-m48t59.ko 2022-09-07T19:14:50.499 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-max6900.ko 2022-09-07T19:14:50.499 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-msm6242.ko 2022-09-07T19:14:50.500 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-pcf2127.ko 2022-09-07T19:14:50.500 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-pcf85063.ko 2022-09-07T19:14:50.500 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-pcf8523.ko 2022-09-07T19:14:50.500 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-pcf8563.ko 2022-09-07T19:14:50.500 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-pcf8583.ko 2022-09-07T19:14:50.501 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-rp5c01.ko 2022-09-07T19:14:50.501 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-rs5c372.ko 2022-09-07T19:14:50.501 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-09-07T19:14:50.501 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-rx8025.ko 2022-09-07T19:14:50.502 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-rx8581.ko 2022-09-07T19:14:50.502 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-09-07T19:14:50.502 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-v3020.ko 2022-09-07T19:14:50.502 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/rtc/rtc-x1205.ko 2022-09-07T19:14:50.502 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi 2022-09-07T19:14:50.503 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/3w-9xxx.ko 2022-09-07T19:14:50.503 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/3w-sas.ko 2022-09-07T19:14:50.503 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/3w-xxxx.ko 2022-09-07T19:14:50.503 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/BusLogic.ko 2022-09-07T19:14:50.504 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/a100u2w.ko 2022-09-07T19:14:50.504 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/aacraid 2022-09-07T19:14:50.504 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/aacraid/aacraid.ko 2022-09-07T19:14:50.504 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/advansys.ko 2022-09-07T19:14:50.504 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/aic7xxx 2022-09-07T19:14:50.505 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-09-07T19:14:50.505 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-09-07T19:14:50.505 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/am53c974.ko 2022-09-07T19:14:50.505 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/arcmsr 2022-09-07T19:14:50.505 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-09-07T19:14:50.506 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/atp870u.ko 2022-09-07T19:14:50.506 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/be2iscsi 2022-09-07T19:14:50.506 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-09-07T19:14:50.506 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/bfa 2022-09-07T19:14:50.507 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/bfa/bfa.ko 2022-09-07T19:14:50.507 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/bnx2fc 2022-09-07T19:14:50.507 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-09-07T19:14:50.507 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/bnx2i 2022-09-07T19:14:50.507 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-09-07T19:14:50.508 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/ch.ko 2022-09-07T19:14:50.508 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/csiostor 2022-09-07T19:14:50.508 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/csiostor/csiostor.ko 2022-09-07T19:14:50.508 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/cxgbi 2022-09-07T19:14:50.509 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/cxgbi/cxgb3i 2022-09-07T19:14:50.509 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-09-07T19:14:50.509 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/cxgbi/cxgb4i 2022-09-07T19:14:50.509 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-09-07T19:14:50.509 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-09-07T19:14:50.510 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/dc395x.ko 2022-09-07T19:14:50.510 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/device_handler 2022-09-07T19:14:50.510 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-09-07T19:14:50.510 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-09-07T19:14:50.511 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-09-07T19:14:50.511 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-09-07T19:14:50.511 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/dmx3191d.ko 2022-09-07T19:14:50.511 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/esas2r 2022-09-07T19:14:50.511 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/esas2r/esas2r.ko 2022-09-07T19:14:50.512 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/esp_scsi.ko 2022-09-07T19:14:50.512 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/fcoe 2022-09-07T19:14:50.512 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/fcoe/fcoe.ko 2022-09-07T19:14:50.512 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-09-07T19:14:50.513 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/fnic 2022-09-07T19:14:50.513 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/fnic/fnic.ko 2022-09-07T19:14:50.513 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/hpsa.ko 2022-09-07T19:14:50.513 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/hptiop.ko 2022-09-07T19:14:50.513 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/hv_storvsc.ko 2022-09-07T19:14:50.514 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/initio.ko 2022-09-07T19:14:50.514 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/ipr.ko 2022-09-07T19:14:50.514 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/ips.ko 2022-09-07T19:14:50.514 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/isci 2022-09-07T19:14:50.515 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/isci/isci.ko 2022-09-07T19:14:50.515 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-09-07T19:14:50.515 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/iscsi_tcp.ko 2022-09-07T19:14:50.515 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/libfc 2022-09-07T19:14:50.516 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/libfc/libfc.ko 2022-09-07T19:14:50.516 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/libiscsi.ko 2022-09-07T19:14:50.516 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/libiscsi_tcp.ko 2022-09-07T19:14:50.516 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/libsas 2022-09-07T19:14:50.516 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/libsas/libsas.ko 2022-09-07T19:14:50.517 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/lpfc 2022-09-07T19:14:50.517 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/lpfc/lpfc.ko 2022-09-07T19:14:50.517 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/megaraid 2022-09-07T19:14:50.517 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/megaraid.ko 2022-09-07T19:14:50.518 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-09-07T19:14:50.518 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-09-07T19:14:50.518 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-09-07T19:14:50.518 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/mpt3sas 2022-09-07T19:14:50.518 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-09-07T19:14:50.519 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/mvsas 2022-09-07T19:14:50.519 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/mvsas/mvsas.ko 2022-09-07T19:14:50.519 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/mvumi.ko 2022-09-07T19:14:50.519 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/pm8001 2022-09-07T19:14:50.520 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-09-07T19:14:50.520 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/pmcraid.ko 2022-09-07T19:14:50.520 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/qla1280.ko 2022-09-07T19:14:50.520 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/qla2xxx 2022-09-07T19:14:50.520 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-09-07T19:14:50.521 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-09-07T19:14:50.521 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/qla4xxx 2022-09-07T19:14:50.521 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-09-07T19:14:50.521 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/raid_class.ko 2022-09-07T19:14:50.522 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/scsi_debug.ko 2022-09-07T19:14:50.522 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/scsi_transport_fc.ko 2022-09-07T19:14:50.522 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-09-07T19:14:50.522 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/scsi_transport_sas.ko 2022-09-07T19:14:50.522 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/scsi_transport_spi.ko 2022-09-07T19:14:50.523 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/scsi_transport_srp.ko 2022-09-07T19:14:50.523 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/ses.ko 2022-09-07T19:14:50.523 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/st.ko 2022-09-07T19:14:50.523 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/stex.ko 2022-09-07T19:14:50.524 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/sym53c8xx_2 2022-09-07T19:14:50.524 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-09-07T19:14:50.524 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/virtio_scsi.ko 2022-09-07T19:14:50.524 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/vmw_pvscsi.ko 2022-09-07T19:14:50.524 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/scsi/wd719x.ko 2022-09-07T19:14:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ssb 2022-09-07T19:14:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ssb/ssb.ko 2022-09-07T19:14:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target 2022-09-07T19:14:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/iscsi 2022-09-07T19:14:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-09-07T19:14:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/loopback 2022-09-07T19:14:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/loopback/tcm_loop.ko 2022-09-07T19:14:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/target_core_file.ko 2022-09-07T19:14:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/target_core_iblock.ko 2022-09-07T19:14:50.527 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/target_core_mod.ko 2022-09-07T19:14:50.527 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/target_core_pscsi.ko 2022-09-07T19:14:50.527 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/target_core_user.ko 2022-09-07T19:14:50.527 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/tcm_fc 2022-09-07T19:14:50.528 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-09-07T19:14:50.528 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal 2022-09-07T19:14:50.528 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel 2022-09-07T19:14:50.528 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal 2022-09-07T19:14:50.528 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-09-07T19:14:50.529 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-09-07T19:14:50.529 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-09-07T19:14:50.529 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-09-07T19:14:50.529 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-09-07T19:14:50.530 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-09-07T19:14:50.530 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-09-07T19:14:50.530 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-09-07T19:14:50.530 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-09-07T19:14:50.530 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-09-07T19:14:50.531 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-09-07T19:14:50.531 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-09-07T19:14:50.531 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-09-07T19:14:50.531 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-09-07T19:14:50.532 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-09-07T19:14:50.532 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty 2022-09-07T19:14:50.532 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/ipwireless 2022-09-07T19:14:50.532 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-09-07T19:14:50.533 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/n_gsm.ko 2022-09-07T19:14:50.533 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/n_hdlc.ko 2022-09-07T19:14:50.533 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/nozomi.ko 2022-09-07T19:14:50.533 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/serial 2022-09-07T19:14:50.533 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/serial/8250 2022-09-07T19:14:50.534 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-09-07T19:14:50.534 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/serial/arc_uart.ko 2022-09-07T19:14:50.534 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/serial/jsm 2022-09-07T19:14:50.534 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/serial/jsm/jsm.ko 2022-09-07T19:14:50.535 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/tty/synclink_gt.ko 2022-09-07T19:14:50.535 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ufs 2022-09-07T19:14:50.535 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ufs/core 2022-09-07T19:14:50.535 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ufs/core/ufshcd-core.ko 2022-09-07T19:14:50.535 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ufs/host 2022-09-07T19:14:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/ufs/host/ufshcd-pci.ko 2022-09-07T19:14:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/uio 2022-09-07T19:14:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/uio/uio.ko 2022-09-07T19:14:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/uio/uio_aec.ko 2022-09-07T19:14:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/uio/uio_cif.ko 2022-09-07T19:14:50.537 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/uio/uio_pci_generic.ko 2022-09-07T19:14:50.537 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/uio/uio_sercos3.ko 2022-09-07T19:14:50.537 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb 2022-09-07T19:14:50.537 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/class 2022-09-07T19:14:50.538 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/class/cdc-acm.ko 2022-09-07T19:14:50.538 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/class/cdc-wdm.ko 2022-09-07T19:14:50.538 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/class/usblp.ko 2022-09-07T19:14:50.538 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/class/usbtmc.ko 2022-09-07T19:14:50.539 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/host 2022-09-07T19:14:50.539 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/host/sl811-hcd.ko 2022-09-07T19:14:50.539 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/host/u132-hcd.ko 2022-09-07T19:14:50.539 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/image 2022-09-07T19:14:50.539 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/image/mdc800.ko 2022-09-07T19:14:50.540 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/image/microtek.ko 2022-09-07T19:14:50.540 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc 2022-09-07T19:14:50.540 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/adutux.ko 2022-09-07T19:14:50.540 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/appledisplay.ko 2022-09-07T19:14:50.541 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/emi26.ko 2022-09-07T19:14:50.541 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/emi62.ko 2022-09-07T19:14:50.541 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/ezusb.ko 2022-09-07T19:14:50.541 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/ftdi-elan.ko 2022-09-07T19:14:50.541 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/idmouse.ko 2022-09-07T19:14:50.542 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/iowarrior.ko 2022-09-07T19:14:50.542 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/isight_firmware.ko 2022-09-07T19:14:50.542 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/ldusb.ko 2022-09-07T19:14:50.542 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/legousbtower.ko 2022-09-07T19:14:50.543 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/sisusbvga 2022-09-07T19:14:50.543 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-09-07T19:14:50.543 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/trancevibrator.ko 2022-09-07T19:14:50.543 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/usb3503.ko 2022-09-07T19:14:50.543 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/usblcd.ko 2022-09-07T19:14:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/usbsevseg.ko 2022-09-07T19:14:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/uss720.ko 2022-09-07T19:14:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/misc/yurex.ko 2022-09-07T19:14:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/phy 2022-09-07T19:14:50.545 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/phy/phy-generic.ko 2022-09-07T19:14:50.545 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial 2022-09-07T19:14:50.545 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/aircable.ko 2022-09-07T19:14:50.545 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ark3116.ko 2022-09-07T19:14:50.545 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/belkin_sa.ko 2022-09-07T19:14:50.546 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ch341.ko 2022-09-07T19:14:50.546 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/cp210x.ko 2022-09-07T19:14:50.546 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/cyberjack.ko 2022-09-07T19:14:50.546 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/cypress_m8.ko 2022-09-07T19:14:50.547 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/digi_acceleport.ko 2022-09-07T19:14:50.547 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/empeg.ko 2022-09-07T19:14:50.547 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ftdi_sio.ko 2022-09-07T19:14:50.547 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/garmin_gps.ko 2022-09-07T19:14:50.547 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/io_edgeport.ko 2022-09-07T19:14:50.548 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/io_ti.ko 2022-09-07T19:14:50.548 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ipaq.ko 2022-09-07T19:14:50.548 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ipw.ko 2022-09-07T19:14:50.548 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ir-usb.ko 2022-09-07T19:14:50.549 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-09-07T19:14:50.549 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/keyspan.ko 2022-09-07T19:14:50.549 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/keyspan_pda.ko 2022-09-07T19:14:50.549 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/kl5kusb105.ko 2022-09-07T19:14:50.549 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/kobil_sct.ko 2022-09-07T19:14:50.550 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/mct_u232.ko 2022-09-07T19:14:50.550 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/mos7720.ko 2022-09-07T19:14:50.550 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/mos7840.ko 2022-09-07T19:14:50.550 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/navman.ko 2022-09-07T19:14:50.551 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/omninet.ko 2022-09-07T19:14:50.551 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/opticon.ko 2022-09-07T19:14:50.551 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/option.ko 2022-09-07T19:14:50.551 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/oti6858.ko 2022-09-07T19:14:50.551 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/pl2303.ko 2022-09-07T19:14:50.552 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/qcaux.ko 2022-09-07T19:14:50.552 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/qcserial.ko 2022-09-07T19:14:50.552 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/quatech2.ko 2022-09-07T19:14:50.552 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/safe_serial.ko 2022-09-07T19:14:50.553 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/sierra.ko 2022-09-07T19:14:50.553 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/spcp8x5.ko 2022-09-07T19:14:50.553 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ssu100.ko 2022-09-07T19:14:50.553 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/symbolserial.ko 2022-09-07T19:14:50.553 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-09-07T19:14:50.554 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-09-07T19:14:50.554 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/usb_debug.ko 2022-09-07T19:14:50.554 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/usb_wwan.ko 2022-09-07T19:14:50.554 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/visor.ko 2022-09-07T19:14:50.555 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/whiteheat.ko 2022-09-07T19:14:50.555 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/serial/xsens_mt.ko 2022-09-07T19:14:50.555 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage 2022-09-07T19:14:50.555 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/uas.ko 2022-09-07T19:14:50.555 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-alauda.ko 2022-09-07T19:14:50.556 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-cypress.ko 2022-09-07T19:14:50.556 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-datafab.ko 2022-09-07T19:14:50.556 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-09-07T19:14:50.556 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-freecom.ko 2022-09-07T19:14:50.557 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-isd200.ko 2022-09-07T19:14:50.557 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-09-07T19:14:50.557 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-karma.ko 2022-09-07T19:14:50.557 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-onetouch.ko 2022-09-07T19:14:50.557 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-realtek.ko 2022-09-07T19:14:50.558 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-sddr09.ko 2022-09-07T19:14:50.558 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-sddr55.ko 2022-09-07T19:14:50.558 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/ums-usbat.ko 2022-09-07T19:14:50.558 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/storage/usb-storage.ko 2022-09-07T19:14:50.559 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/usbip 2022-09-07T19:14:50.559 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/usbip/usbip-core.ko 2022-09-07T19:14:50.559 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/usbip/usbip-host.ko 2022-09-07T19:14:50.559 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-09-07T19:14:50.559 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio 2022-09-07T19:14:50.560 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio/pci 2022-09-07T19:14:50.560 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-09-07T19:14:50.560 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio/pci/vfio-pci.ko 2022-09-07T19:14:50.560 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio/vfio.ko 2022-09-07T19:14:50.561 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-09-07T19:14:50.561 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vfio/vfio_virqfd.ko 2022-09-07T19:14:50.561 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vhost 2022-09-07T19:14:50.561 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vhost/vhost.ko 2022-09-07T19:14:50.561 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vhost/vhost_iotlb.ko 2022-09-07T19:14:50.562 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vhost/vhost_net.ko 2022-09-07T19:14:50.562 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/vhost/vhost_scsi.ko 2022-09-07T19:14:50.562 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/video 2022-09-07T19:14:50.562 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/video/backlight 2022-09-07T19:14:50.563 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/video/backlight/apple_bl.ko 2022-09-07T19:14:50.563 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/video/backlight/lcd.ko 2022-09-07T19:14:50.563 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/video/backlight/platform_lcd.ko 2022-09-07T19:14:50.563 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio 2022-09-07T19:14:50.563 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio.ko 2022-09-07T19:14:50.564 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio_balloon.ko 2022-09-07T19:14:50.564 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio_mmio.ko 2022-09-07T19:14:50.564 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio_pci.ko 2022-09-07T19:14:50.564 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-09-07T19:14:50.565 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-09-07T19:14:50.565 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/virtio/virtio_ring.ko 2022-09-07T19:14:50.565 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1 2022-09-07T19:14:50.565 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/masters 2022-09-07T19:14:50.565 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/masters/ds1wm.ko 2022-09-07T19:14:50.566 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/masters/ds2482.ko 2022-09-07T19:14:50.566 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/masters/ds2490.ko 2022-09-07T19:14:50.566 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves 2022-09-07T19:14:50.566 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-09-07T19:14:50.567 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-09-07T19:14:50.567 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-09-07T19:14:50.567 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-09-07T19:14:50.567 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-09-07T19:14:50.567 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-09-07T19:14:50.568 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-09-07T19:14:50.568 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-09-07T19:14:50.568 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-09-07T19:14:50.568 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_smem.ko 2022-09-07T19:14:50.569 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/slaves/w1_therm.ko 2022-09-07T19:14:50.569 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/w1/wire.ko 2022-09-07T19:14:50.569 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog 2022-09-07T19:14:50.569 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/alim1535_wdt.ko 2022-09-07T19:14:50.569 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/alim7101_wdt.ko 2022-09-07T19:14:50.570 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/f71808e_wdt.ko 2022-09-07T19:14:50.570 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/hpwdt.ko 2022-09-07T19:14:50.570 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/i6300esb.ko 2022-09-07T19:14:50.570 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-09-07T19:14:50.571 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/iTCO_wdt.ko 2022-09-07T19:14:50.571 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/ib700wdt.ko 2022-09-07T19:14:50.571 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/ibmasr.ko 2022-09-07T19:14:50.571 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-09-07T19:14:50.572 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/it8712f_wdt.ko 2022-09-07T19:14:50.572 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/it87_wdt.ko 2022-09-07T19:14:50.572 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/machzwd.ko 2022-09-07T19:14:50.572 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/nv_tco.ko 2022-09-07T19:14:50.572 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/pcwd_pci.ko 2022-09-07T19:14:50.573 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/pcwd_usb.ko 2022-09-07T19:14:50.573 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-09-07T19:14:50.573 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/sch311x_wdt.ko 2022-09-07T19:14:50.573 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/softdog.ko 2022-09-07T19:14:50.573 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/sp5100_tco.ko 2022-09-07T19:14:50.574 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/via_wdt.ko 2022-09-07T19:14:50.574 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-09-07T19:14:50.574 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/w83877f_wdt.ko 2022-09-07T19:14:50.574 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/w83977f_wdt.ko 2022-09-07T19:14:50.575 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/wdt_pci.ko 2022-09-07T19:14:50.575 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/watchdog/xen_wdt.ko 2022-09-07T19:14:50.575 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen 2022-09-07T19:14:50.575 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-acpi-processor.ko 2022-09-07T19:14:50.575 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-evtchn.ko 2022-09-07T19:14:50.576 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-gntalloc.ko 2022-09-07T19:14:50.576 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-gntdev.ko 2022-09-07T19:14:50.576 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-pciback 2022-09-07T19:14:50.576 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-09-07T19:14:50.577 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xen-privcmd.ko 2022-09-07T19:14:50.577 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xenfs 2022-09-07T19:14:50.577 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/drivers/xen/xenfs/xenfs.ko 2022-09-07T19:14:50.577 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs 2022-09-07T19:14:50.577 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/9p 2022-09-07T19:14:50.578 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/9p/9p.ko 2022-09-07T19:14:50.578 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/affs 2022-09-07T19:14:50.578 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/affs/affs.ko 2022-09-07T19:14:50.578 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/befs 2022-09-07T19:14:50.579 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/befs/befs.ko 2022-09-07T19:14:50.579 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/binfmt_misc.ko 2022-09-07T19:14:50.579 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/btrfs 2022-09-07T19:14:50.579 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/btrfs/btrfs.ko 2022-09-07T19:14:50.579 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/cachefiles 2022-09-07T19:14:50.580 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/cachefiles/cachefiles.ko 2022-09-07T19:14:50.580 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ceph 2022-09-07T19:14:50.580 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ceph/ceph.ko 2022-09-07T19:14:50.580 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/cifs 2022-09-07T19:14:50.581 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/cifs/cifs.ko 2022-09-07T19:14:50.581 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/coda 2022-09-07T19:14:50.581 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/coda/coda.ko 2022-09-07T19:14:50.581 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/cramfs 2022-09-07T19:14:50.581 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/cramfs/cramfs.ko 2022-09-07T19:14:50.582 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/dlm 2022-09-07T19:14:50.582 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/dlm/dlm.ko 2022-09-07T19:14:50.582 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ecryptfs 2022-09-07T19:14:50.582 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ecryptfs/ecryptfs.ko 2022-09-07T19:14:50.583 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/f2fs 2022-09-07T19:14:50.583 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/f2fs/f2fs.ko 2022-09-07T19:14:50.583 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fat 2022-09-07T19:14:50.583 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fat/fat.ko 2022-09-07T19:14:50.583 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fat/msdos.ko 2022-09-07T19:14:50.584 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fat/vfat.ko 2022-09-07T19:14:50.584 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fscache 2022-09-07T19:14:50.584 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fscache/fscache.ko 2022-09-07T19:14:50.584 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fuse 2022-09-07T19:14:50.585 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fuse/cuse.ko 2022-09-07T19:14:50.585 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/fuse/fuse.ko 2022-09-07T19:14:50.585 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/gfs2 2022-09-07T19:14:50.585 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/gfs2/gfs2.ko 2022-09-07T19:14:50.585 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/hfs 2022-09-07T19:14:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/hfs/hfs.ko 2022-09-07T19:14:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/hfsplus 2022-09-07T19:14:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/hfsplus/hfsplus.ko 2022-09-07T19:14:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/isofs 2022-09-07T19:14:50.587 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/isofs/isofs.ko 2022-09-07T19:14:50.587 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/jfs 2022-09-07T19:14:50.587 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/jfs/jfs.ko 2022-09-07T19:14:50.587 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/lockd 2022-09-07T19:14:50.588 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/lockd/lockd.ko 2022-09-07T19:14:50.588 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/minix 2022-09-07T19:14:50.588 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/minix/minix.ko 2022-09-07T19:14:50.588 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/netfs 2022-09-07T19:14:50.588 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/netfs/netfs.ko 2022-09-07T19:14:50.589 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs 2022-09-07T19:14:50.589 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/blocklayout 2022-09-07T19:14:50.589 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-09-07T19:14:50.589 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/filelayout 2022-09-07T19:14:50.589 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-09-07T19:14:50.590 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/flexfilelayout 2022-09-07T19:14:50.590 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-09-07T19:14:50.590 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/nfs.ko 2022-09-07T19:14:50.590 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/nfsv3.ko 2022-09-07T19:14:50.591 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs/nfsv4.ko 2022-09-07T19:14:50.591 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs_common 2022-09-07T19:14:50.591 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs_common/grace.ko 2022-09-07T19:14:50.591 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfs_common/nfs_acl.ko 2022-09-07T19:14:50.592 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfsd 2022-09-07T19:14:50.592 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nfsd/nfsd.ko 2022-09-07T19:14:50.592 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nilfs2 2022-09-07T19:14:50.592 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nilfs2/nilfs2.ko 2022-09-07T19:14:50.592 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls 2022-09-07T19:14:50.593 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-celtic.ko 2022-09-07T19:14:50.593 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-centeuro.ko 2022-09-07T19:14:50.593 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-croatian.ko 2022-09-07T19:14:50.593 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-cyrillic.ko 2022-09-07T19:14:50.594 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-gaelic.ko 2022-09-07T19:14:50.594 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-greek.ko 2022-09-07T19:14:50.594 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-iceland.ko 2022-09-07T19:14:50.594 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-inuit.ko 2022-09-07T19:14:50.594 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-roman.ko 2022-09-07T19:14:50.595 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-romanian.ko 2022-09-07T19:14:50.595 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/mac-turkish.ko 2022-09-07T19:14:50.595 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp1250.ko 2022-09-07T19:14:50.595 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp1251.ko 2022-09-07T19:14:50.596 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp1255.ko 2022-09-07T19:14:50.596 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp737.ko 2022-09-07T19:14:50.596 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp775.ko 2022-09-07T19:14:50.596 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp850.ko 2022-09-07T19:14:50.596 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp852.ko 2022-09-07T19:14:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp855.ko 2022-09-07T19:14:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp857.ko 2022-09-07T19:14:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp860.ko 2022-09-07T19:14:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp861.ko 2022-09-07T19:14:50.598 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp862.ko 2022-09-07T19:14:50.598 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp863.ko 2022-09-07T19:14:50.598 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp864.ko 2022-09-07T19:14:50.598 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp865.ko 2022-09-07T19:14:50.598 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp866.ko 2022-09-07T19:14:50.599 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp869.ko 2022-09-07T19:14:50.599 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp874.ko 2022-09-07T19:14:50.599 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp932.ko 2022-09-07T19:14:50.599 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp936.ko 2022-09-07T19:14:50.600 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp949.ko 2022-09-07T19:14:50.600 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_cp950.ko 2022-09-07T19:14:50.600 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_euc-jp.ko 2022-09-07T19:14:50.600 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-1.ko 2022-09-07T19:14:50.600 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-13.ko 2022-09-07T19:14:50.601 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-14.ko 2022-09-07T19:14:50.601 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-15.ko 2022-09-07T19:14:50.601 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-2.ko 2022-09-07T19:14:50.601 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-3.ko 2022-09-07T19:14:50.602 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-4.ko 2022-09-07T19:14:50.602 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-5.ko 2022-09-07T19:14:50.602 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-6.ko 2022-09-07T19:14:50.602 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-7.ko 2022-09-07T19:14:50.602 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_iso8859-9.ko 2022-09-07T19:14:50.603 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_koi8-r.ko 2022-09-07T19:14:50.603 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_koi8-ru.ko 2022-09-07T19:14:50.603 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_koi8-u.ko 2022-09-07T19:14:50.603 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/nls/nls_utf8.ko 2022-09-07T19:14:50.604 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2 2022-09-07T19:14:50.604 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/cluster 2022-09-07T19:14:50.604 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-09-07T19:14:50.604 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/dlm 2022-09-07T19:14:50.604 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-09-07T19:14:50.605 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/dlmfs 2022-09-07T19:14:50.605 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-09-07T19:14:50.605 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/ocfs2.ko 2022-09-07T19:14:50.605 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-09-07T19:14:50.606 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-09-07T19:14:50.606 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-09-07T19:14:50.606 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/overlayfs 2022-09-07T19:14:50.606 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/overlayfs/overlay.ko 2022-09-07T19:14:50.606 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/pstore 2022-09-07T19:14:50.607 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/pstore/ramoops.ko 2022-09-07T19:14:50.607 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/reiserfs 2022-09-07T19:14:50.607 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/reiserfs/reiserfs.ko 2022-09-07T19:14:50.607 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/romfs 2022-09-07T19:14:50.608 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/romfs/romfs.ko 2022-09-07T19:14:50.608 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/smbfs_common 2022-09-07T19:14:50.608 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/smbfs_common/cifs_arc4.ko 2022-09-07T19:14:50.608 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/smbfs_common/cifs_md4.ko 2022-09-07T19:14:50.608 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/squashfs 2022-09-07T19:14:50.609 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/squashfs/squashfs.ko 2022-09-07T19:14:50.609 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/sysv 2022-09-07T19:14:50.609 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/sysv/sysv.ko 2022-09-07T19:14:50.609 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/udf 2022-09-07T19:14:50.610 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/udf/udf.ko 2022-09-07T19:14:50.610 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ufs 2022-09-07T19:14:50.610 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/ufs/ufs.ko 2022-09-07T19:14:50.610 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/xfs 2022-09-07T19:14:50.611 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/fs/xfs/xfs.ko 2022-09-07T19:14:50.611 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/kernel 2022-09-07T19:14:50.611 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/kernel/rcu 2022-09-07T19:14:50.611 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/kernel/rcu/rcutorture.ko 2022-09-07T19:14:50.611 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/kernel/torture.ko 2022-09-07T19:14:50.612 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/kernel/trace 2022-09-07T19:14:50.612 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-09-07T19:14:50.612 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib 2022-09-07T19:14:50.612 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/asn1_encoder.ko 2022-09-07T19:14:50.613 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/crc-itu-t.ko 2022-09-07T19:14:50.613 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/crc8.ko 2022-09-07T19:14:50.613 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/crypto 2022-09-07T19:14:50.613 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/crypto/libarc4.ko 2022-09-07T19:14:50.613 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/crypto/libdes.ko 2022-09-07T19:14:50.614 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/libcrc32c.ko 2022-09-07T19:14:50.614 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/lru_cache.ko 2022-09-07T19:14:50.614 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/lz4 2022-09-07T19:14:50.614 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/lz4/lz4_compress.ko 2022-09-07T19:14:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/lz4/lz4hc_compress.ko 2022-09-07T19:14:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/math 2022-09-07T19:14:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/math/cordic.ko 2022-09-07T19:14:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/raid6 2022-09-07T19:14:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/raid6/raid6_pq.ko 2022-09-07T19:14:50.616 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/reed_solomon 2022-09-07T19:14:50.616 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/reed_solomon/reed_solomon.ko 2022-09-07T19:14:50.616 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/ts_bm.ko 2022-09-07T19:14:50.616 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/ts_fsm.ko 2022-09-07T19:14:50.617 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/ts_kmp.ko 2022-09-07T19:14:50.617 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/zstd 2022-09-07T19:14:50.617 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/lib/zstd/zstd_compress.ko 2022-09-07T19:14:50.617 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/mm 2022-09-07T19:14:50.617 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/mm/hwpoison-inject.ko 2022-09-07T19:14:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net 2022-09-07T19:14:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan 2022-09-07T19:14:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/6lowpan.ko 2022-09-07T19:14:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_dest.ko 2022-09-07T19:14:50.619 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_fragment.ko 2022-09-07T19:14:50.619 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_hop.ko 2022-09-07T19:14:50.619 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_ipv6.ko 2022-09-07T19:14:50.619 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_mobility.ko 2022-09-07T19:14:50.619 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_routing.ko 2022-09-07T19:14:50.620 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/6lowpan/nhc_udp.ko 2022-09-07T19:14:50.620 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/802 2022-09-07T19:14:50.620 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/802/garp.ko 2022-09-07T19:14:50.620 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/802/mrp.ko 2022-09-07T19:14:50.621 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/802/p8022.ko 2022-09-07T19:14:50.621 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/802/psnap.ko 2022-09-07T19:14:50.621 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/802/stp.ko 2022-09-07T19:14:50.621 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/8021q 2022-09-07T19:14:50.621 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/8021q/8021q.ko 2022-09-07T19:14:50.622 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/9p 2022-09-07T19:14:50.622 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/9p/9pnet.ko 2022-09-07T19:14:50.622 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/9p/9pnet_fd.ko 2022-09-07T19:14:50.622 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/9p/9pnet_rdma.ko 2022-09-07T19:14:50.623 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/9p/9pnet_virtio.ko 2022-09-07T19:14:50.623 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/batman-adv 2022-09-07T19:14:50.623 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/batman-adv/batman-adv.ko 2022-09-07T19:14:50.623 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge 2022-09-07T19:14:50.624 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/br_netfilter.ko 2022-09-07T19:14:50.624 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/bridge.ko 2022-09-07T19:14:50.624 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter 2022-09-07T19:14:50.624 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-09-07T19:14:50.624 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_among.ko 2022-09-07T19:14:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_arp.ko 2022-09-07T19:14:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-09-07T19:14:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-09-07T19:14:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_ip.ko 2022-09-07T19:14:50.626 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-09-07T19:14:50.626 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_limit.ko 2022-09-07T19:14:50.626 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_log.ko 2022-09-07T19:14:50.626 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_mark.ko 2022-09-07T19:14:50.626 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-09-07T19:14:50.627 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-09-07T19:14:50.627 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-09-07T19:14:50.627 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-09-07T19:14:50.627 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_snat.ko 2022-09-07T19:14:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_stp.ko 2022-09-07T19:14:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-09-07T19:14:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-09-07T19:14:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-09-07T19:14:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-09-07T19:14:50.629 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/ebtables.ko 2022-09-07T19:14:50.629 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-09-07T19:14:50.629 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-09-07T19:14:50.629 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-09-07T19:14:50.630 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ceph 2022-09-07T19:14:50.630 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ceph/libceph.ko 2022-09-07T19:14:50.630 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/core 2022-09-07T19:14:50.630 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/core/failover.ko 2022-09-07T19:14:50.630 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/core/pktgen.ko 2022-09-07T19:14:50.631 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dccp 2022-09-07T19:14:50.631 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dccp/dccp.ko 2022-09-07T19:14:50.631 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dccp/dccp_diag.ko 2022-09-07T19:14:50.631 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dccp/dccp_ipv4.ko 2022-09-07T19:14:50.632 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dccp/dccp_ipv6.ko 2022-09-07T19:14:50.632 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dns_resolver 2022-09-07T19:14:50.632 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dns_resolver/dns_resolver.ko 2022-09-07T19:14:50.632 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dsa 2022-09-07T19:14:50.632 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dsa/dsa_core.ko 2022-09-07T19:14:50.633 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dsa/tag_brcm.ko 2022-09-07T19:14:50.633 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dsa/tag_dsa.ko 2022-09-07T19:14:50.633 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/dsa/tag_trailer.ko 2022-09-07T19:14:50.633 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ieee802154 2022-09-07T19:14:50.633 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ieee802154/6lowpan 2022-09-07T19:14:50.634 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-09-07T19:14:50.634 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ieee802154/ieee802154.ko 2022-09-07T19:14:50.634 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ieee802154/ieee802154_socket.ko 2022-09-07T19:14:50.634 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4 2022-09-07T19:14:50.635 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/ah4.ko 2022-09-07T19:14:50.635 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/esp4.ko 2022-09-07T19:14:50.635 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/fou.ko 2022-09-07T19:14:50.635 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/gre.ko 2022-09-07T19:14:50.636 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/inet_diag.ko 2022-09-07T19:14:50.636 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/ip_gre.ko 2022-09-07T19:14:50.636 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/ip_tunnel.ko 2022-09-07T19:14:50.636 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/ip_vti.ko 2022-09-07T19:14:50.636 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/ipcomp.ko 2022-09-07T19:14:50.637 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/ipip.ko 2022-09-07T19:14:50.637 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter 2022-09-07T19:14:50.637 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/arp_tables.ko 2022-09-07T19:14:50.637 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-09-07T19:14:50.637 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-09-07T19:14:50.638 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-09-07T19:14:50.638 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-09-07T19:14:50.638 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-09-07T19:14:50.638 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-09-07T19:14:50.639 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-09-07T19:14:50.639 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-09-07T19:14:50.639 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-09-07T19:14:50.639 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-09-07T19:14:50.640 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/iptable_security.ko 2022-09-07T19:14:50.640 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-09-07T19:14:50.640 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-09-07T19:14:50.640 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-09-07T19:14:50.640 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-09-07T19:14:50.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-09-07T19:14:50.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-09-07T19:14:50.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-09-07T19:14:50.641 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-09-07T19:14:50.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-09-07T19:14:50.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-09-07T19:14:50.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_bic.ko 2022-09-07T19:14:50.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_dctcp.ko 2022-09-07T19:14:50.642 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_diag.ko 2022-09-07T19:14:50.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_highspeed.ko 2022-09-07T19:14:50.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_htcp.ko 2022-09-07T19:14:50.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_hybla.ko 2022-09-07T19:14:50.643 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_illinois.ko 2022-09-07T19:14:50.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_lp.ko 2022-09-07T19:14:50.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_scalable.ko 2022-09-07T19:14:50.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_vegas.ko 2022-09-07T19:14:50.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_veno.ko 2022-09-07T19:14:50.644 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_westwood.ko 2022-09-07T19:14:50.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tcp_yeah.ko 2022-09-07T19:14:50.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/tunnel4.ko 2022-09-07T19:14:50.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/udp_diag.ko 2022-09-07T19:14:50.645 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/udp_tunnel.ko 2022-09-07T19:14:50.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv4/xfrm4_tunnel.ko 2022-09-07T19:14:50.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6 2022-09-07T19:14:50.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/ah6.ko 2022-09-07T19:14:50.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/esp6.ko 2022-09-07T19:14:50.646 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/fou6.ko 2022-09-07T19:14:50.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/ip6_tunnel.ko 2022-09-07T19:14:50.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-09-07T19:14:50.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/ip6_vti.ko 2022-09-07T19:14:50.647 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/ipcomp6.ko 2022-09-07T19:14:50.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter 2022-09-07T19:14:50.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-09-07T19:14:50.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-09-07T19:14:50.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-09-07T19:14:50.648 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-09-07T19:14:50.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-09-07T19:14:50.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-09-07T19:14:50.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-09-07T19:14:50.649 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-09-07T19:14:50.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-09-07T19:14:50.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-09-07T19:14:50.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-09-07T19:14:50.650 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-09-07T19:14:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-09-07T19:14:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-09-07T19:14:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-09-07T19:14:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-09-07T19:14:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-09-07T19:14:50.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-09-07T19:14:50.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-09-07T19:14:50.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-09-07T19:14:50.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-09-07T19:14:50.652 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-09-07T19:14:50.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-09-07T19:14:50.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-09-07T19:14:50.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/sit.ko 2022-09-07T19:14:50.653 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/tunnel6.ko 2022-09-07T19:14:50.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/ipv6/xfrm6_tunnel.ko 2022-09-07T19:14:50.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/key 2022-09-07T19:14:50.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/key/af_key.ko 2022-09-07T19:14:50.654 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp 2022-09-07T19:14:50.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_core.ko 2022-09-07T19:14:50.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_debugfs.ko 2022-09-07T19:14:50.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_eth.ko 2022-09-07T19:14:50.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_ip.ko 2022-09-07T19:14:50.655 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_ip6.ko 2022-09-07T19:14:50.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_netlink.ko 2022-09-07T19:14:50.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/l2tp/l2tp_ppp.ko 2022-09-07T19:14:50.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/llc 2022-09-07T19:14:50.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/llc/llc.ko 2022-09-07T19:14:50.656 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/mac802154 2022-09-07T19:14:50.657 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/mac802154/mac802154.ko 2022-09-07T19:14:50.657 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/mpls 2022-09-07T19:14:50.657 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/mpls/mpls_gso.ko 2022-09-07T19:14:50.657 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter 2022-09-07T19:14:50.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset 2022-09-07T19:14:50.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set.ko 2022-09-07T19:14:50.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-09-07T19:14:50.658 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-09-07T19:14:50.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-09-07T19:14:50.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-09-07T19:14:50.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-09-07T19:14:50.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-09-07T19:14:50.659 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-09-07T19:14:50.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-09-07T19:14:50.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-09-07T19:14:50.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-09-07T19:14:50.660 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-09-07T19:14:50.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-09-07T19:14:50.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-09-07T19:14:50.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-09-07T19:14:50.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-09-07T19:14:50.661 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs 2022-09-07T19:14:50.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs.ko 2022-09-07T19:14:50.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-09-07T19:14:50.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-09-07T19:14:50.662 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-09-07T19:14:50.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-09-07T19:14:50.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-09-07T19:14:50.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-09-07T19:14:50.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-09-07T19:14:50.663 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-09-07T19:14:50.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-09-07T19:14:50.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-09-07T19:14:50.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-09-07T19:14:50.664 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-09-07T19:14:50.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-09-07T19:14:50.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conncount.ko 2022-09-07T19:14:50.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack.ko 2022-09-07T19:14:50.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-09-07T19:14:50.665 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-09-07T19:14:50.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-09-07T19:14:50.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_h323.ko 2022-09-07T19:14:50.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_irc.ko 2022-09-07T19:14:50.666 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-09-07T19:14:50.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-09-07T19:14:50.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-09-07T19:14:50.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_sane.ko 2022-09-07T19:14:50.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_sip.ko 2022-09-07T19:14:50.667 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-09-07T19:14:50.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-09-07T19:14:50.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_dup_netdev.ko 2022-09-07T19:14:50.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_flow_table.ko 2022-09-07T19:14:50.668 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_flow_table_inet.ko 2022-09-07T19:14:50.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_log_syslog.ko 2022-09-07T19:14:50.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_nat.ko 2022-09-07T19:14:50.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_nat_amanda.ko 2022-09-07T19:14:50.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_nat_ftp.ko 2022-09-07T19:14:50.669 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_nat_irc.ko 2022-09-07T19:14:50.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_nat_sip.ko 2022-09-07T19:14:50.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_nat_tftp.ko 2022-09-07T19:14:50.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_synproxy_core.ko 2022-09-07T19:14:50.670 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nf_tables.ko 2022-09-07T19:14:50.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nfnetlink.ko 2022-09-07T19:14:50.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nfnetlink_acct.ko 2022-09-07T19:14:50.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nfnetlink_log.ko 2022-09-07T19:14:50.671 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nfnetlink_osf.ko 2022-09-07T19:14:50.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nfnetlink_queue.ko 2022-09-07T19:14:50.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_chain_nat.ko 2022-09-07T19:14:50.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_compat.ko 2022-09-07T19:14:50.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_ct.ko 2022-09-07T19:14:50.672 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_dup_netdev.ko 2022-09-07T19:14:50.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_fib.ko 2022-09-07T19:14:50.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_fwd_netdev.ko 2022-09-07T19:14:50.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_hash.ko 2022-09-07T19:14:50.673 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_limit.ko 2022-09-07T19:14:50.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_log.ko 2022-09-07T19:14:50.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_masq.ko 2022-09-07T19:14:50.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_nat.ko 2022-09-07T19:14:50.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_numgen.ko 2022-09-07T19:14:50.674 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_objref.ko 2022-09-07T19:14:50.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_queue.ko 2022-09-07T19:14:50.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_quota.ko 2022-09-07T19:14:50.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_redir.ko 2022-09-07T19:14:50.675 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_reject.ko 2022-09-07T19:14:50.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_reject_inet.ko 2022-09-07T19:14:50.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_socket.ko 2022-09-07T19:14:50.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/nft_tunnel.ko 2022-09-07T19:14:50.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_AUDIT.ko 2022-09-07T19:14:50.676 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_CHECKSUM.ko 2022-09-07T19:14:50.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_CLASSIFY.ko 2022-09-07T19:14:50.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-09-07T19:14:50.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_CT.ko 2022-09-07T19:14:50.677 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_DSCP.ko 2022-09-07T19:14:50.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_HL.ko 2022-09-07T19:14:50.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_HMARK.ko 2022-09-07T19:14:50.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_IDLETIMER.ko 2022-09-07T19:14:50.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_LED.ko 2022-09-07T19:14:50.678 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_LOG.ko 2022-09-07T19:14:50.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_MASQUERADE.ko 2022-09-07T19:14:50.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_NETMAP.ko 2022-09-07T19:14:50.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_NFLOG.ko 2022-09-07T19:14:50.679 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_NFQUEUE.ko 2022-09-07T19:14:50.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_RATEEST.ko 2022-09-07T19:14:50.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_REDIRECT.ko 2022-09-07T19:14:50.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_SECMARK.ko 2022-09-07T19:14:50.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_TCPMSS.ko 2022-09-07T19:14:50.680 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-09-07T19:14:50.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_TEE.ko 2022-09-07T19:14:50.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_TPROXY.ko 2022-09-07T19:14:50.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_TRACE.ko 2022-09-07T19:14:50.681 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_addrtype.ko 2022-09-07T19:14:50.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_bpf.ko 2022-09-07T19:14:50.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_cgroup.ko 2022-09-07T19:14:50.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_cluster.ko 2022-09-07T19:14:50.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_comment.ko 2022-09-07T19:14:50.682 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_connbytes.ko 2022-09-07T19:14:50.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_connlabel.ko 2022-09-07T19:14:50.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_connlimit.ko 2022-09-07T19:14:50.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_connmark.ko 2022-09-07T19:14:50.683 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_conntrack.ko 2022-09-07T19:14:50.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_cpu.ko 2022-09-07T19:14:50.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_dccp.ko 2022-09-07T19:14:50.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_devgroup.ko 2022-09-07T19:14:50.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_dscp.ko 2022-09-07T19:14:50.684 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_ecn.ko 2022-09-07T19:14:50.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_esp.ko 2022-09-07T19:14:50.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_hashlimit.ko 2022-09-07T19:14:50.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_helper.ko 2022-09-07T19:14:50.685 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_hl.ko 2022-09-07T19:14:50.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_ipcomp.ko 2022-09-07T19:14:50.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_iprange.ko 2022-09-07T19:14:50.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_ipvs.ko 2022-09-07T19:14:50.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_l2tp.ko 2022-09-07T19:14:50.686 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_length.ko 2022-09-07T19:14:50.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_limit.ko 2022-09-07T19:14:50.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_mac.ko 2022-09-07T19:14:50.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_mark.ko 2022-09-07T19:14:50.687 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_multiport.ko 2022-09-07T19:14:50.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_nat.ko 2022-09-07T19:14:50.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_nfacct.ko 2022-09-07T19:14:50.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_osf.ko 2022-09-07T19:14:50.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_owner.ko 2022-09-07T19:14:50.688 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_physdev.ko 2022-09-07T19:14:50.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_pkttype.ko 2022-09-07T19:14:50.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_policy.ko 2022-09-07T19:14:50.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_quota.ko 2022-09-07T19:14:50.689 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_rateest.ko 2022-09-07T19:14:50.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_realm.ko 2022-09-07T19:14:50.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_recent.ko 2022-09-07T19:14:50.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_sctp.ko 2022-09-07T19:14:50.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_set.ko 2022-09-07T19:14:50.690 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_socket.ko 2022-09-07T19:14:50.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_state.ko 2022-09-07T19:14:50.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_statistic.ko 2022-09-07T19:14:50.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_string.ko 2022-09-07T19:14:50.691 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_tcpmss.ko 2022-09-07T19:14:50.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_time.ko 2022-09-07T19:14:50.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netfilter/xt_u32.ko 2022-09-07T19:14:50.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netlink 2022-09-07T19:14:50.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/netlink/netlink_diag.ko 2022-09-07T19:14:50.692 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/nsh 2022-09-07T19:14:50.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/nsh/nsh.ko 2022-09-07T19:14:50.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/openvswitch 2022-09-07T19:14:50.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/openvswitch/openvswitch.ko 2022-09-07T19:14:50.693 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/openvswitch/vport-geneve.ko 2022-09-07T19:14:50.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/openvswitch/vport-gre.ko 2022-09-07T19:14:50.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/openvswitch/vport-vxlan.ko 2022-09-07T19:14:50.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/packet 2022-09-07T19:14:50.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/packet/af_packet_diag.ko 2022-09-07T19:14:50.694 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/rds 2022-09-07T19:14:50.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/rds/rds.ko 2022-09-07T19:14:50.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/rds/rds_rdma.ko 2022-09-07T19:14:50.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/rds/rds_tcp.ko 2022-09-07T19:14:50.695 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched 2022-09-07T19:14:50.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_csum.ko 2022-09-07T19:14:50.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_gact.ko 2022-09-07T19:14:50.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_ipt.ko 2022-09-07T19:14:50.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_mirred.ko 2022-09-07T19:14:50.696 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_nat.ko 2022-09-07T19:14:50.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_pedit.ko 2022-09-07T19:14:50.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_police.ko 2022-09-07T19:14:50.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_simple.ko 2022-09-07T19:14:50.697 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_skbedit.ko 2022-09-07T19:14:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/act_vlan.ko 2022-09-07T19:14:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_basic.ko 2022-09-07T19:14:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_bpf.ko 2022-09-07T19:14:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_flow.ko 2022-09-07T19:14:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_fw.ko 2022-09-07T19:14:50.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_route.ko 2022-09-07T19:14:50.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_rsvp.ko 2022-09-07T19:14:50.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_rsvp6.ko 2022-09-07T19:14:50.699 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_tcindex.ko 2022-09-07T19:14:50.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/cls_u32.ko 2022-09-07T19:14:50.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/em_cmp.ko 2022-09-07T19:14:50.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/em_ipset.ko 2022-09-07T19:14:50.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/em_meta.ko 2022-09-07T19:14:50.700 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/em_nbyte.ko 2022-09-07T19:14:50.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/em_text.ko 2022-09-07T19:14:50.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/em_u32.ko 2022-09-07T19:14:50.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_cbq.ko 2022-09-07T19:14:50.701 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_choke.ko 2022-09-07T19:14:50.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_codel.ko 2022-09-07T19:14:50.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_drr.ko 2022-09-07T19:14:50.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_dsmark.ko 2022-09-07T19:14:50.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_fq.ko 2022-09-07T19:14:50.702 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_gred.ko 2022-09-07T19:14:50.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_hfsc.ko 2022-09-07T19:14:50.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_hhf.ko 2022-09-07T19:14:50.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_htb.ko 2022-09-07T19:14:50.703 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_ingress.ko 2022-09-07T19:14:50.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_mqprio.ko 2022-09-07T19:14:50.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_multiq.ko 2022-09-07T19:14:50.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_netem.ko 2022-09-07T19:14:50.704 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_pie.ko 2022-09-07T19:14:50.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_plug.ko 2022-09-07T19:14:50.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_prio.ko 2022-09-07T19:14:50.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_qfq.ko 2022-09-07T19:14:50.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_red.ko 2022-09-07T19:14:50.705 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_sfb.ko 2022-09-07T19:14:50.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_sfq.ko 2022-09-07T19:14:50.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_tbf.ko 2022-09-07T19:14:50.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sched/sch_teql.ko 2022-09-07T19:14:50.706 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sctp 2022-09-07T19:14:50.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sctp/sctp.ko 2022-09-07T19:14:50.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sctp/sctp_diag.ko 2022-09-07T19:14:50.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc 2022-09-07T19:14:50.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc/auth_gss 2022-09-07T19:14:50.707 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-09-07T19:14:50.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-09-07T19:14:50.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc/sunrpc.ko 2022-09-07T19:14:50.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc/xprtrdma 2022-09-07T19:14:50.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-09-07T19:14:50.708 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/tipc 2022-09-07T19:14:50.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/tipc/diag.ko 2022-09-07T19:14:50.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/tipc/tipc.ko 2022-09-07T19:14:50.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/unix 2022-09-07T19:14:50.709 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/unix/unix_diag.ko 2022-09-07T19:14:50.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/vmw_vsock 2022-09-07T19:14:50.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-09-07T19:14:50.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-09-07T19:14:50.710 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/vmw_vsock/vsock.ko 2022-09-07T19:14:50.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/vmw_vsock/vsock_diag.ko 2022-09-07T19:14:50.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/vmw_vsock/vsock_loopback.ko 2022-09-07T19:14:50.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/xfrm 2022-09-07T19:14:50.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/net/xfrm/xfrm_ipcomp.ko 2022-09-07T19:14:50.711 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/security 2022-09-07T19:14:50.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/security/keys 2022-09-07T19:14:50.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/security/keys/encrypted-keys 2022-09-07T19:14:50.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-09-07T19:14:50.712 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/security/keys/trusted-keys 2022-09-07T19:14:50.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/security/keys/trusted-keys/trusted.ko 2022-09-07T19:14:50.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/virt 2022-09-07T19:14:50.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/virt/lib 2022-09-07T19:14:50.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/kernel/virt/lib/irqbypass.ko 2022-09-07T19:14:50.713 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.alias 2022-09-07T19:14:50.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.alias.bin 2022-09-07T19:14:50.714 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.builtin 2022-09-07T19:14:50.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.builtin.bin 2022-09-07T19:14:50.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.builtin.modinfo 2022-09-07T19:14:50.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.dep 2022-09-07T19:14:50.727 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.dep.bin 2022-09-07T19:14:50.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.devname 2022-09-07T19:14:50.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.order 2022-09-07T19:14:50.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.softdep 2022-09-07T19:14:50.728 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.symbols 2022-09-07T19:14:50.729 INFO:teuthology.orchestra.run.smithi080.stdout:/lib/modules/6.0.0-rc4-ceph-ga127ffb7df2a/modules.symbols.bin 2022-09-07T19:14:50.729 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/lib/.build-id 2022-09-07T19:14:50.729 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/lib/.build-id/26 2022-09-07T19:14:50.729 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/lib/.build-id/26/f3c15f7f2668ff3dc963ef43e786eb787aa4cb 2022-09-07T19:14:50.730 DEBUG:teuthology.task.kernel:get_image_version: 6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.731 DEBUG:teuthology.orchestra.run.smithi080:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-09-07T19:14:50.759 INFO:teuthology.orchestra.run.smithi080.stdout:postinstall scriptlet (using /bin/sh): 2022-09-07T19:14:50.759 INFO:teuthology.orchestra.run.smithi080.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a -a -r /boot/System.map-6.0.0-rc4-ceph-ga127ffb7df2a ]; then 2022-09-07T19:14:50.759 INFO:teuthology.orchestra.run.smithi080.stdout:cp /boot/vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a /boot/.vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a-rpm 2022-09-07T19:14:50.760 INFO:teuthology.orchestra.run.smithi080.stdout:cp /boot/System.map-6.0.0-rc4-ceph-ga127ffb7df2a /boot/.System.map-6.0.0-rc4-ceph-ga127ffb7df2a-rpm 2022-09-07T19:14:50.760 INFO:teuthology.orchestra.run.smithi080.stdout:rm -f /boot/vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a /boot/System.map-6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.760 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/installkernel 6.0.0-rc4-ceph-ga127ffb7df2a /boot/.vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a-rpm /boot/.System.map-6.0.0-rc4-ceph-ga127ffb7df2a-rpm 2022-09-07T19:14:50.760 INFO:teuthology.orchestra.run.smithi080.stdout:rm -f /boot/.vmlinuz-6.0.0-rc4-ceph-ga127ffb7df2a-rpm /boot/.System.map-6.0.0-rc4-ceph-ga127ffb7df2a-rpm 2022-09-07T19:14:50.761 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2022-09-07T19:14:50.761 INFO:teuthology.orchestra.run.smithi080.stdout:preuninstall scriptlet (using /bin/sh): 2022-09-07T19:14:50.761 INFO:teuthology.orchestra.run.smithi080.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-09-07T19:14:50.761 INFO:teuthology.orchestra.run.smithi080.stdout:new-kernel-pkg --remove 6.0.0-rc4-ceph-ga127ffb7df2a --rminitrd --initrdfile=/boot/initramfs-6.0.0-rc4-ceph-ga127ffb7df2a.img 2022-09-07T19:14:50.762 INFO:teuthology.orchestra.run.smithi080.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-09-07T19:14:50.762 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-install remove 6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.762 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2022-09-07T19:14:50.762 INFO:teuthology.orchestra.run.smithi080.stdout:postuninstall scriptlet (using /bin/sh): 2022-09-07T19:14:50.763 INFO:teuthology.orchestra.run.smithi080.stdout:if [ -x /sbin/update-bootloader ]; then 2022-09-07T19:14:50.763 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/update-bootloader --remove 6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.763 INFO:teuthology.orchestra.run.smithi080.stdout:fi 2022-09-07T19:14:50.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -qi grub2-tools 2022-09-07T19:14:50.843 INFO:teuthology.orchestra.run.smithi080.stdout:Name : grub2-tools 2022-09-07T19:14:50.844 INFO:teuthology.orchestra.run.smithi080.stdout:Epoch : 1 2022-09-07T19:14:50.844 INFO:teuthology.orchestra.run.smithi080.stdout:Version : 2.02 2022-09-07T19:14:50.844 INFO:teuthology.orchestra.run.smithi080.stdout:Release : 123.el8 2022-09-07T19:14:50.845 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: x86_64 2022-09-07T19:14:50.845 INFO:teuthology.orchestra.run.smithi080.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2022-09-07T19:14:50.845 INFO:teuthology.orchestra.run.smithi080.stdout:Group : System Environment/Base 2022-09-07T19:14:50.845 INFO:teuthology.orchestra.run.smithi080.stdout:Size : 9265450 2022-09-07T19:14:50.845 INFO:teuthology.orchestra.run.smithi080.stdout:License : GPLv3+ 2022-09-07T19:14:50.846 INFO:teuthology.orchestra.run.smithi080.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2022-09-07T19:14:50.846 INFO:teuthology.orchestra.run.smithi080.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2022-09-07T19:14:50.846 INFO:teuthology.orchestra.run.smithi080.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2022-09-07T19:14:50.847 INFO:teuthology.orchestra.run.smithi080.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2022-09-07T19:14:50.847 INFO:teuthology.orchestra.run.smithi080.stdout:Relocations : (not relocatable) 2022-09-07T19:14:50.847 INFO:teuthology.orchestra.run.smithi080.stdout:Packager : Red Hat, Inc. 2022-09-07T19:14:50.847 INFO:teuthology.orchestra.run.smithi080.stdout:Vendor : Red Hat, Inc. 2022-09-07T19:14:50.848 INFO:teuthology.orchestra.run.smithi080.stdout:URL : http://www.gnu.org/software/grub/ 2022-09-07T19:14:50.848 INFO:teuthology.orchestra.run.smithi080.stdout:Summary : Support tools for GRUB. 2022-09-07T19:14:50.848 INFO:teuthology.orchestra.run.smithi080.stdout:Description : 2022-09-07T19:14:50.848 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:14:50.849 INFO:teuthology.orchestra.run.smithi080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-09-07T19:14:50.849 INFO:teuthology.orchestra.run.smithi080.stdout:customizable bootloader with modular architecture. It supports a rich 2022-09-07T19:14:50.849 INFO:teuthology.orchestra.run.smithi080.stdout:variety of kernel formats, file systems, computer architectures and 2022-09-07T19:14:50.849 INFO:teuthology.orchestra.run.smithi080.stdout:hardware devices. 2022-09-07T19:14:50.849 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:14:50.850 INFO:teuthology.orchestra.run.smithi080.stdout:This subpackage provides tools for support of all platforms. 2022-09-07T19:14:50.851 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-09-07T19:14:50.851 INFO:teuthology.task.kernel:Updating grub on smithi080 to boot 6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:50.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-09-07T19:14:54.017 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2022-09-07T19:14:56.550 INFO:teuthology.orchestra.run.smithi080.stderr:done 2022-09-07T19:14:56.551 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2022-09-07T19:14:56.572 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.pXQ56s8PLj 2022-09-07T19:14:56.572 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pXQ56s8PLj 2022-09-07T19:14:56.644 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.pXQ56s8PLj 2022-09-07T19:14:56.805 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.pXQ56s8PLj is 6KB 2022-09-07T19:14:56.864 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.pXQ56s8PLj 2022-09-07T19:14:56.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo /bin/ls /boot/loader/entries || true 2022-09-07T19:14:56.951 INFO:teuthology.orchestra.run.smithi080.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2022-09-07T19:14:56.952 INFO:teuthology.orchestra.run.smithi080.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2022-09-07T19:14:56.952 INFO:teuthology.orchestra.run.smithi080.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.0.0-rc4-ceph-ga127ffb7df2a.conf 2022-09-07T19:14:56.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:14:57.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2022-09-07T19:15:27.110 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2022-09-07T19:15:27.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-09-07T19:15:27.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:15:45.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2022-09-07T19:16:15.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-09-07T19:16:15.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:16:18.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2022-09-07T19:16:48.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-09-07T19:16:48.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:16:49.035 DEBUG:teuthology.orchestra.run.smithi080:> true 2022-09-07T19:16:49.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-09-07T19:16:49.468 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.0.0-rc4-ceph-ga127ffb7df2a"... 2022-09-07T19:16:49.468 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2022-09-07T19:16:49.524 INFO:teuthology.orchestra.run.smithi080.stdout:6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:16:49.525 DEBUG:teuthology.task.kernel:current kernel version is 6.0.0-rc4-ceph-ga127ffb7df2a vs 6.0.0-rc4-ceph-ga127ffb7df2a 2022-09-07T19:16:49.525 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-09-07T19:16:49.525 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2022-09-07T19:16:50.527 DEBUG:teuthology.parallel:result is None 2022-09-07T19:16:50.528 INFO:teuthology.run_tasks:Running task internal.base... 2022-09-07T19:16:50.536 INFO:teuthology.task.internal:Creating test directory... 2022-09-07T19:16:50.537 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-07T19:16:50.543 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-07T19:16:50.547 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-07T19:16:50.599 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-09-07T19:16:50.610 INFO:teuthology.run_tasks:Running task internal.archive... 2022-09-07T19:16:50.636 INFO:teuthology.task.internal:Creating archive directory... 2022-09-07T19:16:50.636 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-07T19:16:50.642 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-07T19:16:50.645 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-07T19:16:50.717 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-09-07T19:16:50.726 INFO:teuthology.task.internal:Enabling coredump saving... 2022-09-07T19:16:50.726 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-07T19:16:50.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-07T19:16:50.747 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-07T19:16:50.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-07T19:16:50.768 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-07T19:16:50.774 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-07T19:16:50.789 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-07T19:16:50.826 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-07T19:16:50.848 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-07T19:16:50.848 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-07T19:16:50.865 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-07T19:16:50.924 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-07T19:16:50.961 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-07T19:16:50.967 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-09-07T19:16:50.979 INFO:teuthology.task.internal:Configuring sudo... 2022-09-07T19:16:50.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-07T19:16:50.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-07T19:16:50.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-07T19:16:51.068 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-09-07T19:16:51.079 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-09-07T19:16:51.079 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-07T19:16:51.085 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-07T19:16:51.087 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-07T19:16:51.137 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-07T19:16:51.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-07T19:16:51.319 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-07T19:16:51.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-07T19:16:51.496 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:16:51.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-07T19:16:51.583 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-07T19:16:51.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-07T19:16:51.706 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-07T19:16:51.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-07T19:16:51.799 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:16:51.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-07T19:16:51.866 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-07T19:16:51.924 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-07T19:16:51.977 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-07T19:16:52.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-07T19:16:52.068 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:16:52.068 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-07T19:16:52.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2022-09-07T19:16:52.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2022-09-07T19:16:52.146 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2022-09-07T19:16:52.227 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-07T19:16:52.261 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-07T19:16:52.276 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-07T19:16:52.656 INFO:teuthology.run_tasks:Running task internal.timer... 2022-09-07T19:16:52.666 INFO:teuthology.task.internal:Starting timer... 2022-09-07T19:16:52.666 INFO:teuthology.run_tasks:Running task pcp... 2022-09-07T19:16:52.705 INFO:teuthology.run_tasks:Running task selinux... 2022-09-07T19:16:52.732 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-09-07T19:16:52.733 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2022-09-07T19:16:52.892 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2022-09-07T19:16:52.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2022-09-07T19:16:52.952 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2022-09-07T19:16:52.954 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2022-09-07T19:16:53.022 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2022-09-07T19:16:53.024 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-09-07T19:16:53.024 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2022-09-07T19:16:53.098 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2022-09-07T19:16:53.099 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2022-09-07T19:16:53.134 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2022-09-07T19:16:53.135 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2022-09-07T19:16:53.168 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2022-09-07T19:16:53.169 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2022-09-07T19:16:53.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-07T19:16:53.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-07T19:16:53.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-07T19:16:53.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-07T19:16:53.287 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-07T19:16:53.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-07T19:16:53.317 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-09-07T19:16:53.317 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2022-09-07T19:16:53.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2022-09-07T19:16:53.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2022-09-07T19:16:53.462 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-09-07T19:16:53.477 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2022-09-07T19:16:53.478 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-09-07T19:16:53.510 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-09-07T19:16:53.512 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-09-07T19:28:38.707 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2022-09-07T19:28:38.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-09-07T19:28:38.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:28:38.815 DEBUG:teuthology.orchestra.run.smithi080:> true 2022-09-07T19:28:38.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-09-07T19:28:38.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:28:39.038 DEBUG:teuthology.orchestra.run.smithi154:> true 2022-09-07T19:28:39.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-09-07T19:28:39.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-07T19:28:39.231 DEBUG:teuthology.orchestra.run.smithi155:> true 2022-09-07T19:28:39.307 INFO:teuthology.run_tasks:Running task clock... 2022-09-07T19:28:39.325 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-09-07T19:28:39.326 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-07T19:28:39.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-07T19:28:39.337 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-07T19:28:39.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-07T19:28:39.341 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-07T19:28:39.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-07T19:28:39.376 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-07T19:28:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-07T19:28:39.392 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-07T19:28:39.400 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-07T19:28:39.425 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-07T19:28:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-07T19:28:39.476 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2022-09-07T19:28:39.478 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2022-09-07T19:28:39.488 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2022-09-07T19:28:39.490 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2022-09-07T19:28:39.504 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-07T19:28:39.505 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-07T19:28:39.518 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-07T19:28:39.519 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-07T19:28:39.582 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2022-09-07T19:28:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2022-09-07T19:28:39.587 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-07T19:28:39.587 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2022-09-07T19:28:39.587 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.587 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.588 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.588 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.596 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2022-09-07T19:28:39.600 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-07T19:28:39.600 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2022-09-07T19:28:39.600 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.600 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.601 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.601 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.615 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2022-09-07T19:28:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-07T19:28:39.695 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-07T19:28:39.810 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2022-09-07T19:28:39.818 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-07T19:28:39.819 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2022-09-07T19:28:39.819 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.819 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.820 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.820 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-07T19:28:39.821 INFO:teuthology.run_tasks:Running task pexec... 2022-09-07T19:28:39.837 INFO:teuthology.task.pexec:Executing custom commands... 2022-09-07T19:28:39.838 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:28:39.838 DEBUG:teuthology.orchestra.run.smithi080:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-09-07T19:28:39.839 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi154.front.sepia.ceph.com 2022-09-07T19:28:39.839 DEBUG:teuthology.orchestra.run.smithi154:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-09-07T19:28:39.840 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi155.front.sepia.ceph.com 2022-09-07T19:28:39.840 DEBUG:teuthology.orchestra.run.smithi155:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-09-07T19:28:40.216 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2022-09-07T19:28:40.218 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2022-09-07T19:28:40.362 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2022-09-07T19:28:40.694 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 161 kB/s | 2.8 kB 00:00 2022-09-07T19:28:40.748 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 114 kB/s | 2.4 kB 00:00 2022-09-07T19:28:40.938 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 147 kB/s | 2.8 kB 00:00 2022-09-07T19:28:40.963 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 kB/s | 2.4 kB 00:00 2022-09-07T19:28:41.027 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 120 kB/s | 2.4 kB 00:00 2022-09-07T19:28:41.251 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 145 kB/s | 2.8 kB 00:00 2022-09-07T19:28:42.766 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2022-09-07T19:28:42.767 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2022-09-07T19:28:42.768 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2022-09-07T19:28:42.768 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2022-09-07T19:28:42.769 INFO:teuthology.orchestra.run.smithi155.stdout:Resetting modules: 2022-09-07T19:28:42.770 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools 2022-09-07T19:28:42.770 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:28:42.770 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2022-09-07T19:28:42.771 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2022-09-07T19:28:42.771 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:28:42.785 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2022-09-07T19:28:42.786 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2022-09-07T19:28:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2022-09-07T19:28:42.787 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2022-09-07T19:28:42.787 INFO:teuthology.orchestra.run.smithi154.stdout:Resetting modules: 2022-09-07T19:28:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: container-tools 2022-09-07T19:28:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:28:42.789 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2022-09-07T19:28:42.789 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2022-09-07T19:28:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:28:42.984 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2022-09-07T19:28:43.029 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2022-09-07T19:28:43.246 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2022-09-07T19:28:43.247 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2022-09-07T19:28:43.247 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2022-09-07T19:28:43.248 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2022-09-07T19:28:43.248 INFO:teuthology.orchestra.run.smithi080.stdout:Resetting modules: 2022-09-07T19:28:43.248 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools 2022-09-07T19:28:43.249 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:28:43.249 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2022-09-07T19:28:43.249 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2022-09-07T19:28:43.250 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:28:43.401 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2022-09-07T19:28:43.462 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2022-09-07T19:28:43.535 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2022-09-07T19:28:43.929 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 159 kB/s | 2.8 kB 00:00 2022-09-07T19:28:43.988 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 138 kB/s | 2.4 kB 00:00 2022-09-07T19:28:44.144 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2022-09-07T19:28:44.180 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 159 kB/s | 2.8 kB 00:00 2022-09-07T19:28:44.204 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 138 kB/s | 2.4 kB 00:00 2022-09-07T19:28:44.793 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 132 kB/s | 2.4 kB 00:00 2022-09-07T19:28:45.029 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 135 kB/s | 2.8 kB 00:00 2022-09-07T19:28:45.974 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2022-09-07T19:28:45.977 INFO:teuthology.orchestra.run.smithi155.stdout:========================================================================================================================= 2022-09-07T19:28:45.978 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2022-09-07T19:28:45.978 INFO:teuthology.orchestra.run.smithi155.stdout:========================================================================================================================= 2022-09-07T19:28:45.978 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2022-09-07T19:28:45.978 INFO:teuthology.orchestra.run.smithi155.stdout: conmon x86_64 2:2.1.2-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 55 k 2022-09-07T19:28:45.978 INFO:teuthology.orchestra.run.smithi155.stdout: container-selinux noarch 2:2.188.0-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 59 k 2022-09-07T19:28:45.979 INFO:teuthology.orchestra.run.smithi155.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 18 M 2022-09-07T19:28:45.979 INFO:teuthology.orchestra.run.smithi155.stdout: containers-common x86_64 2:1-35.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 109 k 2022-09-07T19:28:45.979 INFO:teuthology.orchestra.run.smithi155.stdout: criu x86_64 3.15-3.module+el8.6.0+15875+dc9a2b96 rhel-8-for-x86_64-appstream-rpms 518 k 2022-09-07T19:28:45.979 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-overlayfs x86_64 1.9-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 73 k 2022-09-07T19:28:45.980 INFO:teuthology.orchestra.run.smithi155.stdout: libslirp x86_64 4.4.0-1.module+el8.6.0+15875+dc9a2b96 rhel-8-for-x86_64-appstream-rpms 70 k 2022-09-07T19:28:45.980 INFO:teuthology.orchestra.run.smithi155.stdout: runc x86_64 1:1.1.3-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 3.0 M 2022-09-07T19:28:45.980 INFO:teuthology.orchestra.run.smithi155.stdout: slirp4netns x86_64 1.2.0-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-07T19:28:45.980 INFO:teuthology.orchestra.run.smithi155.stdout:Installing group/module packages: 2022-09-07T19:28:45.981 INFO:teuthology.orchestra.run.smithi155.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 8.0 M 2022-09-07T19:28:45.981 INFO:teuthology.orchestra.run.smithi155.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 524 k 2022-09-07T19:28:45.981 INFO:teuthology.orchestra.run.smithi155.stdout: crun x86_64 1.4.5-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 209 k 2022-09-07T19:28:45.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-podman noarch 4.0.0-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 149 k 2022-09-07T19:28:45.982 INFO:teuthology.orchestra.run.smithi155.stdout: skopeo x86_64 2:1.8.0-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 6.9 M 2022-09-07T19:28:45.983 INFO:teuthology.orchestra.run.smithi155.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 2.2 M 2022-09-07T19:28:45.983 INFO:teuthology.orchestra.run.smithi155.stdout: udica noarch 0.2.6-4.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 49 k 2022-09-07T19:28:45.983 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2022-09-07T19:28:45.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2022-09-07T19:28:45.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2022-09-07T19:28:45.984 INFO:teuthology.orchestra.run.smithi155.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2022-09-07T19:28:45.984 INFO:teuthology.orchestra.run.smithi155.stdout:Installing module profiles: 2022-09-07T19:28:45.984 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools/common 2022-09-07T19:28:45.985 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling module streams: 2022-09-07T19:28:45.985 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools rhel8 2022-09-07T19:28:45.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:28:45.986 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2022-09-07T19:28:45.986 INFO:teuthology.orchestra.run.smithi155.stdout:========================================================================================================================= 2022-09-07T19:28:45.986 INFO:teuthology.orchestra.run.smithi155.stdout:Install 10 Packages 2022-09-07T19:28:45.986 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 9 Packages 2022-09-07T19:28:45.987 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:28:45.987 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 40 M 2022-09-07T19:28:45.988 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2022-09-07T19:28:46.037 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2022-09-07T19:28:46.039 INFO:teuthology.orchestra.run.smithi154.stdout:========================================================================================================================= 2022-09-07T19:28:46.040 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2022-09-07T19:28:46.040 INFO:teuthology.orchestra.run.smithi154.stdout:========================================================================================================================= 2022-09-07T19:28:46.040 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2022-09-07T19:28:46.041 INFO:teuthology.orchestra.run.smithi154.stdout: conmon x86_64 2:2.1.2-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 55 k 2022-09-07T19:28:46.041 INFO:teuthology.orchestra.run.smithi154.stdout: container-selinux noarch 2:2.188.0-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 59 k 2022-09-07T19:28:46.041 INFO:teuthology.orchestra.run.smithi154.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 18 M 2022-09-07T19:28:46.041 INFO:teuthology.orchestra.run.smithi154.stdout: containers-common x86_64 2:1-35.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 109 k 2022-09-07T19:28:46.041 INFO:teuthology.orchestra.run.smithi154.stdout: criu x86_64 3.15-3.module+el8.6.0+15875+dc9a2b96 rhel-8-for-x86_64-appstream-rpms 518 k 2022-09-07T19:28:46.042 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-overlayfs x86_64 1.9-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 73 k 2022-09-07T19:28:46.042 INFO:teuthology.orchestra.run.smithi154.stdout: libslirp x86_64 4.4.0-1.module+el8.6.0+15875+dc9a2b96 rhel-8-for-x86_64-appstream-rpms 70 k 2022-09-07T19:28:46.042 INFO:teuthology.orchestra.run.smithi154.stdout: runc x86_64 1:1.1.3-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 3.0 M 2022-09-07T19:28:46.042 INFO:teuthology.orchestra.run.smithi154.stdout: slirp4netns x86_64 1.2.0-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-07T19:28:46.043 INFO:teuthology.orchestra.run.smithi154.stdout:Installing group/module packages: 2022-09-07T19:28:46.043 INFO:teuthology.orchestra.run.smithi154.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 8.0 M 2022-09-07T19:28:46.043 INFO:teuthology.orchestra.run.smithi154.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 524 k 2022-09-07T19:28:46.044 INFO:teuthology.orchestra.run.smithi154.stdout: crun x86_64 1.4.5-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 209 k 2022-09-07T19:28:46.044 INFO:teuthology.orchestra.run.smithi154.stdout: python3-podman noarch 4.0.0-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 149 k 2022-09-07T19:28:46.044 INFO:teuthology.orchestra.run.smithi154.stdout: skopeo x86_64 2:1.8.0-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 6.9 M 2022-09-07T19:28:46.045 INFO:teuthology.orchestra.run.smithi154.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 2.2 M 2022-09-07T19:28:46.045 INFO:teuthology.orchestra.run.smithi154.stdout: udica noarch 0.2.6-4.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 49 k 2022-09-07T19:28:46.046 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2022-09-07T19:28:46.046 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2022-09-07T19:28:46.046 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2022-09-07T19:28:46.047 INFO:teuthology.orchestra.run.smithi154.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2022-09-07T19:28:46.047 INFO:teuthology.orchestra.run.smithi154.stdout:Installing module profiles: 2022-09-07T19:28:46.047 INFO:teuthology.orchestra.run.smithi154.stdout: container-tools/common 2022-09-07T19:28:46.048 INFO:teuthology.orchestra.run.smithi154.stdout:Enabling module streams: 2022-09-07T19:28:46.048 INFO:teuthology.orchestra.run.smithi154.stdout: container-tools rhel8 2022-09-07T19:28:46.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:28:46.049 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2022-09-07T19:28:46.050 INFO:teuthology.orchestra.run.smithi154.stdout:========================================================================================================================= 2022-09-07T19:28:46.050 INFO:teuthology.orchestra.run.smithi154.stdout:Install 10 Packages 2022-09-07T19:28:46.051 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 9 Packages 2022-09-07T19:28:46.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:28:46.052 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 40 M 2022-09-07T19:28:46.053 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2022-09-07T19:28:46.122 INFO:teuthology.orchestra.run.smithi155.stdout:(1/19): python3-pytoml-0.1.14-5.git7dea353.el8. 176 kB/s | 25 kB 00:00 2022-09-07T19:28:46.142 INFO:teuthology.orchestra.run.smithi154.stdout:(1/19): python3-pyxdg-0.25-16.el8.noarch.rpm 947 kB/s | 94 kB 00:00 2022-09-07T19:28:46.153 INFO:teuthology.orchestra.run.smithi155.stdout:(2/19): yajl-2.1.0-10.el8.x86_64.rpm 237 kB/s | 41 kB 00:00 2022-09-07T19:28:46.183 INFO:teuthology.orchestra.run.smithi154.stdout:(2/19): python3-pytoml-0.1.14-5.git7dea353.el8. 183 kB/s | 25 kB 00:00 2022-09-07T19:28:46.184 INFO:teuthology.orchestra.run.smithi155.stdout:(3/19): python3-pyxdg-0.25-16.el8.noarch.rpm 475 kB/s | 94 kB 00:00 2022-09-07T19:28:46.204 INFO:teuthology.orchestra.run.smithi154.stdout:(3/19): yajl-2.1.0-10.el8.x86_64.rpm 254 kB/s | 41 kB 00:00 2022-09-07T19:28:46.222 INFO:teuthology.orchestra.run.smithi155.stdout:(4/19): udica-0.2.6-4.module+el8.6.0+15917+093c 1.2 MB/s | 49 kB 00:00 2022-09-07T19:28:46.246 INFO:teuthology.orchestra.run.smithi154.stdout:(4/19): udica-0.2.6-4.module+el8.6.0+15917+093c 1.2 MB/s | 49 kB 00:00 2022-09-07T19:28:46.258 INFO:teuthology.orchestra.run.smithi155.stdout:(5/19): cockpit-podman-49.1-1.module+el8.6.0+15 5.1 MB/s | 524 kB 00:00 2022-09-07T19:28:46.281 INFO:teuthology.orchestra.run.smithi154.stdout:(5/19): cockpit-podman-49.1-1.module+el8.6.0+15 5.1 MB/s | 524 kB 00:00 2022-09-07T19:28:46.313 INFO:teuthology.orchestra.run.smithi155.stdout:(6/19): toolbox-0.0.99.3-0.6.module+el8.6.0+159 12 MB/s | 2.2 MB 00:00 2022-09-07T19:28:46.338 INFO:teuthology.orchestra.run.smithi155.stdout:(7/19): crun-1.4.5-2.module+el8.6.0+15917+093ca 2.4 MB/s | 209 kB 00:00 2022-09-07T19:28:46.339 INFO:teuthology.orchestra.run.smithi154.stdout:(6/19): toolbox-0.0.99.3-0.6.module+el8.6.0+159 11 MB/s | 2.2 MB 00:00 2022-09-07T19:28:46.375 INFO:teuthology.orchestra.run.smithi155.stdout:(8/19): python3-podman-4.0.0-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2022-09-07T19:28:46.376 INFO:teuthology.orchestra.run.smithi154.stdout:(7/19): crun-1.4.5-2.module+el8.6.0+15917+093ca 2.4 MB/s | 209 kB 00:00 2022-09-07T19:28:46.406 INFO:teuthology.orchestra.run.smithi155.stdout:(9/19): container-selinux-2.188.0-1.module+el8. 1.4 MB/s | 59 kB 00:00 2022-09-07T19:28:46.432 INFO:teuthology.orchestra.run.smithi154.stdout:(8/19): python3-podman-4.0.0-1.module+el8.6.0+1 1.6 MB/s | 149 kB 00:00 2022-09-07T19:28:46.473 INFO:teuthology.orchestra.run.smithi154.stdout:(9/19): container-selinux-2.188.0-1.module+el8. 1.4 MB/s | 59 kB 00:00 2022-09-07T19:28:46.514 INFO:teuthology.orchestra.run.smithi155.stdout:(10/19): buildah-1.26.2-1.module+el8.6.0+15917+ 27 MB/s | 8.0 MB 00:00 2022-09-07T19:28:46.590 INFO:teuthology.orchestra.run.smithi154.stdout:(10/19): buildah-1.26.2-1.module+el8.6.0+15917+ 23 MB/s | 8.0 MB 00:00 2022-09-07T19:28:46.597 INFO:teuthology.orchestra.run.smithi155.stdout:(11/19): skopeo-1.8.0-2.module+el8.6.0+15917+09 27 MB/s | 6.9 MB 00:00 2022-09-07T19:28:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:(12/19): conmon-2.1.2-2.module+el8.6.0+15917+09 512 kB/s | 55 kB 00:00 2022-09-07T19:28:46.690 INFO:teuthology.orchestra.run.smithi155.stdout:(13/19): runc-1.1.3-2.module+el8.6.0+15917+093c 10 MB/s | 3.0 MB 00:00 2022-09-07T19:28:46.715 INFO:teuthology.orchestra.run.smithi154.stdout:(11/19): skopeo-1.8.0-2.module+el8.6.0+15917+09 20 MB/s | 6.9 MB 00:00 2022-09-07T19:28:46.716 INFO:teuthology.orchestra.run.smithi155.stdout:(14/19): slirp4netns-1.2.0-2.module+el8.6.0+159 590 kB/s | 54 kB 00:00 2022-09-07T19:28:46.741 INFO:teuthology.orchestra.run.smithi154.stdout:(12/19): conmon-2.1.2-2.module+el8.6.0+15917+09 369 kB/s | 55 kB 00:00 2022-09-07T19:28:46.771 INFO:teuthology.orchestra.run.smithi155.stdout:(15/19): fuse-overlayfs-1.9-1.module+el8.6.0+15 422 kB/s | 73 kB 00:00 2022-09-07T19:28:46.799 INFO:teuthology.orchestra.run.smithi154.stdout:(13/19): runc-1.1.3-2.module+el8.6.0+15917+093c 9.1 MB/s | 3.0 MB 00:00 2022-09-07T19:28:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:(16/19): libslirp-4.4.0-1.module+el8.6.0+15875+ 526 kB/s | 70 kB 00:00 2022-09-07T19:28:46.832 INFO:teuthology.orchestra.run.smithi154.stdout:(14/19): fuse-overlayfs-1.9-1.module+el8.6.0+15 626 kB/s | 73 kB 00:00 2022-09-07T19:28:46.849 INFO:teuthology.orchestra.run.smithi155.stdout:(17/19): containers-common-1-35.module+el8.6.0+ 1.4 MB/s | 109 kB 00:00 2022-09-07T19:28:46.857 INFO:teuthology.orchestra.run.smithi154.stdout:(15/19): slirp4netns-1.2.0-2.module+el8.6.0+159 463 kB/s | 54 kB 00:00 2022-09-07T19:28:46.883 INFO:teuthology.orchestra.run.smithi155.stdout:(18/19): criu-3.15-3.module+el8.6.0+15875+dc9a2 8.6 MB/s | 518 kB 00:00 2022-09-07T19:28:46.925 INFO:teuthology.orchestra.run.smithi154.stdout:(16/19): libslirp-4.4.0-1.module+el8.6.0+15875+ 570 kB/s | 70 kB 00:00 2022-09-07T19:28:46.970 INFO:teuthology.orchestra.run.smithi154.stdout:(17/19): criu-3.15-3.module+el8.6.0+15875+dc9a2 12 MB/s | 518 kB 00:00 2022-09-07T19:28:46.983 INFO:teuthology.orchestra.run.smithi154.stdout:(18/19): containers-common-1-35.module+el8.6.0+ 869 kB/s | 109 kB 00:00 2022-09-07T19:28:46.989 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2022-09-07T19:28:46.992 INFO:teuthology.orchestra.run.smithi080.stdout:========================================================================================================================= 2022-09-07T19:28:46.992 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2022-09-07T19:28:46.992 INFO:teuthology.orchestra.run.smithi080.stdout:========================================================================================================================= 2022-09-07T19:28:46.992 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2022-09-07T19:28:46.993 INFO:teuthology.orchestra.run.smithi080.stdout: conmon x86_64 2:2.1.2-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 55 k 2022-09-07T19:28:46.993 INFO:teuthology.orchestra.run.smithi080.stdout: container-selinux noarch 2:2.188.0-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 59 k 2022-09-07T19:28:46.993 INFO:teuthology.orchestra.run.smithi080.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 18 M 2022-09-07T19:28:46.993 INFO:teuthology.orchestra.run.smithi080.stdout: containers-common x86_64 2:1-35.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 109 k 2022-09-07T19:28:46.994 INFO:teuthology.orchestra.run.smithi080.stdout: criu x86_64 3.15-3.module+el8.6.0+15875+dc9a2b96 rhel-8-for-x86_64-appstream-rpms 518 k 2022-09-07T19:28:46.994 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-overlayfs x86_64 1.9-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 73 k 2022-09-07T19:28:46.994 INFO:teuthology.orchestra.run.smithi080.stdout: libslirp x86_64 4.4.0-1.module+el8.6.0+15875+dc9a2b96 rhel-8-for-x86_64-appstream-rpms 70 k 2022-09-07T19:28:46.995 INFO:teuthology.orchestra.run.smithi080.stdout: runc x86_64 1:1.1.3-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 3.0 M 2022-09-07T19:28:46.995 INFO:teuthology.orchestra.run.smithi080.stdout: slirp4netns x86_64 1.2.0-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-07T19:28:46.995 INFO:teuthology.orchestra.run.smithi080.stdout:Installing group/module packages: 2022-09-07T19:28:46.995 INFO:teuthology.orchestra.run.smithi080.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 8.0 M 2022-09-07T19:28:46.995 INFO:teuthology.orchestra.run.smithi080.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 524 k 2022-09-07T19:28:46.996 INFO:teuthology.orchestra.run.smithi080.stdout: crun x86_64 1.4.5-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 209 k 2022-09-07T19:28:46.996 INFO:teuthology.orchestra.run.smithi080.stdout: python3-podman noarch 4.0.0-1.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 149 k 2022-09-07T19:28:46.996 INFO:teuthology.orchestra.run.smithi080.stdout: skopeo x86_64 2:1.8.0-2.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 6.9 M 2022-09-07T19:28:46.996 INFO:teuthology.orchestra.run.smithi080.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 2.2 M 2022-09-07T19:28:46.997 INFO:teuthology.orchestra.run.smithi080.stdout: udica noarch 0.2.6-4.module+el8.6.0+15917+093ca6f8 rhel-8-for-x86_64-appstream-rpms 49 k 2022-09-07T19:28:46.997 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2022-09-07T19:28:46.997 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2022-09-07T19:28:46.997 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2022-09-07T19:28:46.997 INFO:teuthology.orchestra.run.smithi080.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2022-09-07T19:28:46.998 INFO:teuthology.orchestra.run.smithi080.stdout:Installing module profiles: 2022-09-07T19:28:46.998 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools/common 2022-09-07T19:28:46.998 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling module streams: 2022-09-07T19:28:46.998 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools rhel8 2022-09-07T19:28:46.999 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:28:46.999 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2022-09-07T19:28:46.999 INFO:teuthology.orchestra.run.smithi080.stdout:========================================================================================================================= 2022-09-07T19:28:46.999 INFO:teuthology.orchestra.run.smithi080.stdout:Install 10 Packages 2022-09-07T19:28:46.999 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 9 Packages 2022-09-07T19:28:47.000 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:28:47.001 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 40 M 2022-09-07T19:28:47.001 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2022-09-07T19:28:47.066 INFO:teuthology.orchestra.run.smithi080.stdout:(1/19): python3-pytoml-0.1.14-5.git7dea353.el8. 362 kB/s | 25 kB 00:00 2022-09-07T19:28:47.091 INFO:teuthology.orchestra.run.smithi080.stdout:(2/19): yajl-2.1.0-10.el8.x86_64.rpm 435 kB/s | 41 kB 00:00 2022-09-07T19:28:47.099 INFO:teuthology.orchestra.run.smithi155.stdout:(19/19): containernetworking-plugins-1.1.1-3.mo 48 MB/s | 18 MB 00:00 2022-09-07T19:28:47.100 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:28:47.101 INFO:teuthology.orchestra.run.smithi155.stdout:Total 36 MB/s | 40 MB 00:01 2022-09-07T19:28:47.117 INFO:teuthology.orchestra.run.smithi080.stdout:(3/19): python3-pyxdg-0.25-16.el8.noarch.rpm 785 kB/s | 94 kB 00:00 2022-09-07T19:28:47.159 INFO:teuthology.orchestra.run.smithi080.stdout:(4/19): udica-0.2.6-4.module+el8.6.0+15917+093c 1.2 MB/s | 49 kB 00:00 2022-09-07T19:28:47.192 INFO:teuthology.orchestra.run.smithi080.stdout:(5/19): cockpit-podman-49.1-1.module+el8.6.0+15 5.1 MB/s | 524 kB 00:00 2022-09-07T19:28:47.242 INFO:teuthology.orchestra.run.smithi080.stdout:(6/19): crun-1.4.5-2.module+el8.6.0+15917+093ca 4.2 MB/s | 209 kB 00:00 2022-09-07T19:28:47.250 INFO:teuthology.orchestra.run.smithi154.stdout:(19/19): containernetworking-plugins-1.1.1-3.mo 47 MB/s | 18 MB 00:00 2022-09-07T19:28:47.251 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:28:47.251 INFO:teuthology.orchestra.run.smithi154.stdout:Total 33 MB/s | 40 MB 00:01 2022-09-07T19:28:47.285 INFO:teuthology.orchestra.run.smithi080.stdout:(7/19): toolbox-0.0.99.3-0.6.module+el8.6.0+159 10 MB/s | 2.2 MB 00:00 2022-09-07T19:28:47.335 INFO:teuthology.orchestra.run.smithi080.stdout:(8/19): python3-podman-4.0.0-1.module+el8.6.0+1 1.6 MB/s | 149 kB 00:00 2022-09-07T19:28:47.386 INFO:teuthology.orchestra.run.smithi080.stdout:(9/19): container-selinux-2.188.0-1.module+el8. 1.1 MB/s | 59 kB 00:00 2022-09-07T19:28:47.510 INFO:teuthology.orchestra.run.smithi080.stdout:(10/19): runc-1.1.3-2.module+el8.6.0+15917+093c 24 MB/s | 3.0 MB 00:00 2022-09-07T19:28:47.514 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2022-09-07T19:28:47.544 INFO:teuthology.orchestra.run.smithi080.stdout:(11/19): conmon-2.1.2-2.module+el8.6.0+15917+09 1.6 MB/s | 55 kB 00:00 2022-09-07T19:28:47.559 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2022-09-07T19:28:47.560 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2022-09-07T19:28:47.661 INFO:teuthology.orchestra.run.smithi080.stdout:(12/19): buildah-1.26.2-1.module+el8.6.0+15917+ 16 MB/s | 8.0 MB 00:00 2022-09-07T19:28:47.667 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2022-09-07T19:28:47.687 INFO:teuthology.orchestra.run.smithi080.stdout:(13/19): fuse-overlayfs-1.9-1.module+el8.6.0+15 517 kB/s | 73 kB 00:00 2022-09-07T19:28:47.712 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2022-09-07T19:28:47.712 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2022-09-07T19:28:47.787 INFO:teuthology.orchestra.run.smithi080.stdout:(14/19): skopeo-1.8.0-2.module+el8.6.0+15917+09 14 MB/s | 6.9 MB 00:00 2022-09-07T19:28:47.846 INFO:teuthology.orchestra.run.smithi080.stdout:(15/19): slirp4netns-1.2.0-2.module+el8.6.0+159 295 kB/s | 54 kB 00:00 2022-09-07T19:28:47.910 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2022-09-07T19:28:47.914 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2022-09-07T19:28:48.060 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2022-09-07T19:28:48.064 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2022-09-07T19:28:48.146 INFO:teuthology.orchestra.run.smithi080.stdout:(16/19): libslirp-4.4.0-1.module+el8.6.0+15875+ 153 kB/s | 70 kB 00:00 2022-09-07T19:28:48.188 INFO:teuthology.orchestra.run.smithi080.stdout:(17/19): containers-common-1-35.module+el8.6.0+ 319 kB/s | 109 kB 00:00 2022-09-07T19:28:48.222 INFO:teuthology.orchestra.run.smithi080.stdout:(18/19): criu-3.15-3.module+el8.6.0+15875+dc9a2 6.7 MB/s | 518 kB 00:00 2022-09-07T19:28:48.555 INFO:teuthology.orchestra.run.smithi080.stdout:(19/19): containernetworking-plugins-1.1.1-3.mo 24 MB/s | 18 MB 00:00 2022-09-07T19:28:48.556 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:28:48.556 INFO:teuthology.orchestra.run.smithi080.stdout:Total 26 MB/s | 40 MB 00:01 2022-09-07T19:28:48.890 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2022-09-07T19:28:48.903 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917+0 1/1 2022-09-07T19:28:48.922 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:28:49.110 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:28:49.322 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2022-09-07T19:28:49.335 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917+0 1/1 2022-09-07T19:28:49.355 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:28:49.592 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2022-09-07T19:28:49.605 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:28:49.645 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2022-09-07T19:28:49.646 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2022-09-07T19:28:50.258 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2022-09-07T19:28:50.263 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2022-09-07T19:28:51.307 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2022-09-07T19:28:51.355 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917+0 1/1 2022-09-07T19:28:51.426 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:28:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:29:06.252 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:29:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:29:06.769 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 2/28 2022-09-07T19:29:07.345 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 2/28 2022-09-07T19:29:08.505 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_6 3/28 2022-09-07T19:29:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module+el8.6 4/28 2022-09-07T19:29:08.888 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86 5/28 2022-09-07T19:29:09.079 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_6 3/28 2022-09-07T19:29:09.081 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8. 6/28 2022-09-07T19:29:09.242 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 7/28 2022-09-07T19:29:09.257 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 7/28 2022-09-07T19:29:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module+el8.6 4/28 2022-09-07T19:29:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : yajl-2.1.0-10.el8.x86_64 8/28 2022-09-07T19:29:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86 5/28 2022-09-07T19:29:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 9/28 2022-09-07T19:29:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : containers-common-2:1-35.module+el8.6.0+15917+093c 10/28 2022-09-07T19:29:09.552 INFO:teuthology.orchestra.run.smithi155.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2022-09-07T19:29:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:29:09.710 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8. 6/28 2022-09-07T19:29:09.868 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 7/28 2022-09-07T19:29:09.887 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 7/28 2022-09-07T19:29:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 11/28 2022-09-07T19:29:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : yajl-2.1.0-10.el8.x86_64 8/28 2022-09-07T19:29:10.147 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/28 2022-09-07T19:29:10.271 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 9/28 2022-09-07T19:29:10.272 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : containers-common-2:1-35.module+el8.6.0+15917+093c 10/28 2022-09-07T19:29:10.272 INFO:teuthology.orchestra.run.smithi154.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2022-09-07T19:29:10.273 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:29:10.498 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6 13/28 2022-09-07T19:29:10.791 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 11/28 2022-09-07T19:29:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/28 2022-09-07T19:29:11.358 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 14/28 2022-09-07T19:29:11.435 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6 13/28 2022-09-07T19:29:11.441 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 1/28 2022-09-07T19:29:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 2/28 2022-09-07T19:29:12.220 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x 15/28 2022-09-07T19:29:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 14/28 2022-09-07T19:29:12.410 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86 16/28 2022-09-07T19:29:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 17/28 2022-09-07T19:29:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86 18/28 2022-09-07T19:29:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f 19/28 2022-09-07T19:29:13.130 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : containers-common-2:1-27.module+el8.6.0+14877+f643 20/28 2022-09-07T19:29:13.159 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x 15/28 2022-09-07T19:29:13.299 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 21/28 2022-09-07T19:29:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86 16/28 2022-09-07T19:29:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 22/28 2022-09-07T19:29:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2022-09-07T19:29:13.615 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 17/28 2022-09-07T19:29:13.616 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2022-09-07T19:29:13.788 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 24/28 2022-09-07T19:29:13.851 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86 18/28 2022-09-07T19:29:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 25/28 2022-09-07T19:29:14.027 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f 19/28 2022-09-07T19:29:14.051 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 26/28 2022-09-07T19:29:14.090 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_6 3/28 2022-09-07T19:29:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : containernetworking-plugins-1:1.0.1-2.module+el8.6 27/28 2022-09-07T19:29:14.252 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : containers-common-2:1-27.module+el8.6.0+14877+f643 20/28 2022-09-07T19:29:14.315 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module+el8.6 4/28 2022-09-07T19:29:14.373 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2022-09-07T19:29:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 21/28 2022-09-07T19:29:14.479 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86 5/28 2022-09-07T19:29:14.610 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 22/28 2022-09-07T19:29:14.610 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2022-09-07T19:29:14.731 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8. 6/28 2022-09-07T19:29:14.810 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2022-09-07T19:29:14.870 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 7/28 2022-09-07T19:29:14.931 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 7/28 2022-09-07T19:29:15.027 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 24/28 2022-09-07T19:29:15.082 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : yajl-2.1.0-10.el8.x86_64 8/28 2022-09-07T19:29:15.159 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 25/28 2022-09-07T19:29:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 9/28 2022-09-07T19:29:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : containers-common-2:1-35.module+el8.6.0+15917+093c 10/28 2022-09-07T19:29:15.269 INFO:teuthology.orchestra.run.smithi080.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2022-09-07T19:29:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:29:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 26/28 2022-09-07T19:29:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : containernetworking-plugins-1:1.0.1-2.module+el8.6 27/28 2022-09-07T19:29:15.676 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2022-09-07T19:29:15.701 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 11/28 2022-09-07T19:29:15.906 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/28 2022-09-07T19:29:16.303 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6 13/28 2022-09-07T19:29:17.274 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 14/28 2022-09-07T19:29:18.165 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x 15/28 2022-09-07T19:29:18.352 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86 16/28 2022-09-07T19:29:18.540 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 17/28 2022-09-07T19:29:18.770 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86 18/28 2022-09-07T19:29:18.938 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f 19/28 2022-09-07T19:29:19.139 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : containers-common-2:1-27.module+el8.6.0+14877+f643 20/28 2022-09-07T19:29:19.330 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 21/28 2022-09-07T19:29:19.487 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 22/28 2022-09-07T19:29:19.488 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2022-09-07T19:29:19.713 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2022-09-07T19:29:19.922 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 24/28 2022-09-07T19:29:20.072 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 25/28 2022-09-07T19:29:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 26/28 2022-09-07T19:29:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : containernetworking-plugins-1:1.0.1-2.module+el8.6 27/28 2022-09-07T19:29:20.744 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2022-09-07T19:29:30.053 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 28/28 2022-09-07T19:29:30.451 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2022-09-07T19:29:30.452 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/28 2022-09-07T19:29:30.452 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2/28 2022-09-07T19:29:30.453 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 3/28 2022-09-07T19:29:30.453 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 4/28 2022-09-07T19:29:30.454 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f 5/28 2022-09-07T19:29:30.454 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 6/28 2022-09-07T19:29:30.454 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x 7/28 2022-09-07T19:29:30.455 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 8/28 2022-09-07T19:29:30.455 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6 9/28 2022-09-07T19:29:30.456 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86 10/28 2022-09-07T19:29:30.456 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : container-selinux-2:2.188.0-1.module+el8.6.0+15917 11/28 2022-09-07T19:29:30.457 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : container-selinux-2:2.179.1-1.module+el8.6.0+14877 12/28 2022-09-07T19:29:30.457 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_6 13/28 2022-09-07T19:29:30.457 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 14/28 2022-09-07T19:29:30.458 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86 15/28 2022-09-07T19:29:30.458 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 16/28 2022-09-07T19:29:30.459 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 17/28 2022-09-07T19:29:30.459 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 18/28 2022-09-07T19:29:30.460 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8. 19/28 2022-09-07T19:29:30.460 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 20/28 2022-09-07T19:29:30.460 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86 21/28 2022-09-07T19:29:30.461 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 22/28 2022-09-07T19:29:30.461 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module+el8.6 23/28 2022-09-07T19:29:30.462 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : containernetworking-plugins-1:1.0.1-2.module+el8.6 24/28 2022-09-07T19:29:30.462 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : containers-common-2:1-35.module+el8.6.0+15917+093c 25/28 2022-09-07T19:29:30.463 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : containers-common-2:1-27.module+el8.6.0+14877+f643 26/28 2022-09-07T19:29:30.463 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 27/28 2022-09-07T19:29:31.156 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 28/28 2022-09-07T19:29:31.157 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2022-09-07T19:29:31.351 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:29:31.352 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2022-09-07T19:29:31.352 INFO:teuthology.orchestra.run.smithi155.stdout: conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.352 INFO:teuthology.orchestra.run.smithi155.stdout: container-selinux-2:2.188.0-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:31.352 INFO:teuthology.orchestra.run.smithi155.stdout: containernetworking-plugins-1:1.1.1-3.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.353 INFO:teuthology.orchestra.run.smithi155.stdout: containers-common-2:1-35.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.353 INFO:teuthology.orchestra.run.smithi155.stdout: criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 2022-09-07T19:29:31.353 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.353 INFO:teuthology.orchestra.run.smithi155.stdout: libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86_64 2022-09-07T19:29:31.353 INFO:teuthology.orchestra.run.smithi155.stdout: runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.354 INFO:teuthology.orchestra.run.smithi155.stdout: slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.354 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2022-09-07T19:29:31.354 INFO:teuthology.orchestra.run.smithi155.stdout: buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.354 INFO:teuthology.orchestra.run.smithi155.stdout: cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:31.355 INFO:teuthology.orchestra.run.smithi155.stdout: crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.355 INFO:teuthology.orchestra.run.smithi155.stdout: python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:31.355 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-09-07T19:29:31.355 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-09-07T19:29:31.355 INFO:teuthology.orchestra.run.smithi155.stdout: skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.356 INFO:teuthology.orchestra.run.smithi155.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:31.356 INFO:teuthology.orchestra.run.smithi155.stdout: udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:31.356 INFO:teuthology.orchestra.run.smithi155.stdout: yajl-2.1.0-10.el8.x86_64 2022-09-07T19:29:31.357 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:29:31.357 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2022-09-07T19:29:31.492 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 28/28 2022-09-07T19:29:31.621 DEBUG:teuthology.parallel:result is None 2022-09-07T19:29:31.890 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2022-09-07T19:29:31.891 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/28 2022-09-07T19:29:31.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2/28 2022-09-07T19:29:31.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 3/28 2022-09-07T19:29:31.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 4/28 2022-09-07T19:29:31.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f 5/28 2022-09-07T19:29:31.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 6/28 2022-09-07T19:29:31.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x 7/28 2022-09-07T19:29:31.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 8/28 2022-09-07T19:29:31.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6 9/28 2022-09-07T19:29:31.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86 10/28 2022-09-07T19:29:31.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : container-selinux-2:2.188.0-1.module+el8.6.0+15917 11/28 2022-09-07T19:29:31.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : container-selinux-2:2.179.1-1.module+el8.6.0+14877 12/28 2022-09-07T19:29:31.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_6 13/28 2022-09-07T19:29:31.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 14/28 2022-09-07T19:29:31.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86 15/28 2022-09-07T19:29:31.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 16/28 2022-09-07T19:29:31.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 17/28 2022-09-07T19:29:31.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 18/28 2022-09-07T19:29:31.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8. 19/28 2022-09-07T19:29:31.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 20/28 2022-09-07T19:29:31.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86 21/28 2022-09-07T19:29:31.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 22/28 2022-09-07T19:29:31.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module+el8.6 23/28 2022-09-07T19:29:31.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : containernetworking-plugins-1:1.0.1-2.module+el8.6 24/28 2022-09-07T19:29:31.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : containers-common-2:1-35.module+el8.6.0+15917+093c 25/28 2022-09-07T19:29:31.902 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : containers-common-2:1-27.module+el8.6.0+14877+f643 26/28 2022-09-07T19:29:31.902 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 27/28 2022-09-07T19:29:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 28/28 2022-09-07T19:29:32.681 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2022-09-07T19:29:32.910 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:29:32.911 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2022-09-07T19:29:32.911 INFO:teuthology.orchestra.run.smithi154.stdout: conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.911 INFO:teuthology.orchestra.run.smithi154.stdout: container-selinux-2:2.188.0-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:32.912 INFO:teuthology.orchestra.run.smithi154.stdout: containernetworking-plugins-1:1.1.1-3.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.912 INFO:teuthology.orchestra.run.smithi154.stdout: containers-common-2:1-35.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.912 INFO:teuthology.orchestra.run.smithi154.stdout: criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 2022-09-07T19:29:32.913 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.913 INFO:teuthology.orchestra.run.smithi154.stdout: libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86_64 2022-09-07T19:29:32.914 INFO:teuthology.orchestra.run.smithi154.stdout: runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.914 INFO:teuthology.orchestra.run.smithi154.stdout: slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.914 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2022-09-07T19:29:32.914 INFO:teuthology.orchestra.run.smithi154.stdout: buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.915 INFO:teuthology.orchestra.run.smithi154.stdout: cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:32.915 INFO:teuthology.orchestra.run.smithi154.stdout: crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.915 INFO:teuthology.orchestra.run.smithi154.stdout: python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:32.915 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-09-07T19:29:32.915 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-09-07T19:29:32.916 INFO:teuthology.orchestra.run.smithi154.stdout: skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.916 INFO:teuthology.orchestra.run.smithi154.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:32.916 INFO:teuthology.orchestra.run.smithi154.stdout: udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:32.916 INFO:teuthology.orchestra.run.smithi154.stdout: yajl-2.1.0-10.el8.x86_64 2022-09-07T19:29:32.917 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:29:32.917 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2022-09-07T19:29:33.247 DEBUG:teuthology.parallel:result is None 2022-09-07T19:29:42.855 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.188.0-1.module+el8.6.0+15917 28/28 2022-09-07T19:29:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2022-09-07T19:29:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/28 2022-09-07T19:29:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2/28 2022-09-07T19:29:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 3/28 2022-09-07T19:29:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8 4/28 2022-09-07T19:29:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f 5/28 2022-09-07T19:29:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 6/28 2022-09-07T19:29:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x 7/28 2022-09-07T19:29:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 8/28 2022-09-07T19:29:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6 9/28 2022-09-07T19:29:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86 10/28 2022-09-07T19:29:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : container-selinux-2:2.188.0-1.module+el8.6.0+15917 11/28 2022-09-07T19:29:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : container-selinux-2:2.179.1-1.module+el8.6.0+14877 12/28 2022-09-07T19:29:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_6 13/28 2022-09-07T19:29:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 14/28 2022-09-07T19:29:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86 15/28 2022-09-07T19:29:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 16/28 2022-09-07T19:29:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8 17/28 2022-09-07T19:29:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 18/28 2022-09-07T19:29:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8. 19/28 2022-09-07T19:29:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 20/28 2022-09-07T19:29:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86 21/28 2022-09-07T19:29:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 22/28 2022-09-07T19:29:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module+el8.6 23/28 2022-09-07T19:29:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containernetworking-plugins-1:1.0.1-2.module+el8.6 24/28 2022-09-07T19:29:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containers-common-2:1-35.module+el8.6.0+15917+093c 25/28 2022-09-07T19:29:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containers-common-2:1-27.module+el8.6.0+14877+f643 26/28 2022-09-07T19:29:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 27/28 2022-09-07T19:29:44.631 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 28/28 2022-09-07T19:29:44.632 INFO:teuthology.orchestra.run.smithi080.stdout:Installed products updated. 2022-09-07T19:29:44.837 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:29:44.838 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2022-09-07T19:29:44.838 INFO:teuthology.orchestra.run.smithi080.stdout: conmon-2:2.1.2-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.838 INFO:teuthology.orchestra.run.smithi080.stdout: container-selinux-2:2.188.0-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:44.839 INFO:teuthology.orchestra.run.smithi080.stdout: containernetworking-plugins-1:1.1.1-3.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.839 INFO:teuthology.orchestra.run.smithi080.stdout: containers-common-2:1-35.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.839 INFO:teuthology.orchestra.run.smithi080.stdout: criu-3.15-3.module+el8.6.0+15875+dc9a2b96.x86_64 2022-09-07T19:29:44.840 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-overlayfs-1.9-1.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.840 INFO:teuthology.orchestra.run.smithi080.stdout: libslirp-4.4.0-1.module+el8.6.0+15875+dc9a2b96.x86_64 2022-09-07T19:29:44.840 INFO:teuthology.orchestra.run.smithi080.stdout: runc-1:1.1.3-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.841 INFO:teuthology.orchestra.run.smithi080.stdout: slirp4netns-1.2.0-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.841 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2022-09-07T19:29:44.841 INFO:teuthology.orchestra.run.smithi080.stdout: buildah-1:1.26.2-1.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.842 INFO:teuthology.orchestra.run.smithi080.stdout: cockpit-podman-49.1-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:44.842 INFO:teuthology.orchestra.run.smithi080.stdout: crun-1.4.5-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.843 INFO:teuthology.orchestra.run.smithi080.stdout: python3-podman-4.0.0-1.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:44.844 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-09-07T19:29:44.844 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-09-07T19:29:44.845 INFO:teuthology.orchestra.run.smithi080.stdout: skopeo-2:1.8.0-2.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.845 INFO:teuthology.orchestra.run.smithi080.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+15917+093ca6f8.x86_64 2022-09-07T19:29:44.845 INFO:teuthology.orchestra.run.smithi080.stdout: udica-0.2.6-4.module+el8.6.0+15917+093ca6f8.noarch 2022-09-07T19:29:44.845 INFO:teuthology.orchestra.run.smithi080.stdout: yajl-2.1.0-10.el8.x86_64 2022-09-07T19:29:44.846 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:29:44.846 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2022-09-07T19:29:45.240 DEBUG:teuthology.parallel:result is None 2022-09-07T19:29:45.241 INFO:teuthology.run_tasks:Running task install... 2022-09-07T19:29:45.256 DEBUG:teuthology.task.install:project ceph 2022-09-07T19:29:45.258 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '152194198413033811b31149de909a7ec5852a7f'}} 2022-09-07T19:29:45.258 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '152194198413033811b31149de909a7ec5852a7f'} 2022-09-07T19:29:45.259 INFO:teuthology.task.install:Using flavor: default 2022-09-07T19:29:45.270 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-09-07T19:29:45.271 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-09-07T19:29:45.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2022-09-07T19:29:45.417 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterprise 2022-09-07T19:29:45.422 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:29:45.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo lsb_release -is 2022-09-07T19:29:45.424 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '152194198413033811b31149de909a7ec5852a7f', 'tag': None, 'wait_for_package': False} 2022-09-07T19:29:45.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2022-09-07T19:29:45.477 INFO:teuthology.orchestra.run.smithi154.stdout:RedHatEnterprise 2022-09-07T19:29:45.479 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:29:45.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2022-09-07T19:29:45.481 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '152194198413033811b31149de909a7ec5852a7f', 'tag': None, 'wait_for_package': False} 2022-09-07T19:29:45.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo lsb_release -is 2022-09-07T19:29:45.526 INFO:teuthology.orchestra.run.smithi154.stdout:RedHatEnterprise 2022-09-07T19:29:45.527 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:29:45.528 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:29:45.535 INFO:teuthology.orchestra.run.smithi155.stdout:RedHatEnterprise 2022-09-07T19:29:45.535 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:29:45.536 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '152194198413033811b31149de909a7ec5852a7f', 'tag': None, 'wait_for_package': False} 2022-09-07T19:29:45.536 DEBUG:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2022-09-07T19:29:45.575 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterprise 2022-09-07T19:29:45.576 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:29:45.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:29:45.583 INFO:teuthology.orchestra.run.smithi155.stdout:RedHatEnterprise 2022-09-07T19:29:45.583 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:29:45.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:29:45.698 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/ 2022-09-07T19:29:45.698 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14857.g15219419 2022-09-07T19:29:45.735 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/ 2022-09-07T19:29:45.736 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14857.g15219419 2022-09-07T19:29:45.740 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/ 2022-09-07T19:29:45.741 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14857.g15219419 2022-09-07T19:29:45.887 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-07T19:29:45.887 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:29:45.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-07T19:29:45.913 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-07T19:29:45.913 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:29:45.914 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-07T19:29:45.917 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220907.015905/152194198413033811b31149de909a7ec5852a7f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-07T19:29:45.918 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:29:45.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-07T19:29:45.920 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-07T19:29:45.921 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/152194198413033811b31149de909a7ec5852a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-07T19:29:45.949 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-07T19:29:45.950 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/152194198413033811b31149de909a7ec5852a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-07T19:29:45.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-07T19:29:46.020 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-07T19:29:46.021 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/152194198413033811b31149de909a7ec5852a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-07T19:29:46.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-07T19:29:46.071 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-07T19:29:46.104 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-07T19:29:46.138 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2022-09-07T19:29:46.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2022-09-07T19:29:46.149 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-07T19:29:46.174 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2022-09-07T19:29:46.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2022-09-07T19:29:46.271 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-07T19:29:46.358 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2022-09-07T19:29:46.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2022-09-07T19:29:46.521 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2022-09-07T19:29:46.554 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2022-09-07T19:29:46.719 INFO:teuthology.orchestra.run.smithi154.stdout:52 files removed 2022-09-07T19:29:46.746 INFO:teuthology.orchestra.run.smithi155.stdout:52 files removed 2022-09-07T19:29:46.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-07T19:29:46.795 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-07T19:29:46.848 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2022-09-07T19:29:47.100 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2022-09-07T19:29:47.128 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2022-09-07T19:29:47.149 INFO:teuthology.orchestra.run.smithi080.stdout:52 files removed 2022-09-07T19:29:47.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-07T19:29:47.705 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2022-09-07T19:29:47.730 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 261 kB/s | 81 kB 00:00 2022-09-07T19:29:47.753 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 264 kB/s | 81 kB 00:00 2022-09-07T19:29:47.989 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2022-09-07T19:29:48.071 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2022-09-07T19:29:48.256 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2022-09-07T19:29:48.330 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2022-09-07T19:29:48.410 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 280 kB/s | 81 kB 00:00 2022-09-07T19:29:48.498 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2022-09-07T19:29:48.547 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2022-09-07T19:29:48.705 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2022-09-07T19:29:49.049 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2022-09-07T19:29:49.306 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2022-09-07T19:29:49.839 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 10 MB/s | 13 MB 00:01 2022-09-07T19:29:49.857 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 13 MB 00:01 2022-09-07T19:29:50.515 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2022-09-07T19:29:52.656 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 422 kB/s | 24 kB 00:00 2022-09-07T19:29:52.741 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 398 kB/s | 24 kB 00:00 2022-09-07T19:29:53.416 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 66 MB/s | 46 MB 00:00 2022-09-07T19:29:53.883 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 406 kB/s | 24 kB 00:00 2022-09-07T19:29:53.934 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 51 MB 00:01 2022-09-07T19:29:54.893 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 54 MB/s | 51 MB 00:00 2022-09-07T19:30:01.292 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 51 MB 00:00 2022-09-07T19:30:01.776 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 MB/s | 46 MB 00:00 2022-09-07T19:30:03.211 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 46 MB 00:00 2022-09-07T19:30:12.031 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-07T19:30:12.033 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-07T19:30:12.046 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-09-07T19:30:12.047 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-09-07T19:30:12.048 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-09-07T19:30:12.050 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-07T19:30:12.052 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-07T19:30:12.055 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-07T19:30:12.056 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-07T19:30:12.191 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2022-09-07T19:30:12.203 INFO:teuthology.orchestra.run.smithi155.stdout:=========================================================================================================================== 2022-09-07T19:30:12.203 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2022-09-07T19:30:12.203 INFO:teuthology.orchestra.run.smithi155.stdout:=========================================================================================================================== 2022-09-07T19:30:12.204 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2022-09-07T19:30:12.204 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-09-07T19:30:12.204 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-07T19:30:12.204 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.0.0-14857.g15219419.el8 ceph 6.4 k 2022-09-07T19:30:12.205 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.0.0-14857.g15219419.el8 ceph 5.2 M 2022-09-07T19:30:12.205 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:17.0.0-14857.g15219419.el8 ceph 844 k 2022-09-07T19:30:12.205 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14857.g15219419.el8 ceph 165 k 2022-09-07T19:30:12.205 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.0.0-14857.g15219419.el8 ceph 1.5 M 2022-09-07T19:30:12.206 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 115 k 2022-09-07T19:30:12.206 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 1.6 M 2022-09-07T19:30:12.206 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 7.4 M 2022-09-07T19:30:12.207 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 47 k 2022-09-07T19:30:12.207 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.0.0-14857.g15219419.el8 ceph 18 M 2022-09-07T19:30:12.208 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.0.0-14857.g15219419.el8 ceph 54 M 2022-09-07T19:30:12.208 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 263 k 2022-09-07T19:30:12.208 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 81 k 2022-09-07T19:30:12.208 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:17.0.0-14857.g15219419.el8 ceph 257 k 2022-09-07T19:30:12.209 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 15 k 2022-09-07T19:30:12.209 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-09-07T19:30:12.210 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-07T19:30:12.210 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-07T19:30:12.210 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.0.0-14857.g15219419.el8 ceph 30 k 2022-09-07T19:30:12.210 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 766 k 2022-09-07T19:30:12.211 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.0.0-14857.g15219419.el8 ceph 139 k 2022-09-07T19:30:12.211 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-07T19:30:12.211 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-09-07T19:30:12.212 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-07T19:30:12.212 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-09-07T19:30:12.212 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-09-07T19:30:12.212 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-09-07T19:30:12.213 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.0.0-14857.g15219419.el8 ceph 190 k 2022-09-07T19:30:12.213 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.0.0-14857.g15219419.el8 ceph 372 k 2022-09-07T19:30:12.213 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.0.0-14857.g15219419.el8 ceph 358 k 2022-09-07T19:30:12.213 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.0.0-14857.g15219419.el8 ceph 107 k 2022-09-07T19:30:12.214 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.0.0-14857.g15219419.el8 ceph 94 k 2022-09-07T19:30:12.215 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.5 M 2022-09-07T19:30:12.215 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.0.0-14857.g15219419.el8 ceph 175 k 2022-09-07T19:30:12.216 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-09-07T19:30:12.216 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2022-09-07T19:30:12.217 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.6 M 2022-09-07T19:30:12.217 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.6 M 2022-09-07T19:30:12.217 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-09-07T19:30:12.218 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-09-07T19:30:12.218 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2022-09-07T19:30:12.218 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-07T19:30:12.219 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.0.0-14857.g15219419.el8 ceph 24 M 2022-09-07T19:30:12.219 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 23 k 2022-09-07T19:30:12.220 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.0.0-14857.g15219419.el8 ceph 2.3 M 2022-09-07T19:30:12.220 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 233 k 2022-09-07T19:30:12.220 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.9 M 2022-09-07T19:30:12.221 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.0.0-14857.g15219419.el8 ceph 17 M 2022-09-07T19:30:12.221 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 14 k 2022-09-07T19:30:12.221 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.0.0-14857.g15219419.el8 ceph 24 k 2022-09-07T19:30:12.223 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-07T19:30:12.223 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-07T19:30:12.224 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-09-07T19:30:12.224 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-07T19:30:12.225 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-09-07T19:30:12.225 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.0.0-14857.g15219419.el8 ceph 137 k 2022-09-07T19:30:12.225 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-09-07T19:30:12.226 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-09-07T19:30:12.226 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-07T19:30:12.227 INFO:teuthology.orchestra.run.smithi155.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-09-07T19:30:12.227 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-09-07T19:30:12.228 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-07T19:30:12.228 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.0.0-14857.g15219419.el8 ceph 473 k 2022-09-07T19:30:12.229 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-09-07T19:30:12.229 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 5.8 M 2022-09-07T19:30:12.230 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-07T19:30:12.230 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-09-07T19:30:12.230 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-07T19:30:12.231 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-07T19:30:12.231 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-07T19:30:12.231 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-07T19:30:12.231 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-07T19:30:12.232 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-09-07T19:30:12.232 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-07T19:30:12.232 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-07T19:30:12.232 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-07T19:30:12.232 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-07T19:30:12.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-07T19:30:12.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-07T19:30:12.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-07T19:30:12.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-07T19:30:12.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.0.0-14857.g15219419.el8 ceph 45 k 2022-09-07T19:30:12.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.0.0-14857.g15219419.el8 ceph 109 k 2022-09-07T19:30:12.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-07T19:30:12.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-07T19:30:12.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-07T19:30:12.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-07T19:30:12.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-07T19:30:12.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-07T19:30:12.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-07T19:30:12.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-07T19:30:12.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-07T19:30:12.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-07T19:30:12.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-07T19:30:12.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-07T19:30:12.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-07T19:30:12.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-07T19:30:12.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-07T19:30:12.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-07T19:30:12.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-07T19:30:12.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-07T19:30:12.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-07T19:30:12.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-07T19:30:12.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-07T19:30:12.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-07T19:30:12.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-07T19:30:12.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-07T19:30:12.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-07T19:30:12.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-07T19:30:12.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-07T19:30:12.241 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-07T19:30:12.241 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-07T19:30:12.242 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-07T19:30:12.242 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-07T19:30:12.243 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-07T19:30:12.244 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-07T19:30:12.244 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-09-07T19:30:12.244 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-07T19:30:12.245 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-07T19:30:12.245 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-07T19:30:12.246 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-07T19:30:12.246 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-07T19:30:12.247 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-07T19:30:12.247 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-07T19:30:12.248 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-07T19:30:12.248 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-07T19:30:12.248 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-07T19:30:12.249 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-09-07T19:30:12.249 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-07T19:30:12.250 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-09-07T19:30:12.250 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-07T19:30:12.251 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-07T19:30:12.251 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling module streams: 2022-09-07T19:30:12.252 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql 10 2022-09-07T19:30:12.252 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:30:12.252 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2022-09-07T19:30:12.253 INFO:teuthology.orchestra.run.smithi155.stdout:=========================================================================================================================== 2022-09-07T19:30:12.253 INFO:teuthology.orchestra.run.smithi155.stdout:Install 128 Packages 2022-09-07T19:30:12.254 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 4 Packages 2022-09-07T19:30:12.254 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:30:12.255 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 216 M 2022-09-07T19:30:12.256 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2022-09-07T19:30:12.350 INFO:teuthology.orchestra.run.smithi155.stdout:(1/132): ceph-17.0.0-14857.g15219419.el8.x86_64 49 kB/s | 6.4 kB 00:00 2022-09-07T19:30:12.624 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-07T19:30:12.625 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-07T19:30:12.639 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-09-07T19:30:12.640 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-09-07T19:30:12.641 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-09-07T19:30:12.642 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-07T19:30:12.645 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-07T19:30:12.647 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-07T19:30:12.649 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-07T19:30:12.726 INFO:teuthology.orchestra.run.smithi155.stdout:(2/132): ceph-fuse-17.0.0-14857.g15219419.el8.x 2.2 MB/s | 844 kB 00:00 2022-09-07T19:30:12.780 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2022-09-07T19:30:12.793 INFO:teuthology.orchestra.run.smithi154.stdout:=========================================================================================================================== 2022-09-07T19:30:12.793 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2022-09-07T19:30:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:=========================================================================================================================== 2022-09-07T19:30:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2022-09-07T19:30:12.794 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-09-07T19:30:12.795 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-07T19:30:12.795 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:17.0.0-14857.g15219419.el8 ceph 6.4 k 2022-09-07T19:30:12.795 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:17.0.0-14857.g15219419.el8 ceph 5.2 M 2022-09-07T19:30:12.795 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:17.0.0-14857.g15219419.el8 ceph 844 k 2022-09-07T19:30:12.796 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14857.g15219419.el8 ceph 165 k 2022-09-07T19:30:12.797 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:17.0.0-14857.g15219419.el8 ceph 1.5 M 2022-09-07T19:30:12.797 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 115 k 2022-09-07T19:30:12.798 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 1.6 M 2022-09-07T19:30:12.798 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 7.4 M 2022-09-07T19:30:12.798 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 47 k 2022-09-07T19:30:12.799 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:17.0.0-14857.g15219419.el8 ceph 18 M 2022-09-07T19:30:12.799 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:17.0.0-14857.g15219419.el8 ceph 54 M 2022-09-07T19:30:12.799 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 263 k 2022-09-07T19:30:12.800 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 81 k 2022-09-07T19:30:12.800 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:17.0.0-14857.g15219419.el8 ceph 257 k 2022-09-07T19:30:12.800 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 15 k 2022-09-07T19:30:12.801 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-09-07T19:30:12.801 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-07T19:30:12.801 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-07T19:30:12.801 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:17.0.0-14857.g15219419.el8 ceph 30 k 2022-09-07T19:30:12.802 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 766 k 2022-09-07T19:30:12.802 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:17.0.0-14857.g15219419.el8 ceph 139 k 2022-09-07T19:30:12.802 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-07T19:30:12.803 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-09-07T19:30:12.803 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-07T19:30:12.803 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-09-07T19:30:12.803 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-09-07T19:30:12.803 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-09-07T19:30:12.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:17.0.0-14857.g15219419.el8 ceph 190 k 2022-09-07T19:30:12.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:17.0.0-14857.g15219419.el8 ceph 372 k 2022-09-07T19:30:12.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:17.0.0-14857.g15219419.el8 ceph 358 k 2022-09-07T19:30:12.805 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:17.0.0-14857.g15219419.el8 ceph 107 k 2022-09-07T19:30:12.805 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:17.0.0-14857.g15219419.el8 ceph 94 k 2022-09-07T19:30:12.805 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.5 M 2022-09-07T19:30:12.806 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:17.0.0-14857.g15219419.el8 ceph 175 k 2022-09-07T19:30:12.806 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-09-07T19:30:12.806 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2022-09-07T19:30:12.807 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.6 M 2022-09-07T19:30:12.807 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.6 M 2022-09-07T19:30:12.808 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-09-07T19:30:12.808 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-09-07T19:30:12.809 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2022-09-07T19:30:12.809 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-07T19:30:12.810 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:17.0.0-14857.g15219419.el8 ceph 24 M 2022-09-07T19:30:12.810 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 23 k 2022-09-07T19:30:12.811 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:17.0.0-14857.g15219419.el8 ceph 2.3 M 2022-09-07T19:30:12.811 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 233 k 2022-09-07T19:30:12.811 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.9 M 2022-09-07T19:30:12.812 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:17.0.0-14857.g15219419.el8 ceph 17 M 2022-09-07T19:30:12.812 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 14 k 2022-09-07T19:30:12.813 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:17.0.0-14857.g15219419.el8 ceph 24 k 2022-09-07T19:30:12.813 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-07T19:30:12.813 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-07T19:30:12.814 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-09-07T19:30:12.814 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-07T19:30:12.815 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-09-07T19:30:12.815 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:17.0.0-14857.g15219419.el8 ceph 137 k 2022-09-07T19:30:12.815 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-09-07T19:30:12.815 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-09-07T19:30:12.815 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-07T19:30:12.816 INFO:teuthology.orchestra.run.smithi154.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-09-07T19:30:12.816 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-09-07T19:30:12.816 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-07T19:30:12.816 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:17.0.0-14857.g15219419.el8 ceph 473 k 2022-09-07T19:30:12.817 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-09-07T19:30:12.817 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 5.8 M 2022-09-07T19:30:12.817 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-07T19:30:12.817 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-09-07T19:30:12.818 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-07T19:30:12.818 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-07T19:30:12.818 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-07T19:30:12.818 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-07T19:30:12.818 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-07T19:30:12.819 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-09-07T19:30:12.819 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-07T19:30:12.819 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-07T19:30:12.819 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-07T19:30:12.820 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-07T19:30:12.820 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-07T19:30:12.820 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-07T19:30:12.820 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-07T19:30:12.820 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-07T19:30:12.821 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:17.0.0-14857.g15219419.el8 ceph 45 k 2022-09-07T19:30:12.821 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:17.0.0-14857.g15219419.el8 ceph 109 k 2022-09-07T19:30:12.821 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-07T19:30:12.821 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-07T19:30:12.822 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-07T19:30:12.822 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-07T19:30:12.822 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-07T19:30:12.822 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-07T19:30:12.823 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-07T19:30:12.823 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-07T19:30:12.823 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-07T19:30:12.823 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-07T19:30:12.823 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-07T19:30:12.824 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-07T19:30:12.824 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-07T19:30:12.824 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-07T19:30:12.824 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-07T19:30:12.825 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-07T19:30:12.825 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-07T19:30:12.825 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-07T19:30:12.825 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-07T19:30:12.825 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-07T19:30:12.826 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-07T19:30:12.826 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-07T19:30:12.826 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-07T19:30:12.826 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-07T19:30:12.827 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-07T19:30:12.827 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-07T19:30:12.827 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-07T19:30:12.827 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-07T19:30:12.828 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-07T19:30:12.828 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-07T19:30:12.828 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-07T19:30:12.828 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-07T19:30:12.828 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-07T19:30:12.829 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-09-07T19:30:12.829 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-07T19:30:12.829 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-07T19:30:12.829 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-07T19:30:12.830 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-07T19:30:12.830 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-07T19:30:12.830 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-07T19:30:12.830 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-07T19:30:12.831 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-07T19:30:12.831 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-07T19:30:12.831 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-07T19:30:12.831 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-09-07T19:30:12.832 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-07T19:30:12.832 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-09-07T19:30:12.832 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-07T19:30:12.832 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-07T19:30:12.832 INFO:teuthology.orchestra.run.smithi154.stdout:Enabling module streams: 2022-09-07T19:30:12.833 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql 10 2022-09-07T19:30:12.833 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:30:12.833 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2022-09-07T19:30:12.833 INFO:teuthology.orchestra.run.smithi154.stdout:=========================================================================================================================== 2022-09-07T19:30:12.834 INFO:teuthology.orchestra.run.smithi154.stdout:Install 128 Packages 2022-09-07T19:30:12.834 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 4 Packages 2022-09-07T19:30:12.834 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:30:12.835 INFO:teuthology.orchestra.run.smithi155.stdout:(3/132): ceph-base-17.0.0-14857.g15219419.el8.x 8.4 MB/s | 5.2 MB 00:00 2022-09-07T19:30:12.836 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 216 M 2022-09-07T19:30:12.836 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2022-09-07T19:30:12.851 INFO:teuthology.orchestra.run.smithi155.stdout:(4/132): ceph-immutable-object-cache-17.0.0-148 1.3 MB/s | 165 kB 00:00 2022-09-07T19:30:13.068 INFO:teuthology.orchestra.run.smithi154.stdout:(1/132): ceph-17.0.0-14857.g15219419.el8.x86_64 25 kB/s | 6.4 kB 00:00 2022-09-07T19:30:13.084 INFO:teuthology.orchestra.run.smithi155.stdout:(5/132): ceph-mds-17.0.0-14857.g15219419.el8.x8 9.1 MB/s | 2.3 MB 00:00 2022-09-07T19:30:13.459 INFO:teuthology.orchestra.run.smithi155.stdout:(6/132): ceph-mgr-17.0.0-14857.g15219419.el8.x8 2.5 MB/s | 1.5 MB 00:00 2022-09-07T19:30:13.528 INFO:teuthology.orchestra.run.smithi155.stdout:(7/132): ceph-mon-17.0.0-14857.g15219419.el8.x8 8.7 MB/s | 3.9 MB 00:00 2022-09-07T19:30:13.826 INFO:teuthology.orchestra.run.smithi154.stdout:(2/132): ceph-fuse-17.0.0-14857.g15219419.el8.x 1.1 MB/s | 844 kB 00:00 2022-09-07T19:30:14.018 INFO:teuthology.orchestra.run.smithi154.stdout:(3/132): ceph-immutable-object-cache-17.0.0-148 863 kB/s | 165 kB 00:00 2022-09-07T19:30:14.329 INFO:teuthology.orchestra.run.smithi155.stdout:(8/132): ceph-common-17.0.0-14857.g15219419.el8 11 MB/s | 24 MB 00:02 2022-09-07T19:30:14.395 INFO:teuthology.orchestra.run.smithi155.stdout:(9/132): ceph-selinux-17.0.0-14857.g15219419.el 365 kB/s | 24 kB 00:00 2022-09-07T19:30:14.785 INFO:teuthology.orchestra.run.smithi154.stdout:(4/132): ceph-mds-17.0.0-14857.g15219419.el8.x8 3.0 MB/s | 2.3 MB 00:00 2022-09-07T19:30:15.070 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-07T19:30:15.071 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-07T19:30:15.086 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-09-07T19:30:15.088 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-09-07T19:30:15.089 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-09-07T19:30:15.090 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-07T19:30:15.092 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-07T19:30:15.096 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-07T19:30:15.097 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-07T19:30:15.235 INFO:teuthology.orchestra.run.smithi154.stdout:(5/132): ceph-mgr-17.0.0-14857.g15219419.el8.x8 3.4 MB/s | 1.5 MB 00:00 2022-09-07T19:30:15.237 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2022-09-07T19:30:15.250 INFO:teuthology.orchestra.run.smithi080.stdout:=========================================================================================================================== 2022-09-07T19:30:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2022-09-07T19:30:15.250 INFO:teuthology.orchestra.run.smithi080.stdout:=========================================================================================================================== 2022-09-07T19:30:15.251 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2022-09-07T19:30:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-09-07T19:30:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-07T19:30:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:17.0.0-14857.g15219419.el8 ceph 6.4 k 2022-09-07T19:30:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:17.0.0-14857.g15219419.el8 ceph 5.2 M 2022-09-07T19:30:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:17.0.0-14857.g15219419.el8 ceph 844 k 2022-09-07T19:30:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14857.g15219419.el8 ceph 165 k 2022-09-07T19:30:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:17.0.0-14857.g15219419.el8 ceph 1.5 M 2022-09-07T19:30:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 115 k 2022-09-07T19:30:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 1.6 M 2022-09-07T19:30:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 7.4 M 2022-09-07T19:30:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 47 k 2022-09-07T19:30:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:17.0.0-14857.g15219419.el8 ceph 18 M 2022-09-07T19:30:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:17.0.0-14857.g15219419.el8 ceph 54 M 2022-09-07T19:30:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 263 k 2022-09-07T19:30:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 81 k 2022-09-07T19:30:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:17.0.0-14857.g15219419.el8 ceph 257 k 2022-09-07T19:30:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 15 k 2022-09-07T19:30:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-09-07T19:30:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-07T19:30:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-07T19:30:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:17.0.0-14857.g15219419.el8 ceph 30 k 2022-09-07T19:30:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 766 k 2022-09-07T19:30:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:17.0.0-14857.g15219419.el8 ceph 139 k 2022-09-07T19:30:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-07T19:30:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-09-07T19:30:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-07T19:30:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-09-07T19:30:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-09-07T19:30:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-09-07T19:30:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:17.0.0-14857.g15219419.el8 ceph 190 k 2022-09-07T19:30:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:17.0.0-14857.g15219419.el8 ceph 372 k 2022-09-07T19:30:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:17.0.0-14857.g15219419.el8 ceph 358 k 2022-09-07T19:30:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:17.0.0-14857.g15219419.el8 ceph 107 k 2022-09-07T19:30:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:17.0.0-14857.g15219419.el8 ceph 94 k 2022-09-07T19:30:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.5 M 2022-09-07T19:30:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:17.0.0-14857.g15219419.el8 ceph 175 k 2022-09-07T19:30:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-09-07T19:30:15.268 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2022-09-07T19:30:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.6 M 2022-09-07T19:30:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.6 M 2022-09-07T19:30:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-09-07T19:30:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-09-07T19:30:15.269 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2022-09-07T19:30:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-07T19:30:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:17.0.0-14857.g15219419.el8 ceph 24 M 2022-09-07T19:30:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 23 k 2022-09-07T19:30:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:17.0.0-14857.g15219419.el8 ceph 2.3 M 2022-09-07T19:30:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 233 k 2022-09-07T19:30:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:17.0.0-14857.g15219419.el8 ceph 3.9 M 2022-09-07T19:30:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:17.0.0-14857.g15219419.el8 ceph 17 M 2022-09-07T19:30:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14857.g15219419.el8 ceph-noarch 14 k 2022-09-07T19:30:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:17.0.0-14857.g15219419.el8 ceph 24 k 2022-09-07T19:30:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-07T19:30:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-07T19:30:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-09-07T19:30:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-07T19:30:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-09-07T19:30:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:17.0.0-14857.g15219419.el8 ceph 137 k 2022-09-07T19:30:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-09-07T19:30:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-09-07T19:30:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-07T19:30:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-09-07T19:30:15.276 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-09-07T19:30:15.276 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-07T19:30:15.276 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:17.0.0-14857.g15219419.el8 ceph 473 k 2022-09-07T19:30:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-09-07T19:30:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:17.0.0-14857.g15219419.el8 ceph 5.8 M 2022-09-07T19:30:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-07T19:30:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-09-07T19:30:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-07T19:30:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-07T19:30:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-07T19:30:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-07T19:30:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-07T19:30:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-09-07T19:30:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-07T19:30:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-07T19:30:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-07T19:30:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-07T19:30:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-07T19:30:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-07T19:30:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-07T19:30:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-07T19:30:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:17.0.0-14857.g15219419.el8 ceph 45 k 2022-09-07T19:30:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:17.0.0-14857.g15219419.el8 ceph 109 k 2022-09-07T19:30:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-07T19:30:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-07T19:30:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-07T19:30:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-07T19:30:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-07T19:30:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-07T19:30:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-07T19:30:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-07T19:30:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-07T19:30:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-07T19:30:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-07T19:30:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-07T19:30:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-07T19:30:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-07T19:30:15.286 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-07T19:30:15.286 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-07T19:30:15.286 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-07T19:30:15.286 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-07T19:30:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-07T19:30:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-07T19:30:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-07T19:30:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-07T19:30:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-07T19:30:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-07T19:30:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-07T19:30:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-07T19:30:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-07T19:30:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-07T19:30:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-07T19:30:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-07T19:30:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-07T19:30:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-07T19:30:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-07T19:30:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-09-07T19:30:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-07T19:30:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-07T19:30:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-07T19:30:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-07T19:30:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-07T19:30:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-07T19:30:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-07T19:30:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-07T19:30:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-07T19:30:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-07T19:30:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-09-07T19:30:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-07T19:30:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-09-07T19:30:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-07T19:30:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-07T19:30:15.295 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling module streams: 2022-09-07T19:30:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql 10 2022-09-07T19:30:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:30:15.295 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2022-09-07T19:30:15.295 INFO:teuthology.orchestra.run.smithi080.stdout:=========================================================================================================================== 2022-09-07T19:30:15.296 INFO:teuthology.orchestra.run.smithi080.stdout:Install 128 Packages 2022-09-07T19:30:15.296 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 4 Packages 2022-09-07T19:30:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:30:15.297 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 216 M 2022-09-07T19:30:15.297 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2022-09-07T19:30:15.379 INFO:teuthology.orchestra.run.smithi155.stdout:(10/132): ceph-radosgw-17.0.0-14857.g15219419.e 9.5 MB/s | 18 MB 00:01 2022-09-07T19:30:15.463 INFO:teuthology.orchestra.run.smithi155.stdout:(11/132): cephfs-mirror-17.0.0-14857.g15219419. 3.0 MB/s | 257 kB 00:00 2022-09-07T19:30:15.510 INFO:teuthology.orchestra.run.smithi080.stdout:(1/132): ceph-17.0.0-14857.g15219419.el8.x86_64 27 kB/s | 6.4 kB 00:00 2022-09-07T19:30:15.554 INFO:teuthology.orchestra.run.smithi155.stdout:(12/132): libcephfs-devel-17.0.0-14857.g1521941 333 kB/s | 30 kB 00:00 2022-09-07T19:30:15.719 INFO:teuthology.orchestra.run.smithi154.stdout:(6/132): ceph-base-17.0.0-14857.g15219419.el8.x 1.8 MB/s | 5.2 MB 00:02 2022-09-07T19:30:15.721 INFO:teuthology.orchestra.run.smithi155.stdout:(13/132): libcephfs2-17.0.0-14857.g15219419.el8 4.5 MB/s | 766 kB 00:00 2022-09-07T19:30:15.830 INFO:teuthology.orchestra.run.smithi155.stdout:(14/132): libcephsqlite-17.0.0-14857.g15219419. 1.2 MB/s | 137 kB 00:00 2022-09-07T19:30:15.869 INFO:teuthology.orchestra.run.smithi154.stdout:(7/132): ceph-mon-17.0.0-14857.g15219419.el8.x8 6.1 MB/s | 3.9 MB 00:00 2022-09-07T19:30:15.905 INFO:teuthology.orchestra.run.smithi155.stdout:(15/132): librados-devel-17.0.0-14857.g15219419 1.8 MB/s | 139 kB 00:00 2022-09-07T19:30:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:(16/132): libradosstriper1-17.0.0-14857.g152194 4.3 MB/s | 473 kB 00:00 2022-09-07T19:30:16.893 INFO:teuthology.orchestra.run.smithi080.stdout:(2/132): ceph-fuse-17.0.0-14857.g15219419.el8.x 611 kB/s | 844 kB 00:01 2022-09-07T19:30:17.022 INFO:teuthology.orchestra.run.smithi155.stdout:(17/132): librgw2-17.0.0-14857.g15219419.el8.x8 5.7 MB/s | 5.8 MB 00:01 2022-09-07T19:30:17.093 INFO:teuthology.orchestra.run.smithi080.stdout:(3/132): ceph-immutable-object-cache-17.0.0-148 827 kB/s | 165 kB 00:00 2022-09-07T19:30:17.114 INFO:teuthology.orchestra.run.smithi155.stdout:(18/132): python3-ceph-argparse-17.0.0-14857.g1 488 kB/s | 45 kB 00:00 2022-09-07T19:30:17.198 INFO:teuthology.orchestra.run.smithi155.stdout:(19/132): python3-ceph-common-17.0.0-14857.g152 1.3 MB/s | 109 kB 00:00 2022-09-07T19:30:17.298 INFO:teuthology.orchestra.run.smithi155.stdout:(20/132): python3-cephfs-17.0.0-14857.g15219419 1.9 MB/s | 190 kB 00:00 2022-09-07T19:30:17.406 INFO:teuthology.orchestra.run.smithi155.stdout:(21/132): python3-rados-17.0.0-14857.g15219419. 3.4 MB/s | 372 kB 00:00 2022-09-07T19:30:17.515 INFO:teuthology.orchestra.run.smithi155.stdout:(22/132): python3-rbd-17.0.0-14857.g15219419.el 3.2 MB/s | 358 kB 00:00 2022-09-07T19:30:17.641 INFO:teuthology.orchestra.run.smithi155.stdout:(23/132): python3-rgw-17.0.0-14857.g15219419.el 850 kB/s | 107 kB 00:00 2022-09-07T19:30:17.732 INFO:teuthology.orchestra.run.smithi155.stdout:(24/132): rbd-fuse-17.0.0-14857.g15219419.el8.x 1.0 MB/s | 94 kB 00:00 2022-09-07T19:30:17.919 INFO:teuthology.orchestra.run.smithi080.stdout:(4/132): ceph-base-17.0.0-14857.g15219419.el8.x 2.0 MB/s | 5.2 MB 00:02 2022-09-07T19:30:18.492 INFO:teuthology.orchestra.run.smithi155.stdout:(25/132): rbd-mirror-17.0.0-14857.g15219419.el8 4.6 MB/s | 3.5 MB 00:00 2022-09-07T19:30:18.543 INFO:teuthology.orchestra.run.smithi080.stdout:(5/132): ceph-mgr-17.0.0-14857.g15219419.el8.x8 2.4 MB/s | 1.5 MB 00:00 2022-09-07T19:30:18.616 INFO:teuthology.orchestra.run.smithi155.stdout:(26/132): rbd-nbd-17.0.0-14857.g15219419.el8.x8 1.4 MB/s | 175 kB 00:00 2022-09-07T19:30:18.652 INFO:teuthology.orchestra.run.smithi080.stdout:(6/132): ceph-mds-17.0.0-14857.g15219419.el8.x8 1.5 MB/s | 2.3 MB 00:01 2022-09-07T19:30:18.691 INFO:teuthology.orchestra.run.smithi155.stdout:(27/132): ceph-grafana-dashboards-17.0.0-14857. 305 kB/s | 23 kB 00:00 2022-09-07T19:30:18.784 INFO:teuthology.orchestra.run.smithi155.stdout:(28/132): ceph-mgr-cephadm-17.0.0-14857.g152194 1.2 MB/s | 115 kB 00:00 2022-09-07T19:30:19.284 INFO:teuthology.orchestra.run.smithi155.stdout:(29/132): ceph-osd-17.0.0-14857.g15219419.el8.x 2.9 MB/s | 17 MB 00:05 2022-09-07T19:30:19.326 INFO:teuthology.orchestra.run.smithi155.stdout:(30/132): ceph-mgr-dashboard-17.0.0-14857.g1521 3.0 MB/s | 1.6 MB 00:00 2022-09-07T19:30:19.345 INFO:teuthology.orchestra.run.smithi154.stdout:(8/132): ceph-radosgw-17.0.0-14857.g15219419.el 5.1 MB/s | 18 MB 00:03 2022-09-07T19:30:19.401 INFO:teuthology.orchestra.run.smithi155.stdout:(31/132): ceph-mgr-modules-core-17.0.0-14857.g1 3.0 MB/s | 233 kB 00:00 2022-09-07T19:30:19.459 INFO:teuthology.orchestra.run.smithi154.stdout:(9/132): ceph-selinux-17.0.0-14857.g15219419.el 212 kB/s | 24 kB 00:00 2022-09-07T19:30:19.476 INFO:teuthology.orchestra.run.smithi155.stdout:(32/132): ceph-mgr-rook-17.0.0-14857.g15219419. 627 kB/s | 47 kB 00:00 2022-09-07T19:30:19.552 INFO:teuthology.orchestra.run.smithi155.stdout:(33/132): ceph-prometheus-alerts-17.0.0-14857.g 192 kB/s | 14 kB 00:00 2022-09-07T19:30:19.564 INFO:teuthology.orchestra.run.smithi080.stdout:(7/132): ceph-mon-17.0.0-14857.g15219419.el8.x8 3.8 MB/s | 3.9 MB 00:01 2022-09-07T19:30:19.627 INFO:teuthology.orchestra.run.smithi155.stdout:(34/132): ceph-volume-17.0.0-14857.g15219419.el 3.4 MB/s | 263 kB 00:00 2022-09-07T19:30:19.718 INFO:teuthology.orchestra.run.smithi155.stdout:(35/132): cephadm-17.0.0-14857.g15219419.el8.no 885 kB/s | 81 kB 00:00 2022-09-07T19:30:19.810 INFO:teuthology.orchestra.run.smithi155.stdout:(36/132): cephfs-top-17.0.0-14857.g15219419.el8 168 kB/s | 15 kB 00:00 2022-09-07T19:30:19.994 INFO:teuthology.orchestra.run.smithi155.stdout:(37/132): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2022-09-07T19:30:20.053 INFO:teuthology.orchestra.run.smithi155.stdout:(38/132): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2022-09-07T19:30:20.095 INFO:teuthology.orchestra.run.smithi155.stdout:(39/132): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2022-09-07T19:30:20.178 INFO:teuthology.orchestra.run.smithi155.stdout:(40/132): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2022-09-07T19:30:20.229 INFO:teuthology.orchestra.run.smithi155.stdout:(41/132): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2022-09-07T19:30:20.330 INFO:teuthology.orchestra.run.smithi155.stdout:(42/132): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2022-09-07T19:30:20.396 INFO:teuthology.orchestra.run.smithi155.stdout:(43/132): python3-cachetools-3.1.1-4.el8.noarch 495 kB/s | 33 kB 00:00 2022-09-07T19:30:20.471 INFO:teuthology.orchestra.run.smithi155.stdout:(44/132): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2022-09-07T19:30:20.522 INFO:teuthology.orchestra.run.smithi155.stdout:(45/132): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2022-09-07T19:30:20.597 INFO:teuthology.orchestra.run.smithi155.stdout:(46/132): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2022-09-07T19:30:20.647 INFO:teuthology.orchestra.run.smithi155.stdout:(47/132): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2022-09-07T19:30:20.698 INFO:teuthology.orchestra.run.smithi155.stdout:(48/132): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2022-09-07T19:30:20.748 INFO:teuthology.orchestra.run.smithi155.stdout:(49/132): python3-jaraco-functools-2.0-4.el8.no 352 kB/s | 18 kB 00:00 2022-09-07T19:30:21.240 INFO:teuthology.orchestra.run.smithi155.stdout:(50/132): ceph-test-17.0.0-14857.g15219419.el8. 7.9 MB/s | 54 MB 00:06 2022-09-07T19:30:21.282 INFO:teuthology.orchestra.run.smithi155.stdout:(51/132): python3-kubernetes-11.0.0-6.el8.noarc 2.2 MB/s | 1.2 MB 00:00 2022-09-07T19:30:21.332 INFO:teuthology.orchestra.run.smithi155.stdout:(52/132): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2022-09-07T19:30:21.382 INFO:teuthology.orchestra.run.smithi155.stdout:(53/132): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2022-09-07T19:30:21.407 INFO:teuthology.orchestra.run.smithi155.stdout:(54/132): python3-logutils-0.3.5-11.el8.noarch. 292 kB/s | 49 kB 00:00 2022-09-07T19:30:21.458 INFO:teuthology.orchestra.run.smithi155.stdout:(55/132): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2022-09-07T19:30:21.483 INFO:teuthology.orchestra.run.smithi155.stdout:(56/132): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2022-09-07T19:30:21.508 INFO:teuthology.orchestra.run.smithi155.stdout:(57/132): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2022-09-07T19:30:21.542 INFO:teuthology.orchestra.run.smithi155.stdout:(58/132): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2022-09-07T19:30:21.567 INFO:teuthology.orchestra.run.smithi155.stdout:(59/132): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2022-09-07T19:30:21.659 INFO:teuthology.orchestra.run.smithi155.stdout:(60/132): ceph-mgr-diskprediction-local-17.0.0- 3.1 MB/s | 7.4 MB 00:02 2022-09-07T19:30:21.684 INFO:teuthology.orchestra.run.smithi155.stdout:(61/132): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2022-09-07T19:30:21.709 INFO:teuthology.orchestra.run.smithi155.stdout:(62/132): python3-singledispatch-3.4.0.3-18.el8 168 kB/s | 24 kB 00:00 2022-09-07T19:30:21.760 INFO:teuthology.orchestra.run.smithi155.stdout:(63/132): python3-trustme-0.6.0-4.el8.noarch.rp 552 kB/s | 27 kB 00:00 2022-09-07T19:30:21.794 INFO:teuthology.orchestra.run.smithi155.stdout:(64/132): python3-waitress-1.2.1-2.el8.1.noarch 2.8 MB/s | 241 kB 00:00 2022-09-07T19:30:21.819 INFO:teuthology.orchestra.run.smithi155.stdout:(65/132): python3-tempora-1.14.1-5.el8.noarch.r 184 kB/s | 29 kB 00:00 2022-09-07T19:30:21.866 INFO:teuthology.orchestra.run.smithi155.stdout:(66/132): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2022-09-07T19:30:21.894 INFO:teuthology.orchestra.run.smithi155.stdout:(67/132): python3-websocket-client-0.56.0-5.el8 609 kB/s | 61 kB 00:00 2022-09-07T19:30:21.913 INFO:teuthology.orchestra.run.smithi155.stdout:(68/132): python3-zc-lockfile-2.0-2.el8.noarch. 507 kB/s | 23 kB 00:00 2022-09-07T19:30:21.928 INFO:teuthology.orchestra.run.smithi155.stdout:(69/132): python3-webtest-2.0.33-1.el8.noarch.r 781 kB/s | 85 kB 00:00 2022-09-07T19:30:21.962 INFO:teuthology.orchestra.run.smithi155.stdout:(70/132): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2022-09-07T19:30:22.020 INFO:teuthology.orchestra.run.smithi155.stdout:(71/132): postgresql-contrib-10.21-2.module+el8 8.6 MB/s | 808 kB 00:00 2022-09-07T19:30:22.054 INFO:teuthology.orchestra.run.smithi155.stdout:(72/132): bison-3.0.4-10.el8.x86_64.rpm 7.3 MB/s | 688 kB 00:00 2022-09-07T19:30:22.113 INFO:teuthology.orchestra.run.smithi155.stdout:(73/132): postgresql-10.21-2.module+el8.6.0+153 16 MB/s | 1.5 MB 00:00 2022-09-07T19:30:22.188 INFO:teuthology.orchestra.run.smithi155.stdout:(74/132): python3-numpy-1.14.3-10.el8.x86_64.rp 28 MB/s | 3.7 MB 00:00 2022-09-07T19:30:22.231 INFO:teuthology.orchestra.run.smithi155.stdout:(75/132): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2022-09-07T19:30:22.272 INFO:teuthology.orchestra.run.smithi155.stdout:(76/132): python3-werkzeug-0.12.2-4.el8.noarch. 5.4 MB/s | 457 kB 00:00 2022-09-07T19:30:22.297 INFO:teuthology.orchestra.run.smithi155.stdout:(77/132): python3-markupsafe-0.23-19.el8.x86_64 591 kB/s | 39 kB 00:00 2022-09-07T19:30:22.331 INFO:teuthology.orchestra.run.smithi155.stdout:(78/132): python3-prettytable-0.7.2-14.el8.noar 753 kB/s | 44 kB 00:00 2022-09-07T19:30:22.364 INFO:teuthology.orchestra.run.smithi155.stdout:(79/132): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2022-09-07T19:30:22.431 INFO:teuthology.orchestra.run.smithi155.stdout:(80/132): postgresql-server-10.21-2.module+el8. 16 MB/s | 5.1 MB 00:00 2022-09-07T19:30:22.473 INFO:teuthology.orchestra.run.smithi155.stdout:(81/132): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2022-09-07T19:30:22.498 INFO:teuthology.orchestra.run.smithi155.stdout:(82/132): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2022-09-07T19:30:22.541 INFO:teuthology.orchestra.run.smithi155.stdout:(83/132): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2022-09-07T19:30:22.574 INFO:teuthology.orchestra.run.smithi155.stdout:(84/132): python3-mako-1.0.6-13.el8.noarch.rpm 2.1 MB/s | 157 kB 00:00 2022-09-07T19:30:22.616 INFO:teuthology.orchestra.run.smithi155.stdout:(85/132): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2022-09-07T19:30:22.658 INFO:teuthology.orchestra.run.smithi155.stdout:(86/132): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2022-09-07T19:30:22.725 INFO:teuthology.orchestra.run.smithi155.stdout:(87/132): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2022-09-07T19:30:22.800 INFO:teuthology.orchestra.run.smithi155.stdout:(88/132): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2022-09-07T19:30:22.825 INFO:teuthology.orchestra.run.smithi155.stdout:(89/132): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2022-09-07T19:30:22.867 INFO:teuthology.orchestra.run.smithi155.stdout:(90/132): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2022-09-07T19:30:22.917 INFO:teuthology.orchestra.run.smithi155.stdout:(91/132): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-09-07T19:30:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:(92/132): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2022-09-07T19:30:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:(93/132): python3-pytz-2017.2-9.el8.noarch.rpm 542 kB/s | 54 kB 00:00 2022-09-07T19:30:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:(94/132): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.9 MB/s | 126 kB 00:00 2022-09-07T19:30:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:(95/132): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2022-09-07T19:30:23.118 INFO:teuthology.orchestra.run.smithi155.stdout:(96/132): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2022-09-07T19:30:23.144 INFO:teuthology.orchestra.run.smithi155.stdout:(97/132): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-09-07T19:30:23.186 INFO:teuthology.orchestra.run.smithi155.stdout:(98/132): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2022-09-07T19:30:23.211 INFO:teuthology.orchestra.run.smithi155.stdout:(99/132): python3-jsonpatch-1.21-2.el8.noarch.r 402 kB/s | 27 kB 00:00 2022-09-07T19:30:23.224 INFO:teuthology.orchestra.run.smithi080.stdout:(8/132): ceph-common-17.0.0-14857.g15219419.el8 3.0 MB/s | 24 MB 00:07 2022-09-07T19:30:23.245 INFO:teuthology.orchestra.run.smithi155.stdout:(100/132): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2022-09-07T19:30:23.287 INFO:teuthology.orchestra.run.smithi155.stdout:(101/132): python3-pyasn1-modules-0.3.7-6.el8.n 1.4 MB/s | 110 kB 00:00 2022-09-07T19:30:23.411 INFO:teuthology.orchestra.run.smithi080.stdout:(9/132): ceph-radosgw-17.0.0-14857.g15219419.el 4.6 MB/s | 18 MB 00:03 2022-09-07T19:30:23.436 INFO:teuthology.orchestra.run.smithi080.stdout:(10/132): ceph-selinux-17.0.0-14857.g15219419.e 112 kB/s | 24 kB 00:00 2022-09-07T19:30:23.437 INFO:teuthology.orchestra.run.smithi155.stdout:(102/132): python3-scipy-1.0.0-21.module+el8.5. 22 MB/s | 14 MB 00:00 2022-09-07T19:30:23.462 INFO:teuthology.orchestra.run.smithi155.stdout:(103/132): fuse-2.9.7-15.el8.x86_64.rpm 475 kB/s | 83 kB 00:00 2022-09-07T19:30:23.496 INFO:teuthology.orchestra.run.smithi155.stdout:(104/132): pcre2-devel-10.32-2.el8.x86_64.rpm 2.4 MB/s | 605 kB 00:00 2022-09-07T19:30:23.529 INFO:teuthology.orchestra.run.smithi155.stdout:(105/132): libsepol-devel-2.9-3.el8.x86_64.rpm 949 kB/s | 87 kB 00:00 2022-09-07T19:30:23.556 INFO:teuthology.orchestra.run.smithi155.stdout:(106/132): libselinux-devel-2.9-5.el8.x86_64.rp 3.5 MB/s | 200 kB 00:00 2022-09-07T19:30:23.580 INFO:teuthology.orchestra.run.smithi155.stdout:(107/132): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2022-09-07T19:30:23.613 INFO:teuthology.orchestra.run.smithi155.stdout:(108/132): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2022-09-07T19:30:23.639 INFO:teuthology.orchestra.run.smithi155.stdout:(109/132): librabbitmq-0.9.0-3.el8.x86_64.rpm 565 kB/s | 47 kB 00:00 2022-09-07T19:30:23.681 INFO:teuthology.orchestra.run.smithi155.stdout:(110/132): python3-cryptography-3.2.1-5.el8.x86 5.5 MB/s | 559 kB 00:00 2022-09-07T19:30:23.711 INFO:teuthology.orchestra.run.smithi080.stdout:(11/132): ceph-osd-17.0.0-14857.g15219419.el8.x 3.3 MB/s | 17 MB 00:05 2022-09-07T19:30:23.723 INFO:teuthology.orchestra.run.smithi155.stdout:(111/132): python3-oauthlib-2.1.0-1.el8.noarch. 1.4 MB/s | 155 kB 00:00 2022-09-07T19:30:23.736 INFO:teuthology.orchestra.run.smithi080.stdout:(12/132): cephfs-mirror-17.0.0-14857.g15219419. 856 kB/s | 257 kB 00:00 2022-09-07T19:30:23.748 INFO:teuthology.orchestra.run.smithi155.stdout:(112/132): python3-pycparser-2.14-14.el8.noarch 1.0 MB/s | 109 kB 00:00 2022-09-07T19:30:23.782 INFO:teuthology.orchestra.run.smithi155.stdout:(113/132): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.6 MB/s | 560 kB 00:00 2022-09-07T19:30:23.807 INFO:teuthology.orchestra.run.smithi155.stdout:(114/132): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.0 MB/s | 171 kB 00:00 2022-09-07T19:30:23.812 INFO:teuthology.orchestra.run.smithi080.stdout:(13/132): libcephfs-devel-17.0.0-14857.g1521941 305 kB/s | 30 kB 00:00 2022-09-07T19:30:23.832 INFO:teuthology.orchestra.run.smithi155.stdout:(115/132): python3-jwt-1.6.1-2.el8.noarch.rpm 510 kB/s | 43 kB 00:00 2022-09-07T19:30:23.866 INFO:teuthology.orchestra.run.smithi155.stdout:(116/132): zlib-devel-1.2.11-18.el8_5.x86_64.rp 699 kB/s | 58 kB 00:00 2022-09-07T19:30:23.899 INFO:teuthology.orchestra.run.smithi155.stdout:(117/132): elfutils-libelf-devel-0.186-1.el8.x8 651 kB/s | 60 kB 00:00 2022-09-07T19:30:23.925 INFO:teuthology.orchestra.run.smithi155.stdout:(118/132): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.6 MB/s | 238 kB 00:00 2022-09-07T19:30:23.958 INFO:teuthology.orchestra.run.smithi155.stdout:(119/132): libaio-devel-0.3.112-1.el8.x86_64.rp 208 kB/s | 19 kB 00:00 2022-09-07T19:30:23.975 INFO:teuthology.orchestra.run.smithi155.stdout:(120/132): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2022-09-07T19:30:23.995 INFO:teuthology.orchestra.run.smithi080.stdout:(14/132): libcephsqlite-17.0.0-14857.g15219419. 746 kB/s | 137 kB 00:00 2022-09-07T19:30:24.009 INFO:teuthology.orchestra.run.smithi155.stdout:(121/132): NetworkManager-initscripts-updown-1. 1.6 MB/s | 137 kB 00:00 2022-09-07T19:30:24.079 INFO:teuthology.orchestra.run.smithi080.stdout:(15/132): libcephfs2-17.0.0-14857.g15219419.el8 2.2 MB/s | 766 kB 00:00 2022-09-07T19:30:24.104 INFO:teuthology.orchestra.run.smithi080.stdout:(16/132): librados-devel-17.0.0-14857.g15219419 1.2 MB/s | 139 kB 00:00 2022-09-07T19:30:24.234 INFO:teuthology.orchestra.run.smithi155.stdout:(122/132): python3-requests-oauthlib-1.0.0-1.el 166 kB/s | 43 kB 00:00 2022-09-07T19:30:24.246 INFO:teuthology.orchestra.run.smithi080.stdout:(17/132): libradosstriper1-17.0.0-14857.g152194 2.8 MB/s | 473 kB 00:00 2022-09-07T19:30:24.260 INFO:teuthology.orchestra.run.smithi155.stdout:(123/132): pcre2-utf16-10.32-2.el8.x86_64.rpm 761 kB/s | 229 kB 00:00 2022-09-07T19:30:24.293 INFO:teuthology.orchestra.run.smithi155.stdout:(124/132): xfsprogs-devel-5.0.0-10.el8.x86_64.r 254 kB/s | 72 kB 00:00 2022-09-07T19:30:24.318 INFO:teuthology.orchestra.run.smithi155.stdout:(125/132): libcom_err-devel-1.45.6-4.el8.x86_64 461 kB/s | 39 kB 00:00 2022-09-07T19:30:24.330 INFO:teuthology.orchestra.run.smithi080.stdout:(18/132): python3-ceph-argparse-17.0.0-14857.g1 535 kB/s | 45 kB 00:00 2022-09-07T19:30:24.353 INFO:teuthology.orchestra.run.smithi155.stdout:(126/132): keyutils-libs-devel-1.5.10-9.el8.x86 826 kB/s | 48 kB 00:00 2022-09-07T19:30:24.385 INFO:teuthology.orchestra.run.smithi155.stdout:(127/132): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2022-09-07T19:30:24.422 INFO:teuthology.orchestra.run.smithi080.stdout:(19/132): python3-ceph-common-17.0.0-14857.g152 1.2 MB/s | 109 kB 00:00 2022-09-07T19:30:24.427 INFO:teuthology.orchestra.run.smithi155.stdout:(128/132): openssl-devel-1.1.1k-7.el8_6.x86_64. 14 MB/s | 2.3 MB 00:00 2022-09-07T19:30:24.478 INFO:teuthology.orchestra.run.smithi155.stdout:(129/132): openssl-1.1.1k-7.el8_6.x86_64.rpm 14 MB/s | 709 kB 00:00 2022-09-07T19:30:24.523 INFO:teuthology.orchestra.run.smithi080.stdout:(20/132): python3-cephfs-17.0.0-14857.g15219419 1.9 MB/s | 190 kB 00:00 2022-09-07T19:30:24.552 INFO:teuthology.orchestra.run.smithi155.stdout:(130/132): openssl-libs-1.1.1k-7.el8_6.x86_64.r 29 MB/s | 1.5 MB 00:00 2022-09-07T19:30:24.690 INFO:teuthology.orchestra.run.smithi080.stdout:(21/132): python3-rados-17.0.0-14857.g15219419. 2.2 MB/s | 372 kB 00:00 2022-09-07T19:30:24.849 INFO:teuthology.orchestra.run.smithi080.stdout:(22/132): python3-rbd-17.0.0-14857.g15219419.el 2.2 MB/s | 358 kB 00:00 2022-09-07T19:30:24.911 INFO:teuthology.orchestra.run.smithi154.stdout:(10/132): ceph-common-17.0.0-14857.g15219419.el 2.0 MB/s | 24 MB 00:12 2022-09-07T19:30:24.948 INFO:teuthology.orchestra.run.smithi080.stdout:(23/132): python3-rgw-17.0.0-14857.g15219419.el 1.0 MB/s | 107 kB 00:00 2022-09-07T19:30:25.065 INFO:teuthology.orchestra.run.smithi080.stdout:(24/132): rbd-fuse-17.0.0-14857.g15219419.el8.x 810 kB/s | 94 kB 00:00 2022-09-07T19:30:25.286 INFO:teuthology.orchestra.run.smithi154.stdout:(11/132): ceph-osd-17.0.0-14857.g15219419.el8.x 1.8 MB/s | 17 MB 00:09 2022-09-07T19:30:25.303 INFO:teuthology.orchestra.run.smithi154.stdout:(12/132): cephfs-mirror-17.0.0-14857.g15219419. 656 kB/s | 257 kB 00:00 2022-09-07T19:30:25.395 INFO:teuthology.orchestra.run.smithi155.stdout:(131/132): librbd1-17.0.0-14857.g15219419.el8.x 3.5 MB/s | 3.6 MB 00:01 2022-09-07T19:30:25.396 INFO:teuthology.orchestra.run.smithi154.stdout:(13/132): libcephfs-devel-17.0.0-14857.g1521941 282 kB/s | 30 kB 00:00 2022-09-07T19:30:25.578 INFO:teuthology.orchestra.run.smithi154.stdout:(14/132): libcephsqlite-17.0.0-14857.g15219419. 745 kB/s | 137 kB 00:00 2022-09-07T19:30:25.687 INFO:teuthology.orchestra.run.smithi154.stdout:(15/132): libcephfs2-17.0.0-14857.g15219419.el8 1.9 MB/s | 766 kB 00:00 2022-09-07T19:30:25.796 INFO:teuthology.orchestra.run.smithi154.stdout:(16/132): librados-devel-17.0.0-14857.g15219419 640 kB/s | 139 kB 00:00 2022-09-07T19:30:25.870 INFO:teuthology.orchestra.run.smithi155.stdout:(132/132): librados2-17.0.0-14857.g15219419.el8 2.4 MB/s | 3.6 MB 00:01 2022-09-07T19:30:25.873 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:30:25.874 INFO:teuthology.orchestra.run.smithi155.stdout:Total 16 MB/s | 216 MB 00:13 2022-09-07T19:30:25.999 INFO:teuthology.orchestra.run.smithi154.stdout:(17/132): libradosstriper1-17.0.0-14857.g152194 1.5 MB/s | 473 kB 00:00 2022-09-07T19:30:26.032 INFO:teuthology.orchestra.run.smithi080.stdout:(25/132): librgw2-17.0.0-14857.g15219419.el8.x8 3.0 MB/s | 5.8 MB 00:01 2022-09-07T19:30:26.105 INFO:teuthology.orchestra.run.smithi154.stdout:(18/132): python3-ceph-argparse-17.0.0-14857.g1 422 kB/s | 45 kB 00:00 2022-09-07T19:30:26.132 INFO:teuthology.orchestra.run.smithi080.stdout:(26/132): rbd-nbd-17.0.0-14857.g15219419.el8.x8 1.7 MB/s | 175 kB 00:00 2022-09-07T19:30:26.199 INFO:teuthology.orchestra.run.smithi080.stdout:(27/132): rbd-mirror-17.0.0-14857.g15219419.el8 3.1 MB/s | 3.5 MB 00:01 2022-09-07T19:30:26.205 INFO:teuthology.orchestra.run.smithi154.stdout:(19/132): python3-ceph-common-17.0.0-14857.g152 1.1 MB/s | 109 kB 00:00 2022-09-07T19:30:26.233 INFO:teuthology.orchestra.run.smithi080.stdout:(28/132): ceph-grafana-dashboards-17.0.0-14857. 228 kB/s | 23 kB 00:00 2022-09-07T19:30:26.300 INFO:teuthology.orchestra.run.smithi080.stdout:(29/132): ceph-mgr-cephadm-17.0.0-14857.g152194 1.1 MB/s | 115 kB 00:00 2022-09-07T19:30:26.372 INFO:teuthology.orchestra.run.smithi154.stdout:(20/132): python3-cephfs-17.0.0-14857.g15219419 1.1 MB/s | 190 kB 00:00 2022-09-07T19:30:26.631 INFO:teuthology.orchestra.run.smithi154.stdout:(21/132): python3-rados-17.0.0-14857.g15219419. 1.4 MB/s | 372 kB 00:00 2022-09-07T19:30:26.742 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2022-09-07T19:30:26.815 INFO:teuthology.orchestra.run.smithi154.stdout:(22/132): python3-rbd-17.0.0-14857.g15219419.el 1.9 MB/s | 358 kB 00:00 2022-09-07T19:30:26.878 INFO:teuthology.orchestra.run.smithi080.stdout:(30/132): ceph-mgr-dashboard-17.0.0-14857.g1521 2.6 MB/s | 1.6 MB 00:00 2022-09-07T19:30:26.903 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2022-09-07T19:30:26.904 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2022-09-07T19:30:26.933 INFO:teuthology.orchestra.run.smithi154.stdout:(23/132): python3-rgw-17.0.0-14857.g15219419.el 918 kB/s | 107 kB 00:00 2022-09-07T19:30:27.041 INFO:teuthology.orchestra.run.smithi154.stdout:(24/132): rbd-fuse-17.0.0-14857.g15219419.el8.x 870 kB/s | 94 kB 00:00 2022-09-07T19:30:27.051 INFO:teuthology.orchestra.run.smithi080.stdout:(31/132): ceph-mgr-modules-core-17.0.0-14857.g1 1.3 MB/s | 233 kB 00:00 2022-09-07T19:30:27.464 INFO:teuthology.orchestra.run.smithi080.stdout:(32/132): ceph-mgr-rook-17.0.0-14857.g15219419. 114 kB/s | 47 kB 00:00 2022-09-07T19:30:27.569 INFO:teuthology.orchestra.run.smithi080.stdout:(33/132): ceph-prometheus-alerts-17.0.0-14857.g 139 kB/s | 14 kB 00:00 2022-09-07T19:30:27.761 INFO:teuthology.orchestra.run.smithi080.stdout:(34/132): ceph-volume-17.0.0-14857.g15219419.el 1.3 MB/s | 263 kB 00:00 2022-09-07T19:30:27.877 INFO:teuthology.orchestra.run.smithi080.stdout:(35/132): cephadm-17.0.0-14857.g15219419.el8.no 695 kB/s | 81 kB 00:00 2022-09-07T19:30:27.986 INFO:teuthology.orchestra.run.smithi080.stdout:(36/132): cephfs-top-17.0.0-14857.g15219419.el8 143 kB/s | 15 kB 00:00 2022-09-07T19:30:28.033 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2022-09-07T19:30:28.036 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2022-09-07T19:30:28.178 INFO:teuthology.orchestra.run.smithi080.stdout:(37/132): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2022-09-07T19:30:28.234 INFO:teuthology.orchestra.run.smithi080.stdout:(38/132): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2022-09-07T19:30:28.278 INFO:teuthology.orchestra.run.smithi080.stdout:(39/132): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2022-09-07T19:30:28.370 INFO:teuthology.orchestra.run.smithi080.stdout:(40/132): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2022-09-07T19:30:28.421 INFO:teuthology.orchestra.run.smithi080.stdout:(41/132): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 870 kB/s | 44 kB 00:00 2022-09-07T19:30:28.478 INFO:teuthology.orchestra.run.smithi154.stdout:(25/132): ceph-test-17.0.0-14857.g15219419.el8. 6.0 MB/s | 54 MB 00:09 2022-09-07T19:30:28.480 INFO:teuthology.orchestra.run.smithi080.stdout:(42/132): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2022-09-07T19:30:28.530 INFO:teuthology.orchestra.run.smithi080.stdout:(43/132): python3-cachetools-3.1.1-4.el8.noarch 665 kB/s | 33 kB 00:00 2022-09-07T19:30:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:(44/132): python3-certifi-2018.10.15-7.el8.noar 326 kB/s | 16 kB 00:00 2022-09-07T19:30:28.640 INFO:teuthology.orchestra.run.smithi080.stdout:(45/132): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2022-09-07T19:30:28.668 INFO:teuthology.orchestra.run.smithi154.stdout:(26/132): rbd-nbd-17.0.0-14857.g15219419.el8.x8 914 kB/s | 175 kB 00:00 2022-09-07T19:30:28.723 INFO:teuthology.orchestra.run.smithi080.stdout:(46/132): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2022-09-07T19:30:28.757 INFO:teuthology.orchestra.run.smithi154.stdout:(27/132): rbd-mirror-17.0.0-14857.g15219419.el8 2.0 MB/s | 3.5 MB 00:01 2022-09-07T19:30:28.775 INFO:teuthology.orchestra.run.smithi154.stdout:(28/132): ceph-grafana-dashboards-17.0.0-14857. 210 kB/s | 23 kB 00:00 2022-09-07T19:30:28.840 INFO:teuthology.orchestra.run.smithi080.stdout:(47/132): ceph-mgr-diskprediction-local-17.0.0- 2.9 MB/s | 7.4 MB 00:02 2022-09-07T19:30:28.865 INFO:teuthology.orchestra.run.smithi080.stdout:(48/132): python3-google-auth-1.1.1-10.el8.noar 572 kB/s | 81 kB 00:00 2022-09-07T19:30:28.890 INFO:teuthology.orchestra.run.smithi154.stdout:(29/132): ceph-mgr-cephadm-17.0.0-14857.g152194 869 kB/s | 115 kB 00:00 2022-09-07T19:30:28.915 INFO:teuthology.orchestra.run.smithi080.stdout:(49/132): python3-jaraco-functools-2.0-4.el8.no 352 kB/s | 18 kB 00:00 2022-09-07T19:30:28.932 INFO:teuthology.orchestra.run.smithi080.stdout:(50/132): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2022-09-07T19:30:28.999 INFO:teuthology.orchestra.run.smithi080.stdout:(51/132): python3-logutils-0.3.5-11.el8.noarch. 732 kB/s | 49 kB 00:00 2022-09-07T19:30:29.066 INFO:teuthology.orchestra.run.smithi080.stdout:(52/132): python3-kubernetes-11.0.0-6.el8.noarc 7.7 MB/s | 1.2 MB 00:00 2022-09-07T19:30:29.091 INFO:teuthology.orchestra.run.smithi080.stdout:(53/132): python3-more-itertools-7.2.0-3.el8.no 641 kB/s | 59 kB 00:00 2022-09-07T19:30:29.117 INFO:teuthology.orchestra.run.smithi080.stdout:(54/132): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2022-09-07T19:30:29.167 INFO:teuthology.orchestra.run.smithi080.stdout:(55/132): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2022-09-07T19:30:29.192 INFO:teuthology.orchestra.run.smithi080.stdout:(56/132): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2022-09-07T19:30:29.218 INFO:teuthology.orchestra.run.smithi080.stdout:(57/132): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2022-09-07T19:30:29.251 INFO:teuthology.orchestra.run.smithi080.stdout:(58/132): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2022-09-07T19:30:29.275 INFO:teuthology.orchestra.run.smithi154.stdout:(30/132): librgw2-17.0.0-14857.g15219419.el8.x8 1.7 MB/s | 5.8 MB 00:03 2022-09-07T19:30:29.276 INFO:teuthology.orchestra.run.smithi080.stdout:(59/132): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2022-09-07T19:30:29.308 INFO:teuthology.orchestra.run.smithi154.stdout:(31/132): ceph-mgr-dashboard-17.0.0-14857.g1521 3.1 MB/s | 1.6 MB 00:00 2022-09-07T19:30:29.310 INFO:teuthology.orchestra.run.smithi080.stdout:(60/132): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2022-09-07T19:30:29.335 INFO:teuthology.orchestra.run.smithi080.stdout:(61/132): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2022-09-07T19:30:29.377 INFO:teuthology.orchestra.run.smithi080.stdout:(62/132): python3-tempora-1.14.1-5.el8.noarch.r 437 kB/s | 29 kB 00:00 2022-09-07T19:30:29.403 INFO:teuthology.orchestra.run.smithi080.stdout:(63/132): python3-trustme-0.6.0-4.el8.noarch.rp 411 kB/s | 27 kB 00:00 2022-09-07T19:30:29.425 INFO:teuthology.orchestra.run.smithi154.stdout:(32/132): ceph-mgr-rook-17.0.0-14857.g15219419. 402 kB/s | 47 kB 00:00 2022-09-07T19:30:29.454 INFO:teuthology.orchestra.run.smithi080.stdout:(64/132): python3-waitress-1.2.1-2.el8.1.noarch 3.1 MB/s | 241 kB 00:00 2022-09-07T19:30:29.476 INFO:teuthology.orchestra.run.smithi154.stdout:(33/132): ceph-mgr-modules-core-17.0.0-14857.g1 1.1 MB/s | 233 kB 00:00 2022-09-07T19:30:29.487 INFO:teuthology.orchestra.run.smithi080.stdout:(65/132): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2022-09-07T19:30:29.526 INFO:teuthology.orchestra.run.smithi154.stdout:(34/132): ceph-prometheus-alerts-17.0.0-14857.g 144 kB/s | 14 kB 00:00 2022-09-07T19:30:29.529 INFO:teuthology.orchestra.run.smithi080.stdout:(66/132): python3-websocket-client-0.56.0-5.el8 810 kB/s | 61 kB 00:00 2022-09-07T19:30:29.571 INFO:teuthology.orchestra.run.smithi080.stdout:(67/132): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2022-09-07T19:30:29.596 INFO:teuthology.orchestra.run.smithi080.stdout:(68/132): python3-zc-lockfile-2.0-2.el8.noarch. 344 kB/s | 23 kB 00:00 2022-09-07T19:30:29.621 INFO:teuthology.orchestra.run.smithi080.stdout:(69/132): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2022-09-07T19:30:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:(35/132): cephadm-17.0.0-14857.g15219419.el8.no 648 kB/s | 81 kB 00:00 2022-09-07T19:30:29.676 INFO:teuthology.orchestra.run.smithi154.stdout:(36/132): ceph-volume-17.0.0-14857.g15219419.el 1.3 MB/s | 263 kB 00:00 2022-09-07T19:30:29.680 INFO:teuthology.orchestra.run.smithi080.stdout:(70/132): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2022-09-07T19:30:29.723 INFO:teuthology.orchestra.run.smithi080.stdout:(71/132): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2022-09-07T19:30:29.752 INFO:teuthology.orchestra.run.smithi154.stdout:(37/132): cephfs-top-17.0.0-14857.g15219419.el8 154 kB/s | 15 kB 00:00 2022-09-07T19:30:29.764 INFO:teuthology.orchestra.run.smithi080.stdout:(72/132): libsepol-devel-2.9-3.el8.x86_64.rpm 2.1 MB/s | 87 kB 00:00 2022-09-07T19:30:29.806 INFO:teuthology.orchestra.run.smithi080.stdout:(73/132): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2022-09-07T19:30:29.848 INFO:teuthology.orchestra.run.smithi080.stdout:(74/132): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2022-09-07T19:30:29.890 INFO:teuthology.orchestra.run.smithi080.stdout:(75/132): libverto-devel-0.3.0-5.el8.x86_64.rpm 430 kB/s | 18 kB 00:00 2022-09-07T19:30:29.932 INFO:teuthology.orchestra.run.smithi080.stdout:(76/132): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2022-09-07T19:30:29.974 INFO:teuthology.orchestra.run.smithi080.stdout:(77/132): librabbitmq-0.9.0-3.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2022-09-07T19:30:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:(38/132): liboath-2.6.2-3.el8.x86_64.rpm 235 kB/s | 59 kB 00:00 2022-09-07T19:30:30.016 INFO:teuthology.orchestra.run.smithi080.stdout:(78/132): python3-cryptography-3.2.1-5.el8.x86_ 6.6 MB/s | 559 kB 00:00 2022-09-07T19:30:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:(79/132): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2022-09-07T19:30:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:(39/132): gperftools-libs-2.7-9.el8.x86_64.rpm 815 kB/s | 306 kB 00:00 2022-09-07T19:30:30.084 INFO:teuthology.orchestra.run.smithi080.stdout:(80/132): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2022-09-07T19:30:30.126 INFO:teuthology.orchestra.run.smithi080.stdout:(81/132): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.1 MB/s | 171 kB 00:00 2022-09-07T19:30:30.159 INFO:teuthology.orchestra.run.smithi080.stdout:(82/132): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2022-09-07T19:30:30.184 INFO:teuthology.orchestra.run.smithi080.stdout:(83/132): python3-jwt-1.6.1-2.el8.noarch.rpm 731 kB/s | 43 kB 00:00 2022-09-07T19:30:30.201 INFO:teuthology.orchestra.run.smithi080.stdout:(84/132): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2022-09-07T19:30:30.202 INFO:teuthology.orchestra.run.smithi154.stdout:(40/132): libunwind-1.3.1-3.el8.x86_64.rpm 375 kB/s | 75 kB 00:00 2022-09-07T19:30:30.227 INFO:teuthology.orchestra.run.smithi080.stdout:(85/132): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2022-09-07T19:30:30.252 INFO:teuthology.orchestra.run.smithi080.stdout:(86/132): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.7 MB/s | 238 kB 00:00 2022-09-07T19:30:30.278 INFO:teuthology.orchestra.run.smithi080.stdout:(87/132): libaio-devel-0.3.112-1.el8.x86_64.rpm 371 kB/s | 19 kB 00:00 2022-09-07T19:30:30.295 INFO:teuthology.orchestra.run.smithi154.stdout:(41/132): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2022-09-07T19:30:30.303 INFO:teuthology.orchestra.run.smithi080.stdout:(88/132): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2022-09-07T19:30:30.346 INFO:teuthology.orchestra.run.smithi080.stdout:(89/132): NetworkManager-initscripts-updown-1.3 2.0 MB/s | 137 kB 00:00 2022-09-07T19:30:30.378 INFO:teuthology.orchestra.run.smithi080.stdout:(90/132): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2022-09-07T19:30:30.412 INFO:teuthology.orchestra.run.smithi080.stdout:(91/132): python3-requests-oauthlib-1.0.0-1.el8 642 kB/s | 43 kB 00:00 2022-09-07T19:30:30.428 INFO:teuthology.orchestra.run.smithi154.stdout:(42/132): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2022-09-07T19:30:30.446 INFO:teuthology.orchestra.run.smithi080.stdout:(92/132): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.1 MB/s | 72 kB 00:00 2022-09-07T19:30:30.453 INFO:teuthology.orchestra.run.smithi154.stdout:(43/132): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2022-09-07T19:30:30.479 INFO:teuthology.orchestra.run.smithi080.stdout:(93/132): libcom_err-devel-1.45.6-4.el8.x86_64. 576 kB/s | 39 kB 00:00 2022-09-07T19:30:30.504 INFO:teuthology.orchestra.run.smithi154.stdout:(44/132): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2022-09-07T19:30:30.522 INFO:teuthology.orchestra.run.smithi080.stdout:(94/132): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2022-09-07T19:30:30.529 INFO:teuthology.orchestra.run.smithi154.stdout:(45/132): python3-certifi-2018.10.15-7.el8.noar 215 kB/s | 16 kB 00:00 2022-09-07T19:30:30.588 INFO:teuthology.orchestra.run.smithi080.stdout:(95/132): openssl-devel-1.1.1k-7.el8_6.x86_64.r 16 MB/s | 2.3 MB 00:00 2022-09-07T19:30:30.596 INFO:teuthology.orchestra.run.smithi154.stdout:(46/132): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2022-09-07T19:30:30.631 INFO:teuthology.orchestra.run.smithi080.stdout:(96/132): libgfortran-8.5.0-10.1.el8_6.x86_64.r 5.8 MB/s | 644 kB 00:00 2022-09-07T19:30:30.673 INFO:teuthology.orchestra.run.smithi080.stdout:(97/132): postgresql-contrib-10.21-2.module+el8 9.4 MB/s | 808 kB 00:00 2022-09-07T19:30:30.689 INFO:teuthology.orchestra.run.smithi154.stdout:(47/132): python3-google-auth-1.1.1-10.el8.noar 885 kB/s | 81 kB 00:00 2022-09-07T19:30:30.723 INFO:teuthology.orchestra.run.smithi080.stdout:(98/132): bison-3.0.4-10.el8.x86_64.rpm 7.3 MB/s | 688 kB 00:00 2022-09-07T19:30:30.748 INFO:teuthology.orchestra.run.smithi154.stdout:(48/132): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2022-09-07T19:30:30.772 INFO:teuthology.orchestra.run.smithi154.stdout:(49/132): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2022-09-07T19:30:30.783 INFO:teuthology.orchestra.run.smithi080.stdout:(99/132): postgresql-10.21-2.module+el8.6.0+153 14 MB/s | 1.5 MB 00:00 2022-09-07T19:30:30.797 INFO:teuthology.orchestra.run.smithi154.stdout:(50/132): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2022-09-07T19:30:30.851 INFO:teuthology.orchestra.run.smithi154.stdout:(51/132): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2022-09-07T19:30:30.890 INFO:teuthology.orchestra.run.smithi080.stdout:(100/132): python3-numpy-1.14.3-10.el8.x86_64.r 22 MB/s | 3.7 MB 00:00 2022-09-07T19:30:30.923 INFO:teuthology.orchestra.run.smithi154.stdout:(52/132): python3-more-itertools-7.2.0-3.el8.no 785 kB/s | 59 kB 00:00 2022-09-07T19:30:30.949 INFO:teuthology.orchestra.run.smithi080.stdout:(101/132): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2022-09-07T19:30:30.973 INFO:teuthology.orchestra.run.smithi154.stdout:(53/132): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2022-09-07T19:30:31.042 INFO:teuthology.orchestra.run.smithi080.stdout:(102/132): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2022-09-07T19:30:31.066 INFO:teuthology.orchestra.run.smithi080.stdout:(103/132): python3-markupsafe-0.23-19.el8.x86_6 332 kB/s | 39 kB 00:00 2022-09-07T19:30:31.086 INFO:teuthology.orchestra.run.smithi154.stdout:(54/132): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2022-09-07T19:30:31.108 INFO:teuthology.orchestra.run.smithi080.stdout:(104/132): python3-prettytable-0.7.2-14.el8.noa 659 kB/s | 44 kB 00:00 2022-09-07T19:30:31.142 INFO:teuthology.orchestra.run.smithi080.stdout:(105/132): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2022-09-07T19:30:31.175 INFO:teuthology.orchestra.run.smithi154.stdout:(55/132): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2022-09-07T19:30:31.184 INFO:teuthology.orchestra.run.smithi080.stdout:(106/132): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2022-09-07T19:30:31.224 INFO:teuthology.orchestra.run.smithi154.stdout:(56/132): python3-repoze-lru-0.7-6.el8.noarch.r 584 kB/s | 34 kB 00:00 2022-09-07T19:30:31.234 INFO:teuthology.orchestra.run.smithi080.stdout:(107/132): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2022-09-07T19:30:31.259 INFO:teuthology.orchestra.run.smithi080.stdout:(108/132): python3-numpy-f2py-1.14.3-10.el8.x86 2.9 MB/s | 225 kB 00:00 2022-09-07T19:30:31.301 INFO:teuthology.orchestra.run.smithi080.stdout:(109/132): python3-mako-1.0.6-13.el8.noarch.rpm 3.8 MB/s | 157 kB 00:00 2022-09-07T19:30:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:(57/132): python3-kubernetes-11.0.0-6.el8.noarc 2.1 MB/s | 1.2 MB 00:00 2022-09-07T19:30:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:(58/132): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2022-09-07T19:30:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:(59/132): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2022-09-07T19:30:31.431 INFO:teuthology.orchestra.run.smithi080.stdout:(110/132): openblas-threads-0.3.15-3.el8.x86_64 25 MB/s | 4.9 MB 00:00 2022-09-07T19:30:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:(60/132): python3-simplegeneric-0.8.1-17.el8.no 235 kB/s | 19 kB 00:00 2022-09-07T19:30:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:(61/132): python3-singledispatch-3.4.0.3-18.el8 286 kB/s | 24 kB 00:00 2022-09-07T19:30:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:(62/132): python3-tempora-1.14.1-5.el8.noarch.r 641 kB/s | 29 kB 00:00 2022-09-07T19:30:31.470 INFO:teuthology.orchestra.run.smithi080.stdout:(111/132): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2022-09-07T19:30:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:(63/132): python3-trustme-0.6.0-4.el8.noarch.rp 658 kB/s | 27 kB 00:00 2022-09-07T19:30:31.544 INFO:teuthology.orchestra.run.smithi080.stdout:(112/132): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2022-09-07T19:30:31.577 INFO:teuthology.orchestra.run.smithi080.stdout:(113/132): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2022-09-07T19:30:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:(64/132): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2022-09-07T19:30:31.619 INFO:teuthology.orchestra.run.smithi080.stdout:(114/132): flex-2.6.1-9.el8.x86_64.rpm 4.2 MB/s | 320 kB 00:00 2022-09-07T19:30:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:(65/132): python3-waitress-1.2.1-2.el8.1.noarch 1.5 MB/s | 241 kB 00:00 2022-09-07T19:30:31.662 INFO:teuthology.orchestra.run.smithi080.stdout:(115/132): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2022-09-07T19:30:31.685 INFO:teuthology.orchestra.run.smithi154.stdout:(66/132): python3-websocket-client-0.56.0-5.el8 733 kB/s | 61 kB 00:00 2022-09-07T19:30:31.777 INFO:teuthology.orchestra.run.smithi154.stdout:(67/132): ceph-mgr-diskprediction-local-17.0.0- 2.6 MB/s | 7.4 MB 00:02 2022-09-07T19:30:31.778 INFO:teuthology.orchestra.run.smithi080.stdout:(116/132): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2022-09-07T19:30:31.811 INFO:teuthology.orchestra.run.smithi154.stdout:(68/132): python3-webtest-2.0.33-1.el8.noarch.r 464 kB/s | 85 kB 00:00 2022-09-07T19:30:31.828 INFO:teuthology.orchestra.run.smithi154.stdout:(69/132): python3-zc-lockfile-2.0-2.el8.noarch. 161 kB/s | 23 kB 00:00 2022-09-07T19:30:31.829 INFO:teuthology.orchestra.run.smithi080.stdout:(117/132): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-09-07T19:30:31.854 INFO:teuthology.orchestra.run.smithi154.stdout:(70/132): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2022-09-07T19:30:31.863 INFO:teuthology.orchestra.run.smithi080.stdout:(118/132): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2022-09-07T19:30:31.906 INFO:teuthology.orchestra.run.smithi080.stdout:(119/132): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2022-09-07T19:30:31.938 INFO:teuthology.orchestra.run.smithi080.stdout:(120/132): python3-jsonpointer-1.10-11.el8.noar 600 kB/s | 20 kB 00:00 2022-09-07T19:30:31.945 INFO:teuthology.orchestra.run.smithi154.stdout:(71/132): pcre2-devel-10.32-2.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2022-09-07T19:30:31.971 INFO:teuthology.orchestra.run.smithi154.stdout:(72/132): fuse-2.9.7-15.el8.x86_64.rpm 717 kB/s | 83 kB 00:00 2022-09-07T19:30:31.981 INFO:teuthology.orchestra.run.smithi080.stdout:(121/132): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2022-09-07T19:30:32.004 INFO:teuthology.orchestra.run.smithi154.stdout:(73/132): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2022-09-07T19:30:32.030 INFO:teuthology.orchestra.run.smithi154.stdout:(74/132): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2022-09-07T19:30:32.031 INFO:teuthology.orchestra.run.smithi080.stdout:(122/132): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2022-09-07T19:30:32.072 INFO:teuthology.orchestra.run.smithi154.stdout:(75/132): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2022-09-07T19:30:32.097 INFO:teuthology.orchestra.run.smithi154.stdout:(76/132): libverto-devel-0.3.0-5.el8.x86_64.rpm 271 kB/s | 18 kB 00:00 2022-09-07T19:30:32.162 INFO:teuthology.orchestra.run.smithi154.stdout:(77/132): librabbitmq-0.9.0-3.el8.x86_64.rpm 520 kB/s | 47 kB 00:00 2022-09-07T19:30:32.197 INFO:teuthology.orchestra.run.smithi154.stdout:(78/132): python3-cryptography-3.2.1-5.el8.x86_ 5.5 MB/s | 559 kB 00:00 2022-09-07T19:30:32.206 INFO:teuthology.orchestra.run.smithi080.stdout:(123/132): python3-scipy-1.0.0-21.module+el8.5. 25 MB/s | 14 MB 00:00 2022-09-07T19:30:32.231 INFO:teuthology.orchestra.run.smithi154.stdout:(79/132): python3-oauthlib-2.1.0-1.el8.noarch.r 2.2 MB/s | 155 kB 00:00 2022-09-07T19:30:32.239 INFO:teuthology.orchestra.run.smithi080.stdout:(124/132): oniguruma-6.8.2-2.el8.x86_64.rpm 898 kB/s | 187 kB 00:00 2022-09-07T19:30:32.256 INFO:teuthology.orchestra.run.smithi154.stdout:(80/132): python3-pycparser-2.14-14.el8.noarch. 1.9 MB/s | 109 kB 00:00 2022-09-07T19:30:32.299 INFO:teuthology.orchestra.run.smithi154.stdout:(81/132): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2022-09-07T19:30:32.315 INFO:teuthology.orchestra.run.smithi154.stdout:(82/132): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2022-09-07T19:30:32.349 INFO:teuthology.orchestra.run.smithi154.stdout:(83/132): python3-jwt-1.6.1-2.el8.noarch.rpm 851 kB/s | 43 kB 00:00 2022-09-07T19:30:32.374 INFO:teuthology.orchestra.run.smithi154.stdout:(84/132): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2022-09-07T19:30:32.398 INFO:teuthology.orchestra.run.smithi080.stdout:(125/132): python3-jsonpatch-1.21-2.el8.noarch. 138 kB/s | 27 kB 00:00 2022-09-07T19:30:32.442 INFO:teuthology.orchestra.run.smithi154.stdout:(85/132): elfutils-libelf-devel-0.186-1.el8.x86 652 kB/s | 60 kB 00:00 2022-09-07T19:30:32.466 INFO:teuthology.orchestra.run.smithi154.stdout:(86/132): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2022-09-07T19:30:32.500 INFO:teuthology.orchestra.run.smithi154.stdout:(87/132): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2022-09-07T19:30:32.526 INFO:teuthology.orchestra.run.smithi154.stdout:(88/132): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.7 MB/s | 98 kB 00:00 2022-09-07T19:30:32.567 INFO:teuthology.orchestra.run.smithi154.stdout:(89/132): NetworkManager-initscripts-updown-1.3 2.0 MB/s | 137 kB 00:00 2022-09-07T19:30:32.582 INFO:teuthology.orchestra.run.smithi080.stdout:(126/132): uuid-1.6.2-43.el8.x86_64.rpm 187 kB/s | 64 kB 00:00 2022-09-07T19:30:32.593 INFO:teuthology.orchestra.run.smithi154.stdout:(90/132): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2022-09-07T19:30:32.616 INFO:teuthology.orchestra.run.smithi080.stdout:(127/132): python3-pyasn1-modules-0.3.7-6.el8.n 507 kB/s | 110 kB 00:00 2022-09-07T19:30:32.626 INFO:teuthology.orchestra.run.smithi154.stdout:(91/132): python3-requests-oauthlib-1.0.0-1.el8 730 kB/s | 43 kB 00:00 2022-09-07T19:30:32.677 INFO:teuthology.orchestra.run.smithi154.stdout:(92/132): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 875 kB/s | 72 kB 00:00 2022-09-07T19:30:32.710 INFO:teuthology.orchestra.run.smithi154.stdout:(93/132): libcom_err-devel-1.45.6-4.el8.x86_64. 461 kB/s | 39 kB 00:00 2022-09-07T19:30:32.744 INFO:teuthology.orchestra.run.smithi154.stdout:(94/132): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2022-09-07T19:30:32.802 INFO:teuthology.orchestra.run.smithi154.stdout:(95/132): openssl-devel-1.1.1k-7.el8_6.x86_64.r 19 MB/s | 2.3 MB 00:00 2022-09-07T19:30:32.854 INFO:teuthology.orchestra.run.smithi154.stdout:(96/132): thrift-0.13.0-2.el8.x86_64.rpm 1.7 MB/s | 1.7 MB 00:01 2022-09-07T19:30:32.911 INFO:teuthology.orchestra.run.smithi154.stdout:(97/132): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.8 MB/s | 644 kB 00:00 2022-09-07T19:30:32.953 INFO:teuthology.orchestra.run.smithi154.stdout:(98/132): postgresql-contrib-10.21-2.module+el8 5.3 MB/s | 808 kB 00:00 2022-09-07T19:30:32.987 INFO:teuthology.orchestra.run.smithi154.stdout:(99/132): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2022-09-07T19:30:33.037 INFO:teuthology.orchestra.run.smithi154.stdout:(100/132): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2022-09-07T19:30:33.079 INFO:teuthology.orchestra.run.smithi154.stdout:(101/132): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2022-09-07T19:30:33.106 INFO:teuthology.orchestra.run.smithi154.stdout:(102/132): python3-markupsafe-0.23-19.el8.x86_6 1.5 MB/s | 39 kB 00:00 2022-09-07T19:30:33.149 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2022-09-07T19:30:33.205 INFO:teuthology.orchestra.run.smithi154.stdout:(103/132): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2022-09-07T19:30:33.223 INFO:teuthology.orchestra.run.smithi154.stdout:(104/132): python3-prettytable-0.7.2-14.el8.noa 376 kB/s | 44 kB 00:00 2022-09-07T19:30:33.297 INFO:teuthology.orchestra.run.smithi154.stdout:(105/132): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2022-09-07T19:30:33.331 INFO:teuthology.orchestra.run.smithi154.stdout:(106/132): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2022-09-07T19:30:33.356 INFO:teuthology.orchestra.run.smithi154.stdout:(107/132): python3-jinja2-2.10.1-3.el8.noarch.r 3.9 MB/s | 538 kB 00:00 2022-09-07T19:30:33.375 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/136 2022-09-07T19:30:33.430 INFO:teuthology.orchestra.run.smithi154.stdout:(108/132): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2022-09-07T19:30:33.465 INFO:teuthology.orchestra.run.smithi154.stdout:(109/132): python3-numpy-f2py-1.14.3-10.el8.x86 1.6 MB/s | 225 kB 00:00 2022-09-07T19:30:33.499 INFO:teuthology.orchestra.run.smithi154.stdout:(110/132): python3-mako-1.0.6-13.el8.noarch.rpm 2.2 MB/s | 157 kB 00:00 2022-09-07T19:30:33.541 INFO:teuthology.orchestra.run.smithi154.stdout:(111/132): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2022-09-07T19:30:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/136 2022-09-07T19:30:33.624 INFO:teuthology.orchestra.run.smithi154.stdout:(112/132): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2022-09-07T19:30:33.687 INFO:teuthology.orchestra.run.smithi154.stdout:(113/132): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2022-09-07T19:30:33.741 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/136 2022-09-07T19:30:33.766 INFO:teuthology.orchestra.run.smithi154.stdout:(114/132): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2022-09-07T19:30:33.800 INFO:teuthology.orchestra.run.smithi154.stdout:(115/132): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2022-09-07T19:30:33.834 INFO:teuthology.orchestra.run.smithi154.stdout:(116/132): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2022-09-07T19:30:33.885 INFO:teuthology.orchestra.run.smithi154.stdout:(117/132): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-09-07T19:30:33.916 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/136 2022-09-07T19:30:33.984 INFO:teuthology.orchestra.run.smithi154.stdout:(118/132): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2022-09-07T19:30:34.010 INFO:teuthology.orchestra.run.smithi154.stdout:(119/132): python3-pytz-2017.2-9.el8.noarch.rpm 433 kB/s | 54 kB 00:00 2022-09-07T19:30:34.043 INFO:teuthology.orchestra.run.smithi154.stdout:(120/132): python3-jsonpointer-1.10-11.el8.noar 607 kB/s | 20 kB 00:00 2022-09-07T19:30:34.052 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/136 2022-09-07T19:30:34.068 INFO:teuthology.orchestra.run.smithi154.stdout:(121/132): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.5 MB/s | 126 kB 00:00 2022-09-07T19:30:34.102 INFO:teuthology.orchestra.run.smithi154.stdout:(122/132): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2022-09-07T19:30:34.107 INFO:teuthology.orchestra.run.smithi080.stdout:(128/132): librbd1-17.0.0-14857.g15219419.el8.x 2.4 MB/s | 3.6 MB 00:01 2022-09-07T19:30:34.121 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/136 2022-09-07T19:30:34.127 INFO:teuthology.orchestra.run.smithi154.stdout:(123/132): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.4 MB/s | 259 kB 00:00 2022-09-07T19:30:34.166 INFO:teuthology.orchestra.run.smithi080.stdout:(129/132): librados2-17.0.0-14857.g15219419.el8 2.3 MB/s | 3.6 MB 00:01 2022-09-07T19:30:34.202 INFO:teuthology.orchestra.run.smithi154.stdout:(124/132): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2022-09-07T19:30:34.208 INFO:teuthology.orchestra.run.smithi080.stdout:(130/132): openssl-1.1.1k-7.el8_6.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2022-09-07T19:30:34.227 INFO:teuthology.orchestra.run.smithi154.stdout:(125/132): python3-jsonpatch-1.21-2.el8.noarch. 268 kB/s | 27 kB 00:00 2022-09-07T19:30:34.258 INFO:teuthology.orchestra.run.smithi080.stdout:(131/132): openssl-libs-1.1.1k-7.el8_6.x86_64.r 16 MB/s | 1.5 MB 00:00 2022-09-07T19:30:34.270 INFO:teuthology.orchestra.run.smithi154.stdout:(126/132): uuid-1.6.2-43.el8.x86_64.rpm 956 kB/s | 64 kB 00:00 2022-09-07T19:30:34.295 INFO:teuthology.orchestra.run.smithi154.stdout:(127/132): python3-pyasn1-modules-0.3.7-6.el8.n 1.6 MB/s | 110 kB 00:00 2022-09-07T19:30:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/136 2022-09-07T19:30:34.479 INFO:teuthology.orchestra.run.smithi154.stdout:(128/132): python3-scipy-1.0.0-21.module+el8.5. 20 MB/s | 14 MB 00:00 2022-09-07T19:30:34.529 INFO:teuthology.orchestra.run.smithi154.stdout:(129/132): openssl-1.1.1k-7.el8_6.x86_64.rpm 14 MB/s | 709 kB 00:00 2022-09-07T19:30:34.534 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/136 2022-09-07T19:30:34.588 INFO:teuthology.orchestra.run.smithi154.stdout:(130/132): openssl-libs-1.1.1k-7.el8_6.x86_64.r 25 MB/s | 1.5 MB 00:00 2022-09-07T19:30:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/136 2022-09-07T19:30:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:30:35.338 INFO:teuthology.orchestra.run.smithi154.stdout:(131/132): librados2-17.0.0-14857.g15219419.el8 3.4 MB/s | 3.6 MB 00:01 2022-09-07T19:30:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:30:35.702 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:30:35.820 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:30:36.018 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:30:36.100 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:30:36.113 INFO:teuthology.orchestra.run.smithi154.stdout:(132/132): librbd1-17.0.0-14857.g15219419.el8.x 2.0 MB/s | 3.6 MB 00:01 2022-09-07T19:30:36.116 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:30:36.116 INFO:teuthology.orchestra.run.smithi154.stdout:Total 9.2 MB/s | 216 MB 00:23 2022-09-07T19:30:36.249 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:17.0.0-14857.g15219419.el8.x86_6 10/136 2022-09-07T19:30:36.463 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpq-13.5-1.el8.x86_64 11/136 2022-09-07T19:30:36.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/136 2022-09-07T19:30:36.667 INFO:teuthology.orchestra.run.smithi080.stdout:(132/132): ceph-test-17.0.0-14857.g15219419.el8 4.1 MB/s | 54 MB 00:13 2022-09-07T19:30:36.670 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:30:36.670 INFO:teuthology.orchestra.run.smithi080.stdout:Total 10 MB/s | 216 MB 00:21 2022-09-07T19:30:36.978 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/136 2022-09-07T19:30:36.984 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2022-09-07T19:30:37.142 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2022-09-07T19:30:37.142 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2022-09-07T19:30:37.197 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/136 2022-09-07T19:30:37.393 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 15/136 2022-09-07T19:30:37.496 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 15/136 2022-09-07T19:30:37.643 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 16/136 2022-09-07T19:30:37.711 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 16/136 2022-09-07T19:30:37.849 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 17/136 2022-09-07T19:30:37.968 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 18/136 2022-09-07T19:30:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 18/136 2022-09-07T19:30:38.235 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 19/136 2022-09-07T19:30:38.290 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2022-09-07T19:30:38.295 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2022-09-07T19:30:38.854 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 19/136 2022-09-07T19:30:39.056 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 20/136 2022-09-07T19:30:39.640 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2022-09-07T19:30:39.640 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 20/136 2022-09-07T19:30:39.820 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2022-09-07T19:30:39.820 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2022-09-07T19:30:39.843 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.15-3.el8.x86_64 21/136 2022-09-07T19:30:40.520 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 21/136 2022-09-07T19:30:40.857 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 22/136 2022-09-07T19:30:41.021 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 23/136 2022-09-07T19:30:41.076 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2022-09-07T19:30:41.081 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2022-09-07T19:30:41.310 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/136 2022-09-07T19:30:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2022-09-07T19:30:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/136 2022-09-07T19:30:41.949 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:17.0.0-14857.g15219419.el8 27/136 2022-09-07T19:30:42.089 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:17.0.0-14857.g15219419.e 28/136 2022-09-07T19:30:42.362 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_ 29/136 2022-09-07T19:30:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/136 2022-09-07T19:30:43.589 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/136 2022-09-07T19:30:43.838 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/136 2022-09-07T19:30:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2022-09-07T19:30:44.034 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/136 2022-09-07T19:30:44.211 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/136 2022-09-07T19:30:44.427 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/136 2022-09-07T19:30:44.607 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/136 2022-09-07T19:30:44.780 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/136 2022-09-07T19:30:45.007 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/136 2022-09-07T19:30:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/136 2022-09-07T19:30:45.287 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/136 2022-09-07T19:30:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/136 2022-09-07T19:30:45.762 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/136 2022-09-07T19:30:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/136 2022-09-07T19:30:46.127 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/136 2022-09-07T19:30:46.226 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:30:46.337 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2022-09-07T19:30:46.370 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/136 2022-09-07T19:30:46.552 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/136 2022-09-07T19:30:46.602 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/136 2022-09-07T19:30:46.631 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:30:46.765 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 37/136 2022-09-07T19:30:46.825 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:30:46.928 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/136 2022-09-07T19:30:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:30:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:17.0.0-14857.g15219419.el8.x86_ 38/136 2022-09-07T19:30:47.099 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/136 2022-09-07T19:30:47.117 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:30:47.162 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/136 2022-09-07T19:30:47.237 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:30:47.264 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/136 2022-09-07T19:30:47.321 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 40/136 2022-09-07T19:30:47.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:17.0.0-14857.g15219419.el8.x86_6 10/136 2022-09-07T19:30:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/136 2022-09-07T19:30:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 41/136 2022-09-07T19:30:47.641 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/136 2022-09-07T19:30:47.661 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpq-13.5-1.el8.x86_64 11/136 2022-09-07T19:30:47.683 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/136 2022-09-07T19:30:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/136 2022-09-07T19:30:47.882 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 43/136 2022-09-07T19:30:47.895 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/136 2022-09-07T19:30:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/136 2022-09-07T19:30:48.097 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 44/136 2022-09-07T19:30:48.279 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/136 2022-09-07T19:30:48.494 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 45/136 2022-09-07T19:30:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/136 2022-09-07T19:30:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/136 2022-09-07T19:30:48.667 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 15/136 2022-09-07T19:30:48.766 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:30:48.808 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 15/136 2022-09-07T19:30:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 46/136 2022-09-07T19:30:48.985 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 47/136 2022-09-07T19:30:49.016 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 16/136 2022-09-07T19:30:49.089 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 16/136 2022-09-07T19:30:49.255 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 48/136 2022-09-07T19:30:49.278 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/136 2022-09-07T19:30:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:30:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 49/136 2022-09-07T19:30:49.490 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:30:49.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/136 2022-09-07T19:30:49.677 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:30:49.790 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 50/136 2022-09-07T19:30:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/136 2022-09-07T19:30:49.849 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:30:49.972 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 20/136 2022-09-07T19:30:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:30:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 51/136 2022-09-07T19:30:50.141 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 21/136 2022-09-07T19:30:50.185 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:17.0.0-14857.g15219419.el8.x86_6 10/136 2022-09-07T19:30:50.201 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 52/136 2022-09-07T19:30:50.276 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 21/136 2022-09-07T19:30:50.428 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpq-13.5-1.el8.x86_64 11/136 2022-09-07T19:30:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 22/136 2022-09-07T19:30:50.435 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 53/136 2022-09-07T19:30:50.578 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 54/136 2022-09-07T19:30:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/136 2022-09-07T19:30:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/136 2022-09-07T19:30:51.019 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/136 2022-09-07T19:30:51.093 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 22/136 2022-09-07T19:30:51.121 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/136 2022-09-07T19:30:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/136 2022-09-07T19:30:51.339 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 23/136 2022-09-07T19:30:51.426 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 15/136 2022-09-07T19:30:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 15/136 2022-09-07T19:30:51.718 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/136 2022-09-07T19:30:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 16/136 2022-09-07T19:30:51.896 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 16/136 2022-09-07T19:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 23/136 2022-09-07T19:30:51.937 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/136 2022-09-07T19:30:52.072 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/136 2022-09-07T19:30:52.150 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.15-3.el8.x86_64 24/136 2022-09-07T19:30:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 59/136 2022-09-07T19:30:52.376 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-15.el8.x86_64 60/136 2022-09-07T19:30:52.432 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/136 2022-09-07T19:30:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/136 2022-09-07T19:30:52.631 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/136 2022-09-07T19:30:52.669 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/136 2022-09-07T19:30:52.789 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 20/136 2022-09-07T19:30:52.822 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 24/136 2022-09-07T19:30:52.874 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 62/136 2022-09-07T19:30:52.951 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 62/136 2022-09-07T19:30:52.956 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 21/136 2022-09-07T19:30:53.140 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.6-3.el8.x86_64 63/136 2022-09-07T19:30:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 21/136 2022-09-07T19:30:53.162 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/136 2022-09-07T19:30:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 64/136 2022-09-07T19:30:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 22/136 2022-09-07T19:30:53.415 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/136 2022-09-07T19:30:53.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 65/136 2022-09-07T19:30:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:17.0.0-14857.g15219419.el8 27/136 2022-09-07T19:30:53.743 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:17.0.0-14857.g15219419.e 28/136 2022-09-07T19:30:53.750 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.1-7.el8.noarch 66/136 2022-09-07T19:30:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/136 2022-09-07T19:30:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_ 29/136 2022-09-07T19:30:54.090 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 22/136 2022-09-07T19:30:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/136 2022-09-07T19:30:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/136 2022-09-07T19:30:54.264 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 23/136 2022-09-07T19:30:54.338 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/136 2022-09-07T19:30:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/136 2022-09-07T19:30:54.798 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/136 2022-09-07T19:30:54.962 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/136 2022-09-07T19:30:55.021 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 23/136 2022-09-07T19:30:55.135 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/136 2022-09-07T19:30:55.198 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.15-3.el8.x86_64 24/136 2022-09-07T19:30:55.334 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/136 2022-09-07T19:30:55.545 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/136 2022-09-07T19:30:55.769 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/136 2022-09-07T19:30:55.951 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/136 2022-09-07T19:30:55.952 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/136 2022-09-07T19:30:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 24/136 2022-09-07T19:30:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/136 2022-09-07T19:30:56.319 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/136 2022-09-07T19:30:56.325 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/136 2022-09-07T19:30:56.462 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/136 2022-09-07T19:30:56.511 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/136 2022-09-07T19:30:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/136 2022-09-07T19:30:56.728 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/136 2022-09-07T19:30:56.951 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/136 2022-09-07T19:30:56.972 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:17.0.0-14857.g15219419.el8 27/136 2022-09-07T19:30:57.111 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:17.0.0-14857.g15219419.e 28/136 2022-09-07T19:30:57.181 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/136 2022-09-07T19:30:57.373 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/136 2022-09-07T19:30:57.407 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_ 29/136 2022-09-07T19:30:57.589 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/136 2022-09-07T19:30:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/136 2022-09-07T19:30:57.632 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/136 2022-09-07T19:30:57.969 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/136 2022-09-07T19:30:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/136 2022-09-07T19:30:58.509 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/136 2022-09-07T19:30:58.685 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/136 2022-09-07T19:30:58.774 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/136 2022-09-07T19:30:58.968 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/136 2022-09-07T19:30:59.021 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 37/136 2022-09-07T19:30:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/136 2022-09-07T19:30:59.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:17.0.0-14857.g15219419.el8.x86_ 38/136 2022-09-07T19:30:59.507 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/136 2022-09-07T19:30:59.513 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/136 2022-09-07T19:30:59.732 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/136 2022-09-07T19:30:59.782 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/136 2022-09-07T19:30:59.798 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/136 2022-09-07T19:30:59.820 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/136 2022-09-07T19:31:00.007 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/136 2022-09-07T19:31:00.014 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/136 2022-09-07T19:31:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/136 2022-09-07T19:31:00.277 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/136 2022-09-07T19:31:00.297 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.6-3.el8.x86_64 42/136 2022-09-07T19:31:00.440 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/136 2022-09-07T19:31:00.696 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/136 2022-09-07T19:31:00.728 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/136 2022-09-07T19:31:00.890 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:17.0.0-14857.g15219419.el8.x86_64 93/136 2022-09-07T19:31:00.932 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.1-7.el8.noarch 45/136 2022-09-07T19:31:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.0.0-14857.g15219419.el8.x86_64 93/136 2022-09-07T19:31:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 94/136 2022-09-07T19:31:01.136 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 46/136 2022-09-07T19:31:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 47/136 2022-09-07T19:31:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/136 2022-09-07T19:31:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/136 2022-09-07T19:31:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/136 2022-09-07T19:31:01.826 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/136 2022-09-07T19:31:01.896 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 50/136 2022-09-07T19:31:02.140 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/136 2022-09-07T19:31:02.153 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/136 2022-09-07T19:31:02.387 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/136 2022-09-07T19:31:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/136 2022-09-07T19:31:02.603 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/136 2022-09-07T19:31:02.847 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 37/136 2022-09-07T19:31:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/136 2022-09-07T19:31:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:17.0.0-14857.g15219419.el8.x86_ 38/136 2022-09-07T19:31:03.184 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/136 2022-09-07T19:31:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/136 2022-09-07T19:31:03.471 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/136 2022-09-07T19:31:03.513 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/136 2022-09-07T19:31:03.664 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/136 2022-09-07T19:31:03.804 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/136 2022-09-07T19:31:03.863 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/136 2022-09-07T19:31:03.986 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/136 2022-09-07T19:31:04.153 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/136 2022-09-07T19:31:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : jq-1.6-3.el8.x86_64 42/136 2022-09-07T19:31:04.339 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/136 2022-09-07T19:31:04.381 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/136 2022-09-07T19:31:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/136 2022-09-07T19:31:04.621 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/136 2022-09-07T19:31:04.825 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/136 2022-09-07T19:31:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.1-7.el8.noarch 45/136 2022-09-07T19:31:04.864 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 61/136 2022-09-07T19:31:05.021 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 46/136 2022-09-07T19:31:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 47/136 2022-09-07T19:31:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/136 2022-09-07T19:31:05.327 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/136 2022-09-07T19:31:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/136 2022-09-07T19:31:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/136 2022-09-07T19:31:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:05.742 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 50/136 2022-09-07T19:31:05.792 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 64/136 2022-09-07T19:31:05.887 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 96/136 2022-09-07T19:31:05.969 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 96/136 2022-09-07T19:31:05.992 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/136 2022-09-07T19:31:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/136 2022-09-07T19:31:06.081 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 97/136 2022-09-07T19:31:06.356 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/136 2022-09-07T19:31:06.424 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/136 2022-09-07T19:31:06.598 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.7-15.el8.x86_64 67/136 2022-09-07T19:31:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/136 2022-09-07T19:31:06.770 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/136 2022-09-07T19:31:06.991 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/136 2022-09-07T19:31:07.012 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/136 2022-09-07T19:31:07.314 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/136 2022-09-07T19:31:07.324 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/136 2022-09-07T19:31:07.512 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/136 2022-09-07T19:31:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/136 2022-09-07T19:31:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/136 2022-09-07T19:31:07.890 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/136 2022-09-07T19:31:07.997 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/136 2022-09-07T19:31:08.055 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/136 2022-09-07T19:31:08.289 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/136 2022-09-07T19:31:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/136 2022-09-07T19:31:08.474 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/136 2022-09-07T19:31:08.491 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/136 2022-09-07T19:31:08.713 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/136 2022-09-07T19:31:08.731 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/136 2022-09-07T19:31:08.867 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 61/136 2022-09-07T19:31:08.911 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/136 2022-09-07T19:31:09.099 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/136 2022-09-07T19:31:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/136 2022-09-07T19:31:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/136 2022-09-07T19:31:09.489 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/136 2022-09-07T19:31:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/136 2022-09-07T19:31:09.764 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/136 2022-09-07T19:31:09.789 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 64/136 2022-09-07T19:31:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/136 2022-09-07T19:31:10.054 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/136 2022-09-07T19:31:10.220 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/136 2022-09-07T19:31:10.315 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/136 2022-09-07T19:31:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/136 2022-09-07T19:31:10.514 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.7-15.el8.x86_64 67/136 2022-09-07T19:31:10.680 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/136 2022-09-07T19:31:10.904 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/136 2022-09-07T19:31:11.227 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/136 2022-09-07T19:31:11.453 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/136 2022-09-07T19:31:11.572 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/136 2022-09-07T19:31:11.633 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/136 2022-09-07T19:31:11.808 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/136 2022-09-07T19:31:11.910 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/136 2022-09-07T19:31:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/136 2022-09-07T19:31:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/136 2022-09-07T19:31:12.295 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/136 2022-09-07T19:31:12.453 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/136 2022-09-07T19:31:12.510 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/136 2022-09-07T19:31:12.731 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/136 2022-09-07T19:31:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/136 2022-09-07T19:31:12.885 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/136 2022-09-07T19:31:12.970 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/136 2022-09-07T19:31:13.112 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/136 2022-09-07T19:31:13.359 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/136 2022-09-07T19:31:13.561 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/136 2022-09-07T19:31:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/136 2022-09-07T19:31:13.844 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/136 2022-09-07T19:31:13.921 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:17.0.0-14857.g15219419.el8.x86_64 93/136 2022-09-07T19:31:14.000 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:17.0.0-14857.g15219419.el8.x86_64 93/136 2022-09-07T19:31:14.053 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/136 2022-09-07T19:31:14.222 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 94/136 2022-09-07T19:31:14.274 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/136 2022-09-07T19:31:14.527 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/136 2022-09-07T19:31:15.961 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/136 2022-09-07T19:31:16.291 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/136 2022-09-07T19:31:16.542 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/136 2022-09-07T19:31:16.901 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/136 2022-09-07T19:31:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/136 2022-09-07T19:31:17.399 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/136 2022-09-07T19:31:18.006 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/136 2022-09-07T19:31:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:18.593 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:17.0.0-14857.g15219419.el8.x86_64 93/136 2022-09-07T19:31:18.712 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:17.0.0-14857.g15219419.el8.x86_64 93/136 2022-09-07T19:31:18.792 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 94/136 2022-09-07T19:31:19.105 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 96/136 2022-09-07T19:31:19.185 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 96/136 2022-09-07T19:31:19.320 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 97/136 2022-09-07T19:31:24.503 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:24.734 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:24.853 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 97/136 2022-09-07T19:31:24.854 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2022-09-07T19:31:24.854 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2022-09-07T19:31:24.854 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2022-09-07T19:31:24.855 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2022-09-07T19:31:24.855 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2022-09-07T19:31:24.855 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2022-09-07T19:31:24.855 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2022-09-07T19:31:24.856 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2022-09-07T19:31:24.856 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2022-09-07T19:31:24.856 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:31:25.203 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 98/136 2022-09-07T19:31:25.447 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 95/136 2022-09-07T19:31:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 96/136 2022-09-07T19:31:25.910 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 96/136 2022-09-07T19:31:26.033 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 97/136 2022-09-07T19:31:26.685 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 98/136 2022-09-07T19:31:26.917 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 99/136 2022-09-07T19:31:27.136 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 99/136 2022-09-07T19:31:27.311 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 100/136 2022-09-07T19:31:27.694 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 100/136 2022-09-07T19:31:27.853 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 101/136 2022-09-07T19:31:27.870 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 101/136 2022-09-07T19:31:29.489 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.0.0-14857.g15219419.el8.noarch 102/136 2022-09-07T19:31:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:17.0.0-14857.g15219419.el8.noarch 102/136 2022-09-07T19:31:29.792 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14857.g15219419. 103/136 2022-09-07T19:31:29.931 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14857.g15219419 104/136 2022-09-07T19:31:30.119 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 105/136 2022-09-07T19:31:30.324 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 105/136 2022-09-07T19:31:30.608 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 106/136 2022-09-07T19:31:31.572 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 106/136 2022-09-07T19:31:31.752 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 107/136 2022-09-07T19:31:31.841 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 107/136 2022-09-07T19:31:32.201 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14857.g15219419.e 108/136 2022-09-07T19:31:32.398 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 109/136 2022-09-07T19:31:32.433 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 109/136 2022-09-07T19:31:32.594 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 110/136 2022-09-07T19:31:32.605 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 110/136 2022-09-07T19:31:34.260 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:17.0.0-14857.g15219419.el8.x86_64 111/136 2022-09-07T19:31:34.452 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 112/136 2022-09-07T19:31:34.486 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 112/136 2022-09-07T19:31:34.627 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14857.g1521 113/136 2022-09-07T19:31:34.669 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14857.g1521 113/136 2022-09-07T19:31:34.810 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 114/136 2022-09-07T19:31:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 114/136 2022-09-07T19:31:35.335 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 115/136 2022-09-07T19:31:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 97/136 2022-09-07T19:31:38.335 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2022-09-07T19:31:38.336 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2022-09-07T19:31:38.336 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2022-09-07T19:31:38.337 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /run 2022-09-07T19:31:38.337 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2022-09-07T19:31:38.338 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2022-09-07T19:31:38.338 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2022-09-07T19:31:38.338 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2022-09-07T19:31:38.339 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2022-09-07T19:31:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:31:38.734 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 98/136 2022-09-07T19:31:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 98/136 2022-09-07T19:31:40.365 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 115/136 2022-09-07T19:31:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 99/136 2022-09-07T19:31:40.627 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 116/136 2022-09-07T19:31:40.669 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 99/136 2022-09-07T19:31:40.842 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/136 2022-09-07T19:31:40.845 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 100/136 2022-09-07T19:31:41.030 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/136 2022-09-07T19:31:41.227 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 100/136 2022-09-07T19:31:41.314 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 118/136 2022-09-07T19:31:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 101/136 2022-09-07T19:31:41.434 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 101/136 2022-09-07T19:31:42.148 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 119/136 2022-09-07T19:31:42.443 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 120/136 2022-09-07T19:31:42.613 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 121/136 2022-09-07T19:31:42.771 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86 122/136 2022-09-07T19:31:42.934 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/136 2022-09-07T19:31:43.045 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:17.0.0-14857.g15219419.el8.noarch 102/136 2022-09-07T19:31:43.253 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:17.0.0-14857.g15219419.el8.noarch 102/136 2022-09-07T19:31:43.396 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14857.g15219419. 103/136 2022-09-07T19:31:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14857.g15219419 104/136 2022-09-07T19:31:43.790 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 105/136 2022-09-07T19:31:43.995 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 105/136 2022-09-07T19:31:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 106/136 2022-09-07T19:31:45.035 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:31:45.265 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 106/136 2022-09-07T19:31:45.284 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:31:45.301 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:31:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 107/136 2022-09-07T19:31:45.500 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 125/136 2022-09-07T19:31:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 107/136 2022-09-07T19:31:45.790 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 126/136 2022-09-07T19:31:45.934 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14857.g15219419.e 108/136 2022-09-07T19:31:46.058 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 127/136 2022-09-07T19:31:46.135 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 109/136 2022-09-07T19:31:46.180 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 109/136 2022-09-07T19:31:46.310 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/136 2022-09-07T19:31:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 110/136 2022-09-07T19:31:46.353 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 110/136 2022-09-07T19:31:46.483 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 129/136 2022-09-07T19:31:46.491 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 129/136 2022-09-07T19:31:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 130/136 2022-09-07T19:31:46.858 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.1-9.el8.x86_64 131/136 2022-09-07T19:31:46.933 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 131/136 2022-09-07T19:31:47.149 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/136 2022-09-07T19:31:47.164 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/136 2022-09-07T19:31:47.343 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 133/136 2022-09-07T19:31:47.344 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 134/136 2022-09-07T19:31:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 97/136 2022-09-07T19:31:47.439 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2022-09-07T19:31:47.439 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2022-09-07T19:31:47.440 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2022-09-07T19:31:47.440 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /run 2022-09-07T19:31:47.440 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2022-09-07T19:31:47.440 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2022-09-07T19:31:47.441 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2022-09-07T19:31:47.441 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2022-09-07T19:31:47.441 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2022-09-07T19:31:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:31:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 134/136 2022-09-07T19:31:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 135/136 2022-09-07T19:31:47.793 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 135/136 2022-09-07T19:31:47.794 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:31:47.895 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 98/136 2022-09-07T19:31:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:17.0.0-14857.g15219419.el8.x86_64 111/136 2022-09-07T19:31:48.271 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 112/136 2022-09-07T19:31:48.305 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 112/136 2022-09-07T19:31:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14857.g1521 113/136 2022-09-07T19:31:48.558 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14857.g1521 113/136 2022-09-07T19:31:48.603 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:31:48.604 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.0.0-14857.g15219419.el8.x86_64 1/136 2022-09-07T19:31:48.604 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 2/136 2022-09-07T19:31:48.604 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 3/136 2022-09-07T19:31:48.604 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 4/136 2022-09-07T19:31:48.604 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14857.g1521 5/136 2022-09-07T19:31:48.605 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 6/136 2022-09-07T19:31:48.605 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:31:48.605 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:31:48.605 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:31:48.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 10/136 2022-09-07T19:31:48.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 11/136 2022-09-07T19:31:48.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 12/136 2022-09-07T19:31:48.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 13/136 2022-09-07T19:31:48.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86 14/136 2022-09-07T19:31:48.608 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 15/136 2022-09-07T19:31:48.608 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 16/136 2022-09-07T19:31:48.608 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.0.0-14857.g15219419.el8.x86_ 17/136 2022-09-07T19:31:48.608 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 18/136 2022-09-07T19:31:48.609 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.0.0-14857.g15219419.el8.x86_64 19/136 2022-09-07T19:31:48.609 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14857.g15219419.e 20/136 2022-09-07T19:31:48.609 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.0.0-14857.g15219419.el8 21/136 2022-09-07T19:31:48.609 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_ 22/136 2022-09-07T19:31:48.609 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.0.0-14857.g15219419.el8.x86_6 23/136 2022-09-07T19:31:48.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 24/136 2022-09-07T19:31:48.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 25/136 2022-09-07T19:31:48.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 26/136 2022-09-07T19:31:48.611 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 27/136 2022-09-07T19:31:48.626 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 28/136 2022-09-07T19:31:48.627 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14857.g15219419 29/136 2022-09-07T19:31:48.627 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 30/136 2022-09-07T19:31:48.628 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 31/136 2022-09-07T19:31:48.628 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 32/136 2022-09-07T19:31:48.629 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14857.g15219419.e 33/136 2022-09-07T19:31:48.629 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 34/136 2022-09-07T19:31:48.629 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14857.g15219419. 35/136 2022-09-07T19:31:48.630 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 36/136 2022-09-07T19:31:48.630 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.0.0-14857.g15219419.el8.noarch 37/136 2022-09-07T19:31:48.630 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 38/136 2022-09-07T19:31:48.630 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/136 2022-09-07T19:31:48.630 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/136 2022-09-07T19:31:48.631 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/136 2022-09-07T19:31:48.631 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/136 2022-09-07T19:31:48.631 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/136 2022-09-07T19:31:48.631 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/136 2022-09-07T19:31:48.632 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/136 2022-09-07T19:31:48.632 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/136 2022-09-07T19:31:48.632 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/136 2022-09-07T19:31:48.632 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/136 2022-09-07T19:31:48.633 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/136 2022-09-07T19:31:48.633 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/136 2022-09-07T19:31:48.633 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2022-09-07T19:31:48.634 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/136 2022-09-07T19:31:48.634 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/136 2022-09-07T19:31:48.635 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/136 2022-09-07T19:31:48.635 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/136 2022-09-07T19:31:48.635 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/136 2022-09-07T19:31:48.636 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/136 2022-09-07T19:31:48.636 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/136 2022-09-07T19:31:48.636 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/136 2022-09-07T19:31:48.637 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/136 2022-09-07T19:31:48.637 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/136 2022-09-07T19:31:48.638 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/136 2022-09-07T19:31:48.638 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/136 2022-09-07T19:31:48.638 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/136 2022-09-07T19:31:48.639 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/136 2022-09-07T19:31:48.639 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/136 2022-09-07T19:31:48.640 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/136 2022-09-07T19:31:48.640 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/136 2022-09-07T19:31:48.640 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/136 2022-09-07T19:31:48.641 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/136 2022-09-07T19:31:48.641 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/136 2022-09-07T19:31:48.641 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 72/136 2022-09-07T19:31:48.642 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.0.4-10.el8.x86_64 73/136 2022-09-07T19:31:48.642 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 74/136 2022-09-07T19:31:48.642 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 75/136 2022-09-07T19:31:48.642 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 76/136 2022-09-07T19:31:48.643 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/136 2022-09-07T19:31:48.643 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 78/136 2022-09-07T19:31:48.643 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 79/136 2022-09-07T19:31:48.643 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 80/136 2022-09-07T19:31:48.644 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 81/136 2022-09-07T19:31:48.644 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 82/136 2022-09-07T19:31:48.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 83/136 2022-09-07T19:31:48.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 84/136 2022-09-07T19:31:48.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 85/136 2022-09-07T19:31:48.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/136 2022-09-07T19:31:48.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 87/136 2022-09-07T19:31:48.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/136 2022-09-07T19:31:48.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.1-9.el8.x86_64 89/136 2022-09-07T19:31:48.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 90/136 2022-09-07T19:31:48.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.6-3.el8.x86_64 91/136 2022-09-07T19:31:48.648 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 92/136 2022-09-07T19:31:48.648 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.1-7.el8.noarch 93/136 2022-09-07T19:31:48.648 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 94/136 2022-09-07T19:31:48.648 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 95/136 2022-09-07T19:31:48.649 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 96/136 2022-09-07T19:31:48.649 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpq-13.5-1.el8.x86_64 97/136 2022-09-07T19:31:48.649 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/136 2022-09-07T19:31:48.649 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/136 2022-09-07T19:31:48.650 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/136 2022-09-07T19:31:48.650 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 101/136 2022-09-07T19:31:48.650 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/136 2022-09-07T19:31:48.651 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 103/136 2022-09-07T19:31:48.651 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 104/136 2022-09-07T19:31:48.651 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 105/136 2022-09-07T19:31:48.651 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/136 2022-09-07T19:31:48.652 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/136 2022-09-07T19:31:48.652 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 108/136 2022-09-07T19:31:48.652 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 109/136 2022-09-07T19:31:48.652 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 110/136 2022-09-07T19:31:48.652 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 111/136 2022-09-07T19:31:48.653 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 112/136 2022-09-07T19:31:48.653 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 113/136 2022-09-07T19:31:48.653 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 114/136 2022-09-07T19:31:48.653 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 115/136 2022-09-07T19:31:48.654 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/136 2022-09-07T19:31:48.654 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 117/136 2022-09-07T19:31:48.654 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/136 2022-09-07T19:31:48.654 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 119/136 2022-09-07T19:31:48.655 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 120/136 2022-09-07T19:31:48.655 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 121/136 2022-09-07T19:31:48.655 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 122/136 2022-09-07T19:31:48.655 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 123/136 2022-09-07T19:31:48.655 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 124/136 2022-09-07T19:31:48.656 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/136 2022-09-07T19:31:48.656 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 126/136 2022-09-07T19:31:48.656 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 127/136 2022-09-07T19:31:48.656 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 128/136 2022-09-07T19:31:48.657 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.0.0-14857.g15219419.el8.x86_64 129/136 2022-09-07T19:31:48.657 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/136 2022-09-07T19:31:48.657 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.0.0-14857.g15219419.el8.x86_64 131/136 2022-09-07T19:31:48.657 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/136 2022-09-07T19:31:48.658 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/136 2022-09-07T19:31:48.658 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/136 2022-09-07T19:31:48.658 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/136 2022-09-07T19:31:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 114/136 2022-09-07T19:31:49.096 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 114/136 2022-09-07T19:31:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 115/136 2022-09-07T19:31:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 98/136 2022-09-07T19:31:49.830 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 99/136 2022-09-07T19:31:50.137 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 99/136 2022-09-07T19:31:50.311 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 100/136 2022-09-07T19:31:50.489 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:31:50.489 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2022-09-07T19:31:50.715 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:31:50.716 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2022-09-07T19:31:50.716 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.716 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.717 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:31:50.717 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:31:50.717 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2022-09-07T19:31:50.717 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-09-07T19:31:50.717 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.1-7.el8.noarch 2022-09-07T19:31:50.718 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.0.4-10.el8.x86_64 2022-09-07T19:31:50.718 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.718 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.718 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.719 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.719 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.719 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.719 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.720 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.720 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.720 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.720 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.720 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.721 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.721 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.721 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.721 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.722 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.722 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.722 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.722 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.723 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.723 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.723 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:31:50.723 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-09-07T19:31:50.724 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.1-9.el8.x86_64 2022-09-07T19:31:50.724 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.7-15.el8.x86_64 2022-09-07T19:31:50.724 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-07T19:31:50.724 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.6-3.el8.x86_64 2022-09-07T19:31:50.725 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-07T19:31:50.725 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-09-07T19:31:50.725 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-07T19:31:50.725 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.725 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.726 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.726 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-09-07T19:31:50.726 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-09-07T19:31:50.726 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-07T19:31:50.727 INFO:teuthology.orchestra.run.smithi155.stdout: libpq-13.5-1.el8.x86_64 2022-09-07T19:31:50.727 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-09-07T19:31:50.727 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-07T19:31:50.727 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.728 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.728 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-07T19:31:50.728 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.728 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-07T19:31:50.728 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-07T19:31:50.729 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-07T19:31:50.729 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-07T19:31:50.729 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-09-07T19:31:50.729 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-07T19:31:50.730 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-07T19:31:50.730 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-07T19:31:50.730 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.15-3.el8.x86_64 2022-09-07T19:31:50.730 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-09-07T19:31:50.730 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:31:50.731 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-07T19:31:50.731 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-07T19:31:50.731 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-07T19:31:50.731 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:31:50.732 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:31:50.732 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:31:50.732 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-07T19:31:50.732 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-07T19:31:50.732 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-07T19:31:50.733 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-07T19:31:50.733 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-07T19:31:50.733 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.733 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.734 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.734 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-07T19:31:50.734 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-07T19:31:50.734 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-07T19:31:50.735 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-07T19:31:50.735 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-07T19:31:50.735 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-07T19:31:50.735 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-07T19:31:50.735 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-07T19:31:50.736 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-07T19:31:50.736 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-07T19:31:50.736 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-07T19:31:50.736 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-07T19:31:50.736 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-07T19:31:50.737 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-07T19:31:50.737 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-07T19:31:50.737 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-07T19:31:50.737 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-07T19:31:50.738 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-07T19:31:50.738 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-07T19:31:50.738 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-07T19:31:50.738 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-07T19:31:50.738 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-07T19:31:50.739 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2022-09-07T19:31:50.739 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-07T19:31:50.739 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-07T19:31:50.739 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-07T19:31:50.740 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-07T19:31:50.740 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-07T19:31:50.740 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-07T19:31:50.740 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.740 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-07T19:31:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-07T19:31:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-07T19:31:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-07T19:31:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-09-07T19:31:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-07T19:31:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-07T19:31:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-07T19:31:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-07T19:31:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-07T19:31:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-07T19:31:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-07T19:31:50.744 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-07T19:31:50.744 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-07T19:31:50.744 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-07T19:31:50.744 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.744 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.745 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:31:50.745 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-07T19:31:50.745 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-07T19:31:50.745 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-07T19:31:50.746 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-07T19:31:50.746 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-07T19:31:50.746 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-09-07T19:31:50.747 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:31:50.747 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2022-09-07T19:31:50.807 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 100/136 2022-09-07T19:31:50.948 DEBUG:teuthology.parallel:result is None 2022-09-07T19:31:50.961 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 101/136 2022-09-07T19:31:51.033 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 101/136 2022-09-07T19:31:53.998 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:17.0.0-14857.g15219419.el8.noarch 102/136 2022-09-07T19:31:54.183 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:17.0.0-14857.g15219419.el8.noarch 102/136 2022-09-07T19:31:54.319 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14857.g15219419. 103/136 2022-09-07T19:31:54.339 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 115/136 2022-09-07T19:31:54.482 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14857.g15219419 104/136 2022-09-07T19:31:54.651 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 105/136 2022-09-07T19:31:54.695 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 116/136 2022-09-07T19:31:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 105/136 2022-09-07T19:31:55.153 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 106/136 2022-09-07T19:31:55.576 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 117/136 2022-09-07T19:31:55.858 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/136 2022-09-07T19:31:56.074 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 119/136 2022-09-07T19:31:56.272 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/136 2022-09-07T19:31:56.380 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 106/136 2022-09-07T19:31:56.460 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/136 2022-09-07T19:31:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 107/136 2022-09-07T19:31:56.718 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 121/136 2022-09-07T19:31:56.730 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 107/136 2022-09-07T19:31:56.892 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86 122/136 2022-09-07T19:31:57.064 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/136 2022-09-07T19:31:57.125 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14857.g15219419.e 108/136 2022-09-07T19:31:57.314 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 109/136 2022-09-07T19:31:57.411 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 109/136 2022-09-07T19:31:57.576 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 110/136 2022-09-07T19:31:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 110/136 2022-09-07T19:31:59.257 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:31:59.477 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:17.0.0-14857.g15219419.el8.x86_64 111/136 2022-09-07T19:31:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:31:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:31:59.668 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 112/136 2022-09-07T19:31:59.760 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 112/136 2022-09-07T19:31:59.839 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 125/136 2022-09-07T19:31:59.909 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14857.g1521 113/136 2022-09-07T19:32:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14857.g1521 113/136 2022-09-07T19:32:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 126/136 2022-09-07T19:32:00.176 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 114/136 2022-09-07T19:32:00.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 127/136 2022-09-07T19:32:00.636 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 114/136 2022-09-07T19:32:00.781 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/136 2022-09-07T19:32:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 115/136 2022-09-07T19:32:01.029 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.1-9.el8.x86_64 129/136 2022-09-07T19:32:01.104 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 129/136 2022-09-07T19:32:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.0.4-10.el8.x86_64 130/136 2022-09-07T19:32:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 130/136 2022-09-07T19:32:01.563 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 131/136 2022-09-07T19:32:01.571 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 131/136 2022-09-07T19:32:01.734 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/136 2022-09-07T19:32:01.948 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 133/136 2022-09-07T19:32:01.948 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 134/136 2022-09-07T19:32:02.191 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 134/136 2022-09-07T19:32:02.192 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 135/136 2022-09-07T19:32:02.441 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 135/136 2022-09-07T19:32:02.442 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:32:03.338 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:32:03.338 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:17.0.0-14857.g15219419.el8.x86_64 1/136 2022-09-07T19:32:03.338 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 2/136 2022-09-07T19:32:03.339 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 3/136 2022-09-07T19:32:03.339 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 4/136 2022-09-07T19:32:03.339 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14857.g1521 5/136 2022-09-07T19:32:03.339 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 6/136 2022-09-07T19:32:03.340 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:32:03.340 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:32:03.340 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:32:03.340 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 10/136 2022-09-07T19:32:03.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 11/136 2022-09-07T19:32:03.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 12/136 2022-09-07T19:32:03.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 13/136 2022-09-07T19:32:03.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86 14/136 2022-09-07T19:32:03.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 15/136 2022-09-07T19:32:03.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 16/136 2022-09-07T19:32:03.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:17.0.0-14857.g15219419.el8.x86_ 17/136 2022-09-07T19:32:03.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 18/136 2022-09-07T19:32:03.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:17.0.0-14857.g15219419.el8.x86_64 19/136 2022-09-07T19:32:03.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14857.g15219419.e 20/136 2022-09-07T19:32:03.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:17.0.0-14857.g15219419.el8 21/136 2022-09-07T19:32:03.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_ 22/136 2022-09-07T19:32:03.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:17.0.0-14857.g15219419.el8.x86_6 23/136 2022-09-07T19:32:03.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 24/136 2022-09-07T19:32:03.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 25/136 2022-09-07T19:32:03.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 26/136 2022-09-07T19:32:03.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 27/136 2022-09-07T19:32:03.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 28/136 2022-09-07T19:32:03.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14857.g15219419 29/136 2022-09-07T19:32:03.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 30/136 2022-09-07T19:32:03.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 31/136 2022-09-07T19:32:03.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 32/136 2022-09-07T19:32:03.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14857.g15219419.e 33/136 2022-09-07T19:32:03.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 34/136 2022-09-07T19:32:03.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14857.g15219419. 35/136 2022-09-07T19:32:03.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 36/136 2022-09-07T19:32:03.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:17.0.0-14857.g15219419.el8.noarch 37/136 2022-09-07T19:32:03.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 38/136 2022-09-07T19:32:03.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/136 2022-09-07T19:32:03.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/136 2022-09-07T19:32:03.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/136 2022-09-07T19:32:03.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/136 2022-09-07T19:32:03.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/136 2022-09-07T19:32:03.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/136 2022-09-07T19:32:03.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/136 2022-09-07T19:32:03.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/136 2022-09-07T19:32:03.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/136 2022-09-07T19:32:03.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/136 2022-09-07T19:32:03.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/136 2022-09-07T19:32:03.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/136 2022-09-07T19:32:03.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2022-09-07T19:32:03.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/136 2022-09-07T19:32:03.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/136 2022-09-07T19:32:03.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/136 2022-09-07T19:32:03.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/136 2022-09-07T19:32:03.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/136 2022-09-07T19:32:03.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/136 2022-09-07T19:32:03.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/136 2022-09-07T19:32:03.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/136 2022-09-07T19:32:03.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/136 2022-09-07T19:32:03.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/136 2022-09-07T19:32:03.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/136 2022-09-07T19:32:03.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/136 2022-09-07T19:32:03.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/136 2022-09-07T19:32:03.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/136 2022-09-07T19:32:03.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/136 2022-09-07T19:32:03.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/136 2022-09-07T19:32:03.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/136 2022-09-07T19:32:03.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/136 2022-09-07T19:32:03.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/136 2022-09-07T19:32:03.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/136 2022-09-07T19:32:03.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/136 2022-09-07T19:32:03.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 73/136 2022-09-07T19:32:03.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/136 2022-09-07T19:32:03.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/136 2022-09-07T19:32:03.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 76/136 2022-09-07T19:32:03.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 77/136 2022-09-07T19:32:03.373 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/136 2022-09-07T19:32:03.373 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 79/136 2022-09-07T19:32:03.374 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/136 2022-09-07T19:32:03.374 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 81/136 2022-09-07T19:32:03.374 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/136 2022-09-07T19:32:03.375 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 83/136 2022-09-07T19:32:03.375 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/136 2022-09-07T19:32:03.376 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/136 2022-09-07T19:32:03.376 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 86/136 2022-09-07T19:32:03.377 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/136 2022-09-07T19:32:03.377 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 88/136 2022-09-07T19:32:03.377 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 89/136 2022-09-07T19:32:03.378 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 90/136 2022-09-07T19:32:03.378 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 91/136 2022-09-07T19:32:03.378 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 92/136 2022-09-07T19:32:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 93/136 2022-09-07T19:32:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/136 2022-09-07T19:32:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 95/136 2022-09-07T19:32:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 96/136 2022-09-07T19:32:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 97/136 2022-09-07T19:32:03.380 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 98/136 2022-09-07T19:32:03.380 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/136 2022-09-07T19:32:03.380 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 100/136 2022-09-07T19:32:03.380 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 101/136 2022-09-07T19:32:03.381 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 102/136 2022-09-07T19:32:03.381 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 103/136 2022-09-07T19:32:03.381 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 104/136 2022-09-07T19:32:03.381 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 105/136 2022-09-07T19:32:03.381 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 106/136 2022-09-07T19:32:03.382 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 107/136 2022-09-07T19:32:03.382 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/136 2022-09-07T19:32:03.382 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 109/136 2022-09-07T19:32:03.383 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 110/136 2022-09-07T19:32:03.383 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 111/136 2022-09-07T19:32:03.383 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/136 2022-09-07T19:32:03.383 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/136 2022-09-07T19:32:03.384 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 114/136 2022-09-07T19:32:03.384 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.1-9.el8.x86_64 115/136 2022-09-07T19:32:03.384 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 116/136 2022-09-07T19:32:03.384 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.6-3.el8.x86_64 117/136 2022-09-07T19:32:03.384 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 118/136 2022-09-07T19:32:03.385 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.1-7.el8.noarch 119/136 2022-09-07T19:32:03.385 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 120/136 2022-09-07T19:32:03.385 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 121/136 2022-09-07T19:32:03.385 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 122/136 2022-09-07T19:32:03.386 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpq-13.5-1.el8.x86_64 123/136 2022-09-07T19:32:03.386 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 124/136 2022-09-07T19:32:03.386 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 125/136 2022-09-07T19:32:03.386 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 126/136 2022-09-07T19:32:03.387 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 127/136 2022-09-07T19:32:03.387 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 128/136 2022-09-07T19:32:03.387 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:17.0.0-14857.g15219419.el8.x86_64 129/136 2022-09-07T19:32:03.387 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/136 2022-09-07T19:32:03.387 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:17.0.0-14857.g15219419.el8.x86_64 131/136 2022-09-07T19:32:03.388 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/136 2022-09-07T19:32:03.388 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/136 2022-09-07T19:32:03.388 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/136 2022-09-07T19:32:03.388 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/136 2022-09-07T19:32:05.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:32:05.460 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2022-09-07T19:32:05.686 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:32:05.687 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2022-09-07T19:32:05.687 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.687 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.688 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:32:05.688 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:32:05.688 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2022-09-07T19:32:05.688 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-09-07T19:32:05.689 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.1-7.el8.noarch 2022-09-07T19:32:05.689 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.0.4-10.el8.x86_64 2022-09-07T19:32:05.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.691 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.691 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.691 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.691 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.691 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.692 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.692 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.692 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.692 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.693 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.693 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.693 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.694 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.694 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.695 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.695 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.695 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.695 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:05.696 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-09-07T19:32:05.696 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.1-9.el8.x86_64 2022-09-07T19:32:05.696 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.7-15.el8.x86_64 2022-09-07T19:32:05.697 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-07T19:32:05.697 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.6-3.el8.x86_64 2022-09-07T19:32:05.697 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-07T19:32:05.697 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-09-07T19:32:05.698 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-07T19:32:05.698 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.698 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.698 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.699 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-09-07T19:32:05.699 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-09-07T19:32:05.699 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-07T19:32:05.699 INFO:teuthology.orchestra.run.smithi154.stdout: libpq-13.5-1.el8.x86_64 2022-09-07T19:32:05.700 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-09-07T19:32:05.700 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-07T19:32:05.700 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.700 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.700 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-07T19:32:05.701 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.701 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-07T19:32:05.701 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-07T19:32:05.701 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-07T19:32:05.702 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-07T19:32:05.702 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-09-07T19:32:05.702 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-07T19:32:05.703 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-07T19:32:05.703 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-07T19:32:05.703 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.15-3.el8.x86_64 2022-09-07T19:32:05.703 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-09-07T19:32:05.704 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:32:05.704 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-07T19:32:05.704 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-07T19:32:05.704 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-07T19:32:05.704 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:32:05.705 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:32:05.705 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:32:05.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-07T19:32:05.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-07T19:32:05.706 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-07T19:32:05.706 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-07T19:32:05.706 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-07T19:32:05.706 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.707 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.707 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.707 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-07T19:32:05.708 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-07T19:32:05.708 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-07T19:32:05.708 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-07T19:32:05.709 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-07T19:32:05.709 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-07T19:32:05.709 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-07T19:32:05.709 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-07T19:32:05.710 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-07T19:32:05.710 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-07T19:32:05.710 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-07T19:32:05.710 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-07T19:32:05.711 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-07T19:32:05.711 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-07T19:32:05.711 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-07T19:32:05.711 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-07T19:32:05.712 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-07T19:32:05.712 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-07T19:32:05.712 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-07T19:32:05.712 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-07T19:32:05.713 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-07T19:32:05.713 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-07T19:32:05.713 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-2.6-1.el8.noarch 2022-09-07T19:32:05.714 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-07T19:32:05.714 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-07T19:32:05.714 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-07T19:32:05.714 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-07T19:32:05.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-07T19:32:05.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-07T19:32:05.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-07T19:32:05.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-07T19:32:05.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-07T19:32:05.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-07T19:32:05.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-09-07T19:32:05.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-07T19:32:05.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-07T19:32:05.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-07T19:32:05.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-07T19:32:05.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-07T19:32:05.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-07T19:32:05.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-07T19:32:05.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-07T19:32:05.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-07T19:32:05.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-07T19:32:05.720 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.720 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.720 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:05.720 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-07T19:32:05.721 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-07T19:32:05.721 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-07T19:32:05.721 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-07T19:32:05.721 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-07T19:32:05.722 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-09-07T19:32:05.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-09-07T19:32:05.723 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2022-09-07T19:32:05.898 DEBUG:teuthology.parallel:result is None 2022-09-07T19:32:06.664 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 115/136 2022-09-07T19:32:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 116/136 2022-09-07T19:32:08.319 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 117/136 2022-09-07T19:32:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/136 2022-09-07T19:32:08.846 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 119/136 2022-09-07T19:32:09.032 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/136 2022-09-07T19:32:09.324 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/136 2022-09-07T19:32:09.571 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 121/136 2022-09-07T19:32:09.770 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86 122/136 2022-09-07T19:32:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/136 2022-09-07T19:32:13.551 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:32:13.865 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:32:13.929 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/136 2022-09-07T19:32:14.107 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 125/136 2022-09-07T19:32:14.357 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 126/136 2022-09-07T19:32:14.702 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 127/136 2022-09-07T19:32:15.074 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/136 2022-09-07T19:32:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.1-9.el8.x86_64 129/136 2022-09-07T19:32:15.451 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 129/136 2022-09-07T19:32:15.705 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.0.4-10.el8.x86_64 130/136 2022-09-07T19:32:15.757 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 130/136 2022-09-07T19:32:15.922 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 131/136 2022-09-07T19:32:15.967 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 131/136 2022-09-07T19:32:16.102 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/136 2022-09-07T19:32:16.342 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 133/136 2022-09-07T19:32:16.343 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 134/136 2022-09-07T19:32:16.614 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 134/136 2022-09-07T19:32:16.614 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 135/136 2022-09-07T19:32:16.925 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 135/136 2022-09-07T19:32:16.925 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:32:17.663 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:32:17.664 INFO:teuthology.orchestra.run.smithi080.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-09-07T19:32:17.664 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:32:18.510 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:17.0.0-14857.g15219419.el8.x86_64 1/136 2022-09-07T19:32:18.510 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 2/136 2022-09-07T19:32:18.510 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 3/136 2022-09-07T19:32:18.511 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 4/136 2022-09-07T19:32:18.511 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14857.g1521 5/136 2022-09-07T19:32:18.511 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 6/136 2022-09-07T19:32:18.511 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 7/136 2022-09-07T19:32:18.512 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 8/136 2022-09-07T19:32:18.512 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 9/136 2022-09-07T19:32:18.512 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 10/136 2022-09-07T19:32:18.512 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 11/136 2022-09-07T19:32:18.512 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 12/136 2022-09-07T19:32:18.513 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_6 13/136 2022-09-07T19:32:18.513 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86 14/136 2022-09-07T19:32:18.513 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 15/136 2022-09-07T19:32:18.513 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_6 16/136 2022-09-07T19:32:18.514 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:17.0.0-14857.g15219419.el8.x86_ 17/136 2022-09-07T19:32:18.514 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:17.0.0-14857.g15219419.el8.x8 18/136 2022-09-07T19:32:18.514 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:17.0.0-14857.g15219419.el8.x86_64 19/136 2022-09-07T19:32:18.515 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14857.g15219419.e 20/136 2022-09-07T19:32:18.515 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:17.0.0-14857.g15219419.el8 21/136 2022-09-07T19:32:18.515 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_ 22/136 2022-09-07T19:32:18.516 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:17.0.0-14857.g15219419.el8.x86_6 23/136 2022-09-07T19:32:18.516 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 24/136 2022-09-07T19:32:18.516 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 25/136 2022-09-07T19:32:18.517 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 26/136 2022-09-07T19:32:18.517 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 27/136 2022-09-07T19:32:18.517 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 28/136 2022-09-07T19:32:18.517 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14857.g15219419 29/136 2022-09-07T19:32:18.518 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.no 30/136 2022-09-07T19:32:18.518 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8. 31/136 2022-09-07T19:32:18.518 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14857.g15 32/136 2022-09-07T19:32:18.518 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14857.g15219419.e 33/136 2022-09-07T19:32:18.519 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarc 34/136 2022-09-07T19:32:18.519 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14857.g15219419. 35/136 2022-09-07T19:32:18.519 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 36/136 2022-09-07T19:32:18.519 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:17.0.0-14857.g15219419.el8.noarch 37/136 2022-09-07T19:32:18.519 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 38/136 2022-09-07T19:32:18.520 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/136 2022-09-07T19:32:18.520 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/136 2022-09-07T19:32:18.520 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/136 2022-09-07T19:32:18.520 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/136 2022-09-07T19:32:18.521 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/136 2022-09-07T19:32:18.521 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/136 2022-09-07T19:32:18.521 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/136 2022-09-07T19:32:18.521 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/136 2022-09-07T19:32:18.521 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/136 2022-09-07T19:32:18.522 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/136 2022-09-07T19:32:18.522 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/136 2022-09-07T19:32:18.522 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/136 2022-09-07T19:32:18.522 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2022-09-07T19:32:18.523 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/136 2022-09-07T19:32:18.523 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/136 2022-09-07T19:32:18.523 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/136 2022-09-07T19:32:18.523 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/136 2022-09-07T19:32:18.524 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/136 2022-09-07T19:32:18.524 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/136 2022-09-07T19:32:18.524 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/136 2022-09-07T19:32:18.524 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/136 2022-09-07T19:32:18.524 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/136 2022-09-07T19:32:18.525 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/136 2022-09-07T19:32:18.525 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/136 2022-09-07T19:32:18.525 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/136 2022-09-07T19:32:18.525 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/136 2022-09-07T19:32:18.526 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/136 2022-09-07T19:32:18.526 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/136 2022-09-07T19:32:18.526 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/136 2022-09-07T19:32:18.526 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/136 2022-09-07T19:32:18.527 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/136 2022-09-07T19:32:18.527 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/136 2022-09-07T19:32:18.527 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/136 2022-09-07T19:32:18.527 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/136 2022-09-07T19:32:18.527 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 73/136 2022-09-07T19:32:18.528 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/136 2022-09-07T19:32:18.528 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/136 2022-09-07T19:32:18.528 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 76/136 2022-09-07T19:32:18.528 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 77/136 2022-09-07T19:32:18.529 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/136 2022-09-07T19:32:18.529 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 79/136 2022-09-07T19:32:18.529 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/136 2022-09-07T19:32:18.529 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 81/136 2022-09-07T19:32:18.529 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/136 2022-09-07T19:32:18.530 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 83/136 2022-09-07T19:32:18.530 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/136 2022-09-07T19:32:18.530 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/136 2022-09-07T19:32:18.530 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 86/136 2022-09-07T19:32:18.531 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/136 2022-09-07T19:32:18.531 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 88/136 2022-09-07T19:32:18.531 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 89/136 2022-09-07T19:32:18.531 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 90/136 2022-09-07T19:32:18.531 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 91/136 2022-09-07T19:32:18.532 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 92/136 2022-09-07T19:32:18.532 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 93/136 2022-09-07T19:32:18.532 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/136 2022-09-07T19:32:18.532 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 95/136 2022-09-07T19:32:18.533 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 96/136 2022-09-07T19:32:18.533 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 97/136 2022-09-07T19:32:18.533 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 98/136 2022-09-07T19:32:18.533 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/136 2022-09-07T19:32:18.533 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 100/136 2022-09-07T19:32:18.534 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 101/136 2022-09-07T19:32:18.534 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 102/136 2022-09-07T19:32:18.534 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 103/136 2022-09-07T19:32:18.534 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 104/136 2022-09-07T19:32:18.535 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 105/136 2022-09-07T19:32:18.535 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 106/136 2022-09-07T19:32:18.535 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 107/136 2022-09-07T19:32:18.535 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/136 2022-09-07T19:32:18.536 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 109/136 2022-09-07T19:32:18.536 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 110/136 2022-09-07T19:32:18.536 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 111/136 2022-09-07T19:32:18.536 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/136 2022-09-07T19:32:18.536 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/136 2022-09-07T19:32:18.537 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 114/136 2022-09-07T19:32:18.537 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.1-9.el8.x86_64 115/136 2022-09-07T19:32:18.537 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 116/136 2022-09-07T19:32:18.537 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : jq-1.6-3.el8.x86_64 117/136 2022-09-07T19:32:18.538 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 118/136 2022-09-07T19:32:18.538 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.1-7.el8.noarch 119/136 2022-09-07T19:32:18.538 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 120/136 2022-09-07T19:32:18.538 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 121/136 2022-09-07T19:32:18.538 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 122/136 2022-09-07T19:32:18.539 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpq-13.5-1.el8.x86_64 123/136 2022-09-07T19:32:18.539 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 124/136 2022-09-07T19:32:18.539 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 125/136 2022-09-07T19:32:18.539 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 126/136 2022-09-07T19:32:18.540 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 127/136 2022-09-07T19:32:18.540 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 128/136 2022-09-07T19:32:18.540 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:17.0.0-14857.g15219419.el8.x86_64 129/136 2022-09-07T19:32:18.540 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/136 2022-09-07T19:32:18.540 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:17.0.0-14857.g15219419.el8.x86_64 131/136 2022-09-07T19:32:18.541 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/136 2022-09-07T19:32:18.541 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/136 2022-09-07T19:32:18.541 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/136 2022-09-07T19:32:18.541 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/136 2022-09-07T19:32:21.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/136 2022-09-07T19:32:21.275 INFO:teuthology.orchestra.run.smithi080.stdout:Installed products updated. 2022-09-07T19:32:21.510 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:32:21.511 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2022-09-07T19:32:21.511 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.511 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.511 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:32:21.512 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:32:21.512 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2022-09-07T19:32:21.512 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-09-07T19:32:21.512 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.1-7.el8.noarch 2022-09-07T19:32:21.513 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.0.4-10.el8.x86_64 2022-09-07T19:32:21.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.517 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.517 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.517 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.517 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.518 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.518 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.518 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:17.0.0-14857.g15219419.el8.noarch 2022-09-07T19:32:21.518 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-09-07T19:32:21.519 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.1-9.el8.x86_64 2022-09-07T19:32:21.519 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.7-15.el8.x86_64 2022-09-07T19:32:21.519 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-07T19:32:21.519 INFO:teuthology.orchestra.run.smithi080.stdout: jq-1.6-3.el8.x86_64 2022-09-07T19:32:21.519 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-07T19:32:21.520 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-09-07T19:32:21.520 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-07T19:32:21.520 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.520 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.521 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.521 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-09-07T19:32:21.521 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-09-07T19:32:21.521 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-07T19:32:21.521 INFO:teuthology.orchestra.run.smithi080.stdout: libpq-13.5-1.el8.x86_64 2022-09-07T19:32:21.522 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-09-07T19:32:21.522 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-07T19:32:21.522 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.522 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.523 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-07T19:32:21.523 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.523 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-07T19:32:21.523 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-07T19:32:21.524 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-07T19:32:21.524 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-07T19:32:21.524 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-09-07T19:32:21.524 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-07T19:32:21.524 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-07T19:32:21.525 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-07T19:32:21.525 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.15-3.el8.x86_64 2022-09-07T19:32:21.525 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-09-07T19:32:21.525 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-09-07T19:32:21.526 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-07T19:32:21.526 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-07T19:32:21.526 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-07T19:32:21.526 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:32:21.527 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:32:21.527 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-07T19:32:21.527 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-07T19:32:21.527 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-07T19:32:21.528 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-07T19:32:21.528 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-07T19:32:21.528 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-07T19:32:21.528 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.529 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.529 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.529 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-07T19:32:21.529 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-07T19:32:21.530 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-07T19:32:21.530 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-07T19:32:21.530 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-07T19:32:21.530 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-07T19:32:21.531 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-07T19:32:21.531 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-07T19:32:21.531 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-07T19:32:21.531 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-07T19:32:21.532 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-07T19:32:21.532 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-07T19:32:21.532 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-07T19:32:21.532 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-07T19:32:21.533 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-07T19:32:21.533 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-07T19:32:21.533 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-07T19:32:21.533 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-07T19:32:21.534 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-07T19:32:21.534 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-07T19:32:21.534 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-07T19:32:21.535 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-07T19:32:21.535 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-2.6-1.el8.noarch 2022-09-07T19:32:21.535 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-07T19:32:21.535 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-07T19:32:21.536 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-07T19:32:21.536 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-07T19:32:21.536 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-07T19:32:21.536 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-07T19:32:21.537 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.537 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.537 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-07T19:32:21.537 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-07T19:32:21.538 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.538 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-07T19:32:21.538 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-07T19:32:21.538 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-09-07T19:32:21.539 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-07T19:32:21.539 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-07T19:32:21.539 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-07T19:32:21.539 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-07T19:32:21.539 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-07T19:32:21.540 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-07T19:32:21.540 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-07T19:32:21.540 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-07T19:32:21.540 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-07T19:32:21.541 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-07T19:32:21.541 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.541 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.541 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:17.0.0-14857.g15219419.el8.x86_64 2022-09-07T19:32:21.541 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-07T19:32:21.542 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-07T19:32:21.542 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-07T19:32:21.542 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-07T19:32:21.542 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-07T19:32:21.543 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-09-07T19:32:21.543 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:32:21.544 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2022-09-07T19:32:21.898 DEBUG:teuthology.parallel:result is None 2022-09-07T19:32:21.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2022-09-07T19:32:22.074 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterprise 2022-09-07T19:32:22.079 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:32:22.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:32:22.240 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-07T19:32:22.313 INFO:teuthology.orchestra.run.smithi080.stdout:17.0.0-14857.g15219419.el8 2022-09-07T19:32:22.314 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14857.g15219419.el8 2022-09-07T19:32:22.315 INFO:teuthology.task.install:The correct ceph version 17.0.0-14857.g15219419 is installed. 2022-09-07T19:32:22.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo lsb_release -is 2022-09-07T19:32:22.378 INFO:teuthology.orchestra.run.smithi154.stdout:RedHatEnterprise 2022-09-07T19:32:22.379 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:32:22.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:32:22.536 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-07T19:32:22.560 INFO:teuthology.orchestra.run.smithi154.stdout:17.0.0-14857.g15219419.el8 2022-09-07T19:32:22.560 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14857.g15219419.el8 2022-09-07T19:32:22.561 INFO:teuthology.task.install:The correct ceph version 17.0.0-14857.g15219419 is installed. 2022-09-07T19:32:22.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2022-09-07T19:32:22.627 INFO:teuthology.orchestra.run.smithi155.stdout:RedHatEnterprise 2022-09-07T19:32:22.629 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-07T19:32:22.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:32:22.787 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-07T19:32:22.812 INFO:teuthology.orchestra.run.smithi155.stdout:17.0.0-14857.g15219419.el8 2022-09-07T19:32:22.813 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14857.g15219419.el8 2022-09-07T19:32:22.813 INFO:teuthology.task.install:The correct ceph version 17.0.0-14857.g15219419 is installed. 2022-09-07T19:32:22.814 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-09-07T19:32:22.814 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:32:22.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-07T19:32:22.906 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:32:22.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-07T19:32:22.940 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:32:22.940 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-07T19:32:22.973 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-09-07T19:32:22.974 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:32:22.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2022-09-07T19:32:23.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-07T19:32:23.198 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:32:23.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2022-09-07T19:32:23.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-07T19:32:23.301 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:32:23.301 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2022-09-07T19:32:23.334 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-07T19:32:23.404 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-09-07T19:32:23.405 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:32:23.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-07T19:32:23.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-07T19:32:23.628 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:32:23.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-07T19:32:23.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-07T19:32:23.731 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:32:23.732 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-07T19:32:23.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-07T19:32:23.834 INFO:teuthology.run_tasks:Running task cephadm... 2022-09-07T19:32:23.921 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '152194198413033811b31149de909a7ec5852a7f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2022-09-07T19:32:23.922 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:32:23.923 INFO:tasks.cephadm:Cluster fsid is cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:32:23.923 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2022-09-07T19:32:23.924 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.80', 'mon.b': '172.21.15.154', 'mon.c': '172.21.15.155'} 2022-09-07T19:32:23.924 INFO:tasks.cephadm:First mon is mon.a on smithi080 2022-09-07T19:32:23.924 INFO:tasks.cephadm:First mgr is x 2022-09-07T19:32:23.925 INFO:tasks.cephadm:Normalizing hostnames... 2022-09-07T19:32:23.925 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2022-09-07T19:32:24.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2022-09-07T19:32:24.052 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2022-09-07T19:32:24.084 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 152194198413033811b31149de909a7ec5852a7f)... 2022-09-07T19:32:24.085 DEBUG:teuthology.orchestra.run.smithi080:> git archive --remote=git://git.ceph.com/ceph-ci.git 152194198413033811b31149de909a7ec5852a7f src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2022-09-07T19:32:24.199 DEBUG:teuthology.orchestra.run.smithi154:> git archive --remote=git://git.ceph.com/ceph-ci.git 152194198413033811b31149de909a7ec5852a7f src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2022-09-07T19:32:24.263 DEBUG:teuthology.orchestra.run.smithi155:> git archive --remote=git://git.ceph.com/ceph-ci.git 152194198413033811b31149de909a7ec5852a7f src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2022-09-07T19:32:24.330 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-09-07T19:32:24.394 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-09-07T19:32:24.416 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-09-07T19:32:24.454 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f on all hosts... 2022-09-07T19:32:24.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f pull 2022-09-07T19:32:24.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f pull 2022-09-07T19:32:24.464 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f pull 2022-09-07T19:32:25.439 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f... 2022-09-07T19:32:27.998 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f... 2022-09-07T19:32:30.378 INFO:teuthology.orchestra.run.smithi080.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f... 2022-09-07T19:32:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2022-09-07T19:32:56.084 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev)", 2022-09-07T19:32:56.084 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "6405dbf5acb7a3494d2b44504da4bc6ac177ba034fa1511424e72538f0aa6923", 2022-09-07T19:32:56.085 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2022-09-07T19:32:56.085 INFO:teuthology.orchestra.run.smithi154.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:890f81b462827c9c5f6424b47803267c6c59d344d092a29bdfcf3547a2647a6f" 2022-09-07T19:32:56.085 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2022-09-07T19:32:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:} 2022-09-07T19:33:15.203 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2022-09-07T19:33:15.205 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev)", 2022-09-07T19:33:15.205 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "6405dbf5acb7a3494d2b44504da4bc6ac177ba034fa1511424e72538f0aa6923", 2022-09-07T19:33:15.205 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2022-09-07T19:33:15.206 INFO:teuthology.orchestra.run.smithi155.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:890f81b462827c9c5f6424b47803267c6c59d344d092a29bdfcf3547a2647a6f" 2022-09-07T19:33:15.206 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2022-09-07T19:33:15.206 INFO:teuthology.orchestra.run.smithi155.stdout:} 2022-09-07T19:33:28.529 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:33:28.530 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev)", 2022-09-07T19:33:28.530 INFO:teuthology.orchestra.run.smithi080.stdout: "image_id": "6405dbf5acb7a3494d2b44504da4bc6ac177ba034fa1511424e72538f0aa6923", 2022-09-07T19:33:28.530 INFO:teuthology.orchestra.run.smithi080.stdout: "repo_digests": [ 2022-09-07T19:33:28.530 INFO:teuthology.orchestra.run.smithi080.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:890f81b462827c9c5f6424b47803267c6c59d344d092a29bdfcf3547a2647a6f" 2022-09-07T19:33:28.531 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2022-09-07T19:33:28.531 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:33:28.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2022-09-07T19:33:28.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2022-09-07T19:33:28.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2022-09-07T19:33:28.747 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2022-09-07T19:33:28.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2022-09-07T19:33:28.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2022-09-07T19:33:28.914 INFO:tasks.cephadm:Writing seed config... 2022-09-07T19:33:28.917 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2022-09-07T19:33:28.917 INFO:tasks.cephadm: override: [client] debug client = 20 2022-09-07T19:33:28.918 INFO:tasks.cephadm: override: [client] debug ms = 1 2022-09-07T19:33:28.918 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2022-09-07T19:33:28.919 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2022-09-07T19:33:28.919 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2022-09-07T19:33:28.920 INFO:tasks.cephadm: override: [mds] debug mds = 20 2022-09-07T19:33:28.920 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2022-09-07T19:33:28.920 INFO:tasks.cephadm: override: [mds] debug ms = 1 2022-09-07T19:33:28.921 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2022-09-07T19:33:28.921 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2022-09-07T19:33:28.922 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2022-09-07T19:33:28.922 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2022-09-07T19:33:28.922 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2022-09-07T19:33:28.923 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2022-09-07T19:33:28.923 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2022-09-07T19:33:28.925 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2022-09-07T19:33:28.926 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2022-09-07T19:33:28.926 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2022-09-07T19:33:28.927 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2022-09-07T19:33:28.927 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2022-09-07T19:33:28.928 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2022-09-07T19:33:28.928 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2022-09-07T19:33:28.928 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2022-09-07T19:33:28.929 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2022-09-07T19:33:28.929 INFO:tasks.cephadm: override: [mon] debug mon = 20 2022-09-07T19:33:28.929 INFO:tasks.cephadm: override: [mon] debug ms = 1 2022-09-07T19:33:28.930 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2022-09-07T19:33:28.930 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2022-09-07T19:33:28.930 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2022-09-07T19:33:28.931 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2022-09-07T19:33:28.931 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2022-09-07T19:33:28.931 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2022-09-07T19:33:28.932 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2022-09-07T19:33:28.932 INFO:tasks.cephadm: override: [osd] debug ms = 1 2022-09-07T19:33:28.932 INFO:tasks.cephadm: override: [osd] debug osd = 20 2022-09-07T19:33:28.933 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2022-09-07T19:33:28.933 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2022-09-07T19:33:28.933 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2022-09-07T19:33:28.934 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2022-09-07T19:33:28.934 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2022-09-07T19:33:28.934 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2022-09-07T19:33:28.935 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2022-09-07T19:33:28.935 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2022-09-07T19:33:28.936 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2022-09-07T19:33:28.938 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:33:28.939 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2022-09-07T19:33:28.996 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = cc599a0c-2ee3-11ed-8431-001a4aab830c ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2022-09-07T19:33:28.997 DEBUG:teuthology.orchestra.run.smithi080:mon.a> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.a.service 2022-09-07T19:33:29.003 DEBUG:teuthology.orchestra.run.smithi080:mgr.x> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.x.service 2022-09-07T19:33:29.049 INFO:tasks.cephadm:Bootstrapping... 2022-09-07T19:33:29.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f -v bootstrap --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.80 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2022-09-07T19:33:29.087 INFO:journalctl@ceph.mon.a.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:33:29.134 INFO:journalctl@ceph.mgr.x.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:33:29.376 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2022-09-07T19:33:29.376 INFO:teuthology.orchestra.run.smithi080.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f', '-v', 'bootstrap', '--fsid', 'cc599a0c-2ee3-11ed-8431-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.80', '--skip-admin-label'] 2022-09-07T19:33:29.570 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.1.1 2022-09-07T19:33:29.571 INFO:teuthology.orchestra.run.smithi080.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2022-09-07T19:33:29.572 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying podman|docker is present... 2022-09-07T19:33:29.764 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.1.1 2022-09-07T19:33:29.765 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying lvm2 is present... 2022-09-07T19:33:29.765 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying time synchronization is in place... 2022-09-07T19:33:29.782 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2022-09-07T19:33:29.783 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2022-09-07T19:33:29.799 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2022-09-07T19:33:29.799 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2022-09-07T19:33:29.817 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout enabled 2022-09-07T19:33:29.834 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout active 2022-09-07T19:33:29.834 INFO:teuthology.orchestra.run.smithi080.stdout:Unit chronyd.service is enabled and running 2022-09-07T19:33:29.835 INFO:teuthology.orchestra.run.smithi080.stdout:Repeating the final host check... 2022-09-07T19:33:30.025 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.1.1 2022-09-07T19:33:30.025 INFO:teuthology.orchestra.run.smithi080.stdout:podman (/bin/podman) version 4.1.1 is present 2022-09-07T19:33:30.025 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl is present 2022-09-07T19:33:30.026 INFO:teuthology.orchestra.run.smithi080.stdout:lvcreate is present 2022-09-07T19:33:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2022-09-07T19:33:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2022-09-07T19:33:30.059 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2022-09-07T19:33:30.059 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2022-09-07T19:33:30.077 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout enabled 2022-09-07T19:33:30.094 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout active 2022-09-07T19:33:30.095 INFO:teuthology.orchestra.run.smithi080.stdout:Unit chronyd.service is enabled and running 2022-09-07T19:33:30.095 INFO:teuthology.orchestra.run.smithi080.stdout:Host looks OK 2022-09-07T19:33:30.095 INFO:teuthology.orchestra.run.smithi080.stdout:Cluster fsid: cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:30.095 INFO:teuthology.orchestra.run.smithi080.stdout:Acquiring lock 140250625613104 on /run/cephadm/cc599a0c-2ee3-11ed-8431-001a4aab830c.lock 2022-09-07T19:33:30.096 INFO:teuthology.orchestra.run.smithi080.stdout:Lock 140250625613104 acquired on /run/cephadm/cc599a0c-2ee3-11ed-8431-001a4aab830c.lock 2022-09-07T19:33:30.096 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying IP 172.21.15.80 port 3300 ... 2022-09-07T19:33:30.097 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying IP 172.21.15.80 port 6789 ... 2022-09-07T19:33:30.097 INFO:teuthology.orchestra.run.smithi080.stdout:Base mon IP(s) is [172.21.15.80:3300, 172.21.15.80:6789], mon addrv is [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2022-09-07T19:33:30.106 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2022-09-07T19:33:30.107 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.80 metric 100 2022-09-07T19:33:30.116 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2022-09-07T19:33:30.116 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2022-09-07T19:33:30.116 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1775sec hoplimit 64 pref medium 2022-09-07T19:33:30.126 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2022-09-07T19:33:30.127 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2022-09-07T19:33:30.127 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2022-09-07T19:33:30.128 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2022-09-07T19:33:30.128 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2022-09-07T19:33:30.128 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2022-09-07T19:33:30.129 INFO:teuthology.orchestra.run.smithi080.stdout:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2022-09-07T19:33:30.129 INFO:teuthology.orchestra.run.smithi080.stdout:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2022-09-07T19:33:30.129 INFO:teuthology.orchestra.run.smithi080.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2022-09-07T19:33:30.131 INFO:teuthology.orchestra.run.smithi080.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2022-09-07T19:33:30.131 INFO:teuthology.orchestra.run.smithi080.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f... 2022-09-07T19:33:30.724 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 6405dbf5acb7a3494d2b44504da4bc6ac177ba034fa1511424e72538f0aa6923 2022-09-07T19:33:30.725 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f... 2022-09-07T19:33:30.725 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Getting image source signatures 2022-09-07T19:33:30.725 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:df305547f7faebabb0d38c7e1906a4fd8264edcd18fcce61af66675bb804ad0f 2022-09-07T19:33:30.725 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:99a39ffc60545d3551e6b2d1fa8868206fd1c0517c86346f930cd3902f2e17c6 2022-09-07T19:33:30.726 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:bb868b3138d9139f452065e8d61f4c081341a6caa61b0ac6f12814f3a0dc362e 2022-09-07T19:33:30.726 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:5d1b43028e8e0373631944ff9016c99bdf03efc12705b9a423bc758fccf55806 2022-09-07T19:33:30.726 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:2252a7414fd07c781b1ed7bd7af688bb98409db8ecbad4aec3bacaa72fdc5aa7 2022-09-07T19:33:30.726 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying config sha256:6405dbf5acb7a3494d2b44504da4bc6ac177ba034fa1511424e72538f0aa6923 2022-09-07T19:33:30.727 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Writing manifest to image destination 2022-09-07T19:33:30.727 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Storing signatures 2022-09-07T19:33:31.619 INFO:teuthology.orchestra.run.smithi080.stdout:ceph: stdout ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev) 2022-09-07T19:33:31.620 INFO:teuthology.orchestra.run.smithi080.stdout:Ceph version: ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev) 2022-09-07T19:33:31.620 INFO:teuthology.orchestra.run.smithi080.stdout:Extracting ceph user uid/gid from container image... 2022-09-07T19:33:32.414 INFO:teuthology.orchestra.run.smithi080.stdout:stat: stdout 167 167 2022-09-07T19:33:32.415 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial keys... 2022-09-07T19:33:33.208 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQAM8hhjZ/BJMxAATVxJ0c2ZlQtFpSkQuywHsQ== 2022-09-07T19:33:34.006 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQAN8hhjlZNNJxAApxj9eQ33SSzzUGJOsyN5WA== 2022-09-07T19:33:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQAO8hhjUingGhAA/0oK9Y0oyNIxOH9m5Tp0mg== 2022-09-07T19:33:34.804 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial monmap... 2022-09-07T19:33:35.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2022-09-07T19:33:35.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2022-09-07T19:33:35.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:35.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-09-07T19:33:35.603 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool for a [v2:172.21.15.80:3300,v1:172.21.15.80:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2022-09-07T19:33:35.603 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = octopus 2022-09-07T19:33:35.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: set fsid to cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:35.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-09-07T19:33:35.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:33:35.604 INFO:teuthology.orchestra.run.smithi080.stdout:Creating mon... 2022-09-07T19:33:36.495 INFO:teuthology.orchestra.run.smithi080.stdout:create mon.a on 2022-09-07T19:33:36.791 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2022-09-07T19:33:37.050 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2022-09-07T19:33:37.331 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c.target → /etc/systemd/system/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c.target. 2022-09-07T19:33:37.332 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c.target → /etc/systemd/system/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c.target. 2022-09-07T19:33:37.721 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.a 2022-09-07T19:33:37.721 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.a.service: Unit ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.a.service not loaded. 2022-09-07T19:33:37.985 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c.target.wants/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@.service. 2022-09-07T19:33:38.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:38 smithi080 systemd[1]: Starting Ceph mon.a for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:33:38.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:38 smithi080 podman[89605]: 2022-09-07T19:33:38.903 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2022-09-07T19:33:38.904 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2022-09-07T19:33:38.925 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2022-09-07T19:33:38.925 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2022-09-07T19:33:38.925 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2022-09-07T19:33:38.925 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to enable service . firewalld.service is not available 2022-09-07T19:33:38.926 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mon to start... 2022-09-07T19:33:38.926 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mon... 2022-09-07T19:33:39.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:38 smithi080 bash[89605]: 58028e1773bf13e6be29bf719025d1975ef25c7b55ab06e139eeab66983db90f 2022-09-07T19:33:39.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:38 smithi080 systemd[1]: Started Ceph mon.a for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:33:39.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:38 smithi080 ceph-mon[89645]: mkfs cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:39.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:38 smithi080 ceph-mon[89645]: mon.a is new leader, mons a in quorum (ranks 0) 2022-09-07T19:33:39.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout cluster: 2022-09-07T19:33:39.936 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout id: cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:39.936 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2022-09-07T19:33:39.936 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:39.937 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout services: 2022-09-07T19:33:39.937 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.696875s) 2022-09-07T19:33:39.937 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2022-09-07T19:33:39.937 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2022-09-07T19:33:39.938 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:39.938 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout data: 2022-09-07T19:33:39.938 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2022-09-07T19:33:39.938 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2022-09-07T19:33:39.939 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2022-09-07T19:33:39.939 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout pgs: 2022-09-07T19:33:39.939 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:39.939 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.496+0000 7fba6f41d700 1 Processor -- start 2022-09-07T19:33:39.940 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.496+0000 7fba6f41d700 1 -- start start 2022-09-07T19:33:39.940 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.497+0000 7fba6f41d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68108520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:39.940 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.497+0000 7fba6f41d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68103f10 con 0x7fba68077c50 2022-09-07T19:33:39.940 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.497+0000 7fba6d1b9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:39.941 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.498+0000 7fba6d1b9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68108520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34628/0 (socket says 172.21.15.80:34628) 2022-09-07T19:33:39.941 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.498+0000 7fba6d1b9700 1 -- 172.21.15.80:0/1709270484 learned_addr learned my addr 172.21.15.80:0/1709270484 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:39.941 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.498+0000 7fba6d1b9700 1 -- 172.21.15.80:0/1709270484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68108a60 con 0x7fba68077c50 2022-09-07T19:33:39.941 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.498+0000 7fba6d1b9700 1 --2- 172.21.15.80:0/1709270484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68108520 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fba64009700 tx=0x7fba64009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3e5e1d8836834 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:39.942 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba5ffff700 1 -- 172.21.15.80:0/1709270484 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba64004160 con 0x7fba68077c50 2022-09-07T19:33:39.942 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba5ffff700 1 -- 172.21.15.80:0/1709270484 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba640042c0 con 0x7fba68077c50 2022-09-07T19:33:39.942 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba5ffff700 1 -- 172.21.15.80:0/1709270484 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba64011630 con 0x7fba68077c50 2022-09-07T19:33:39.943 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 -- 172.21.15.80:0/1709270484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 msgr2=0x7fba68108520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:39.943 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 --2- 172.21.15.80:0/1709270484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68108520 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fba64009700 tx=0x7fba64009a10 comp rx=0 tx=0).stop 2022-09-07T19:33:39.943 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 -- 172.21.15.80:0/1709270484 shutdown_connections 2022-09-07T19:33:39.943 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 --2- 172.21.15.80:0/1709270484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68108520 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:39.944 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 -- 172.21.15.80:0/1709270484 >> 172.21.15.80:0/1709270484 conn(0x7fba680fdaf0 msgr2=0x7fba680fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:39.944 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 -- 172.21.15.80:0/1709270484 shutdown_connections 2022-09-07T19:33:39.944 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.499+0000 7fba6f41d700 1 -- 172.21.15.80:0/1709270484 wait complete. 2022-09-07T19:33:39.944 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6f41d700 1 Processor -- start 2022-09-07T19:33:39.945 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6f41d700 1 -- start start 2022-09-07T19:33:39.945 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6f41d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:39.945 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6f41d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68199050 con 0x7fba68077c50 2022-09-07T19:33:39.945 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6d1b9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:39.945 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6d1b9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34634/0 (socket says 172.21.15.80:34634) 2022-09-07T19:33:39.946 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.501+0000 7fba6d1b9700 1 -- 172.21.15.80:0/483671663 learned_addr learned my addr 172.21.15.80:0/483671663 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:39.946 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.502+0000 7fba6d1b9700 1 -- 172.21.15.80:0/483671663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640093e0 con 0x7fba68077c50 2022-09-07T19:33:39.946 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.502+0000 7fba6d1b9700 1 --2- 172.21.15.80:0/483671663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68198b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fba64000c00 tx=0x7fba640045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:39.946 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.502+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba64003520 con 0x7fba68077c50 2022-09-07T19:33:39.947 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.502+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba64003680 con 0x7fba68077c50 2022-09-07T19:33:39.947 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.502+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba64003920 con 0x7fba68077c50 2022-09-07T19:33:39.947 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.502+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba68199250 con 0x7fba68077c50 2022-09-07T19:33:39.947 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.503+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba68199680 con 0x7fba68077c50 2022-09-07T19:33:39.948 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.503+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fba6402c020 con 0x7fba68077c50 2022-09-07T19:33:39.948 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.503+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fba6401cbf0 con 0x7fba68077c50 2022-09-07T19:33:39.948 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.504+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba68060310 con 0x7fba68077c50 2022-09-07T19:33:39.948 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.507+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fba6401c450 con 0x7fba68077c50 2022-09-07T19:33:39.949 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.578+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fba6805f990 con 0x7fba68077c50 2022-09-07T19:33:39.949 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.579+0000 7fba5e7fc700 1 -- 172.21.15.80:0/483671663 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fba6401cdb0 con 0x7fba68077c50 2022-09-07T19:33:39.949 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.579+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 msgr2=0x7fba68198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:39.949 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.579+0000 7fba6f41d700 1 --2- 172.21.15.80:0/483671663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68198b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fba64000c00 tx=0x7fba640045d0 comp rx=0 tx=0).stop 2022-09-07T19:33:39.950 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.580+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 shutdown_connections 2022-09-07T19:33:39.950 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.580+0000 7fba6f41d700 1 --2- 172.21.15.80:0/483671663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba68077c50 0x7fba68198b10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:39.950 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.580+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 >> 172.21.15.80:0/483671663 conn(0x7fba680fdaf0 msgr2=0x7fba680ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:39.950 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.580+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 shutdown_connections 2022-09-07T19:33:39.951 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:39.580+0000 7fba6f41d700 1 -- 172.21.15.80:0/483671663 wait complete. 2022-09-07T19:33:39.951 INFO:teuthology.orchestra.run.smithi080.stdout:mon is available 2022-09-07T19:33:39.951 INFO:teuthology.orchestra.run.smithi080.stdout:Assimilating anything we can from ceph.conf... 2022-09-07T19:33:40.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:39 smithi080 ceph-mon[89645]: mon.a is new leader, mons a in quorum (ranks 0) 2022-09-07T19:33:40.214 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:39 smithi080 ceph-mon[89645]: monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} 2022-09-07T19:33:40.214 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:39 smithi080 ceph-mon[89645]: fsmap 2022-09-07T19:33:40.214 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:39 smithi080 ceph-mon[89645]: osdmap e1: 0 total, 0 up, 0 in 2022-09-07T19:33:40.214 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:39 smithi080 ceph-mon[89645]: mgrmap e1: no daemons active 2022-09-07T19:33:40.215 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:39 smithi080 ceph-mon[89645]: from='client.? 172.21.15.80:0/483671663' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2022-09-07T19:33:41.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:41.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [global] 2022-09-07T19:33:41.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout fsid = cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:41.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2022-09-07T19:33:41.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2022-09-07T19:33:41.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2022-09-07T19:33:41.050 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2022-09-07T19:33:41.050 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2022-09-07T19:33:41.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:41.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [mgr] 2022-09-07T19:33:41.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2022-09-07T19:33:41.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:41.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [osd] 2022-09-07T19:33:41.053 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2022-09-07T19:33:41.053 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2022-09-07T19:33:41.054 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2022-09-07T19:33:41.054 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2022-09-07T19:33:41.055 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2022-09-07T19:33:41.055 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.522+0000 7fcdc9f21700 1 Processor -- start 2022-09-07T19:33:41.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.522+0000 7fcdc9f21700 1 -- start start 2022-09-07T19:33:41.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.522+0000 7fcdc9f21700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc41084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:41.057 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.522+0000 7fcdc9f21700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4103ed0 con 0x7fcdc4077c90 2022-09-07T19:33:41.057 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.523+0000 7fcdc37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc41084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:41.058 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.523+0000 7fcdc37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc41084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34644/0 (socket says 172.21.15.80:34644) 2022-09-07T19:33:41.058 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.523+0000 7fcdc37fe700 1 -- 172.21.15.80:0/1879194782 learned_addr learned my addr 172.21.15.80:0/1879194782 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:41.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.523+0000 7fcdc37fe700 1 -- 172.21.15.80:0/1879194782 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc4108a20 con 0x7fcdc4077c90 2022-09-07T19:33:41.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.524+0000 7fcdc37fe700 1 --2- 172.21.15.80:0/1879194782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc41084e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009700 tx=0x7fcdb4009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8a66b95094fce7 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:41.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.524+0000 7fcdc27fc700 1 -- 172.21.15.80:0/1879194782 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdb4004160 con 0x7fcdc4077c90 2022-09-07T19:33:41.060 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.524+0000 7fcdc27fc700 1 -- 172.21.15.80:0/1879194782 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb40042c0 con 0x7fcdc4077c90 2022-09-07T19:33:41.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.524+0000 7fcdc27fc700 1 -- 172.21.15.80:0/1879194782 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdb4011630 con 0x7fcdc4077c90 2022-09-07T19:33:41.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 -- 172.21.15.80:0/1879194782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 msgr2=0x7fcdc41084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:41.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 --2- 172.21.15.80:0/1879194782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc41084e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009700 tx=0x7fcdb4009a10 comp rx=0 tx=0).stop 2022-09-07T19:33:41.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 -- 172.21.15.80:0/1879194782 shutdown_connections 2022-09-07T19:33:41.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 --2- 172.21.15.80:0/1879194782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc41084e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:41.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 -- 172.21.15.80:0/1879194782 >> 172.21.15.80:0/1879194782 conn(0x7fcdc40fdaf0 msgr2=0x7fcdc40fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:41.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 -- 172.21.15.80:0/1879194782 shutdown_connections 2022-09-07T19:33:41.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.525+0000 7fcdc9f21700 1 -- 172.21.15.80:0/1879194782 wait complete. 2022-09-07T19:33:41.063 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.526+0000 7fcdc9f21700 1 Processor -- start 2022-09-07T19:33:41.063 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.526+0000 7fcdc9f21700 1 -- start start 2022-09-07T19:33:41.063 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.527+0000 7fcdc9f21700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:41.063 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.527+0000 7fcdc9f21700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4199000 con 0x7fcdc4077c90 2022-09-07T19:33:41.064 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.527+0000 7fcdc37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:41.064 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.527+0000 7fcdc37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc4198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34658/0 (socket says 172.21.15.80:34658) 2022-09-07T19:33:41.064 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.527+0000 7fcdc37fe700 1 -- 172.21.15.80:0/400942275 learned_addr learned my addr 172.21.15.80:0/400942275 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:41.064 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.527+0000 7fcdc37fe700 1 -- 172.21.15.80:0/400942275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40093e0 con 0x7fcdc4077c90 2022-09-07T19:33:41.065 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc37fe700 1 --2- 172.21.15.80:0/400942275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc4198ac0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4000c00 tx=0x7fcdb40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:41.065 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdb4003520 con 0x7fcdc4077c90 2022-09-07T19:33:41.065 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb4003680 con 0x7fcdc4077c90 2022-09-07T19:33:41.065 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdb4003920 con 0x7fcdc4077c90 2022-09-07T19:33:41.065 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc4199200 con 0x7fcdc4077c90 2022-09-07T19:33:41.066 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc4199630 con 0x7fcdc4077c90 2022-09-07T19:33:41.066 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.528+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fcdb402c020 con 0x7fcdc4077c90 2022-09-07T19:33:41.066 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.529+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcdb401cbf0 con 0x7fcdc4077c90 2022-09-07T19:33:41.066 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.529+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc4060310 con 0x7fcdc4077c90 2022-09-07T19:33:41.067 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.532+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fcdb401c450 con 0x7fcdc4077c90 2022-09-07T19:33:41.067 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.601+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fcdc4108cd0 con 0x7fcdc4077c90 2022-09-07T19:33:41.067 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.606+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 7 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fcdb401cdb0 con 0x7fcdc4077c90 2022-09-07T19:33:41.067 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.606+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/400942275 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fcdb401a510 con 0x7fcdc4077c90 2022-09-07T19:33:41.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 msgr2=0x7fcdc4198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:41.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 --2- 172.21.15.80:0/400942275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc4198ac0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4000c00 tx=0x7fcdb40045d0 comp rx=0 tx=0).stop 2022-09-07T19:33:41.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 shutdown_connections 2022-09-07T19:33:41.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 --2- 172.21.15.80:0/400942275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4077c90 0x7fcdc4198ac0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:41.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 >> 172.21.15.80:0/400942275 conn(0x7fcdc40fdaf0 msgr2=0x7fcdc40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:41.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 shutdown_connections 2022-09-07T19:33:41.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:40.607+0000 7fcdc9f21700 1 -- 172.21.15.80:0/400942275 wait complete. 2022-09-07T19:33:41.070 INFO:teuthology.orchestra.run.smithi080.stdout:Generating new minimal ceph.conf... 2022-09-07T19:33:41.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:40 smithi080 ceph-mon[89645]: from='client.? 172.21.15.80:0/400942275' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-09-07T19:33:41.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:40 smithi080 ceph-mon[89645]: from='client.? 172.21.15.80:0/400942275' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-09-07T19:33:42.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:41 smithi080 ceph-mon[89645]: from='client.? 172.21.15.80:0/905510020' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:33:42.140 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.627+0000 7ff6eec7e700 1 Processor -- start 2022-09-07T19:33:42.141 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.627+0000 7ff6eec7e700 1 -- start start 2022-09-07T19:33:42.141 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.627+0000 7ff6eec7e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8102810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:42.141 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.627+0000 7ff6eec7e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8102d50 con 0x7ff6e8102400 2022-09-07T19:33:42.141 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.628+0000 7ff6eca1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:42.142 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.628+0000 7ff6eca1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8102810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34662/0 (socket says 172.21.15.80:34662) 2022-09-07T19:33:42.142 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.628+0000 7ff6eca1a700 1 -- 172.21.15.80:0/3055126916 learned_addr learned my addr 172.21.15.80:0/3055126916 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:42.142 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.628+0000 7ff6eca1a700 1 -- 172.21.15.80:0/3055126916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8102e90 con 0x7ff6e8102400 2022-09-07T19:33:42.142 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6eca1a700 1 --2- 172.21.15.80:0/3055126916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8102810 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b9a0 tx=0x7ff6dc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f540443847806f89 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:42.144 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6e77fe700 1 -- 172.21.15.80:0/3055126916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc004160 con 0x7ff6e8102400 2022-09-07T19:33:42.144 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6e77fe700 1 -- 172.21.15.80:0/3055126916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ff6dc00de70 con 0x7ff6e8102400 2022-09-07T19:33:42.144 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6e77fe700 1 -- 172.21.15.80:0/3055126916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc003d00 con 0x7ff6e8102400 2022-09-07T19:33:42.144 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6eec7e700 1 -- 172.21.15.80:0/3055126916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 msgr2=0x7ff6e8102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:42.145 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6eec7e700 1 --2- 172.21.15.80:0/3055126916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8102810 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b9a0 tx=0x7ff6dc00bcb0 comp rx=0 tx=0).stop 2022-09-07T19:33:42.145 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6eec7e700 1 -- 172.21.15.80:0/3055126916 shutdown_connections 2022-09-07T19:33:42.145 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.629+0000 7ff6eec7e700 1 --2- 172.21.15.80:0/3055126916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8102810 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:42.145 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.630+0000 7ff6eec7e700 1 -- 172.21.15.80:0/3055126916 >> 172.21.15.80:0/3055126916 conn(0x7ff6e80fdaf0 msgr2=0x7ff6e80fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:42.146 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.630+0000 7ff6eec7e700 1 -- 172.21.15.80:0/3055126916 shutdown_connections 2022-09-07T19:33:42.146 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.630+0000 7ff6eec7e700 1 -- 172.21.15.80:0/3055126916 wait complete. 2022-09-07T19:33:42.146 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.631+0000 7ff6eec7e700 1 Processor -- start 2022-09-07T19:33:42.146 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.631+0000 7ff6eec7e700 1 -- start start 2022-09-07T19:33:42.147 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.631+0000 7ff6eec7e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:42.147 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.631+0000 7ff6eec7e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8199790 con 0x7ff6e8102400 2022-09-07T19:33:42.147 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.631+0000 7ff6eca1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:42.147 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6eca1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34670/0 (socket says 172.21.15.80:34670) 2022-09-07T19:33:42.148 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6eca1a700 1 -- 172.21.15.80:0/905510020 learned_addr learned my addr 172.21.15.80:0/905510020 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:42.148 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6eca1a700 1 -- 172.21.15.80:0/905510020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc00b680 con 0x7ff6e8102400 2022-09-07T19:33:42.148 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6eca1a700 1 --2- 172.21.15.80:0/905510020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8199250 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc003820 tx=0x7ff6dc004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:42.148 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc010680 con 0x7ff6e8102400 2022-09-07T19:33:42.148 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ff6dc010c60 con 0x7ff6e8102400 2022-09-07T19:33:42.149 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e8199990 con 0x7ff6e8102400 2022-09-07T19:33:42.149 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.632+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc022a60 con 0x7ff6e8102400 2022-09-07T19:33:42.149 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.633+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e8199d60 con 0x7ff6e8102400 2022-09-07T19:33:42.149 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.633+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ff6dc022c50 con 0x7ff6e8102400 2022-09-07T19:33:42.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.633+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff6dc02bbb0 con 0x7ff6e8102400 2022-09-07T19:33:42.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.634+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e8060380 con 0x7ff6e8102400 2022-09-07T19:33:42.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.637+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7ff6e8060380 con 0x7ff6e8102400 2022-09-07T19:33:42.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.707+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ff6e8192910 con 0x7ff6e8102400 2022-09-07T19:33:42.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.707+0000 7ff6e5ffb700 1 -- 172.21.15.80:0/905510020 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7ff6dc030060 con 0x7ff6e8102400 2022-09-07T19:33:42.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.708+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 msgr2=0x7ff6e8199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:42.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.708+0000 7ff6eec7e700 1 --2- 172.21.15.80:0/905510020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8199250 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc003820 tx=0x7ff6dc004250 comp rx=0 tx=0).stop 2022-09-07T19:33:42.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.709+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 shutdown_connections 2022-09-07T19:33:42.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.709+0000 7ff6eec7e700 1 --2- 172.21.15.80:0/905510020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e8102400 0x7ff6e8199250 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:42.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.709+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 >> 172.21.15.80:0/905510020 conn(0x7ff6e80fdaf0 msgr2=0x7ff6e80ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:42.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.709+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 shutdown_connections 2022-09-07T19:33:42.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:41.709+0000 7ff6eec7e700 1 -- 172.21.15.80:0/905510020 wait complete. 2022-09-07T19:33:42.153 INFO:teuthology.orchestra.run.smithi080.stdout:Restarting the monitor... 2022-09-07T19:33:42.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:42 smithi080 systemd[1]: Stopping Ceph mon.a for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:33:42.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:42 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mon-a[89621]: 2022-09-07T19:33:42.650+0000 7fb3f51cb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2022-09-07T19:33:42.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:42 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mon-a[89621]: 2022-09-07T19:33:42.650+0000 7fb3f51cb700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2022-09-07T19:33:43.339 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:43 smithi080 bash[89982]: ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mon-a 2022-09-07T19:33:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:43 smithi080 systemd[1]: ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.a.service: Succeeded. 2022-09-07T19:33:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:43 smithi080 systemd[1]: Stopped Ceph mon.a for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:33:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:43 smithi080 systemd[1]: Starting Ceph mon.a for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:33:44.168 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:43 smithi080 podman[90084]: 2022-09-07T19:33:44.209 INFO:teuthology.orchestra.run.smithi080.stdout:Setting mon public_network to 172.21.0.0/20 2022-09-07T19:33:44.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 bash[90084]: 5f6fe6e336d583edff1ca6e7150c37d60bf620947e342fd2fc29d54a75485d31 2022-09-07T19:33:44.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: set uid:gid to 167:167 (ceph:ceph) 2022-09-07T19:33:44.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev), process ceph-mon, pid 7 2022-09-07T19:33:44.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: pidfile_write: ignore empty --pid-file 2022-09-07T19:33:44.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: load: jerasure load: lrc 2022-09-07T19:33:44.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: RocksDB version: 6.15.5 2022-09-07T19:33:44.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-09-07T19:33:44.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Compile date Sep 7 2022 2022-09-07T19:33:44.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: DB SUMMARY 2022-09-07T19:33:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: DB Session ID: 6FK9WCPZCKUK3C4UI404 2022-09-07T19:33:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: CURRENT file: CURRENT 2022-09-07T19:33:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: IDENTITY file: IDENTITY 2022-09-07T19:33:44.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2022-09-07T19:33:44.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2022-09-07T19:33:44.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 97687 ; 2022-09-07T19:33:44.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.error_if_exists: 0 2022-09-07T19:33:44.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.create_if_missing: 0 2022-09-07T19:33:44.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.paranoid_checks: 1 2022-09-07T19:33:44.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-09-07T19:33:44.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.env: 0x5629af176100 2022-09-07T19:33:44.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.fs: Posix File System 2022-09-07T19:33:44.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.info_log: 0x5629b08f5c20 2022-09-07T19:33:44.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_file_opening_threads: 16 2022-09-07T19:33:44.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.statistics: (nil) 2022-09-07T19:33:44.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.use_fsync: 0 2022-09-07T19:33:44.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_log_file_size: 0 2022-09-07T19:33:44.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-09-07T19:33:44.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.log_file_time_to_roll: 0 2022-09-07T19:33:44.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.keep_log_file_num: 1000 2022-09-07T19:33:44.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.recycle_log_file_num: 0 2022-09-07T19:33:44.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.allow_fallocate: 1 2022-09-07T19:33:44.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.allow_mmap_reads: 0 2022-09-07T19:33:44.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.allow_mmap_writes: 0 2022-09-07T19:33:44.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.use_direct_reads: 0 2022-09-07T19:33:44.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-09-07T19:33:44.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.create_missing_column_families: 0 2022-09-07T19:33:44.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.db_log_dir: 2022-09-07T19:33:44.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2022-09-07T19:33:44.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.table_cache_numshardbits: 6 2022-09-07T19:33:44.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.WAL_ttl_seconds: 0 2022-09-07T19:33:44.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.WAL_size_limit_MB: 0 2022-09-07T19:33:44.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-09-07T19:33:44.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-09-07T19:33:44.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.is_fd_close_on_exec: 1 2022-09-07T19:33:44.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.advise_random_on_open: 1 2022-09-07T19:33:44.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.db_write_buffer_size: 0 2022-09-07T19:33:44.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.write_buffer_manager: 0x5629b09eab70 2022-09-07T19:33:44.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-09-07T19:33:44.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-09-07T19:33:44.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-09-07T19:33:44.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.use_adaptive_mutex: 0 2022-09-07T19:33:44.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.rate_limiter: (nil) 2022-09-07T19:33:44.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-09-07T19:33:44.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.wal_recovery_mode: 2 2022-09-07T19:33:44.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.enable_thread_tracking: 0 2022-09-07T19:33:44.530 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.enable_pipelined_write: 0 2022-09-07T19:33:44.530 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.unordered_write: 0 2022-09-07T19:33:44.530 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-09-07T19:33:44.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-09-07T19:33:44.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-09-07T19:33:44.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-09-07T19:33:44.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.row_cache: None 2022-09-07T19:33:44.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.wal_filter: None 2022-09-07T19:33:44.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-09-07T19:33:44.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.allow_ingest_behind: 0 2022-09-07T19:33:44.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.preserve_deletes: 0 2022-09-07T19:33:44.533 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.two_write_queues: 0 2022-09-07T19:33:44.533 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.manual_wal_flush: 0 2022-09-07T19:33:44.533 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.atomic_flush: 0 2022-09-07T19:33:44.533 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-09-07T19:33:44.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.persist_stats_to_disk: 0 2022-09-07T19:33:44.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.write_dbid_to_manifest: 0 2022-09-07T19:33:44.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.log_readahead_size: 0 2022-09-07T19:33:44.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-09-07T19:33:44.535 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.best_efforts_recovery: 0 2022-09-07T19:33:44.535 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-09-07T19:33:44.535 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-09-07T19:33:44.535 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.allow_data_in_errors: 0 2022-09-07T19:33:44.535 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.db_host_id: __hostname__ 2022-09-07T19:33:44.536 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_background_jobs: 2 2022-09-07T19:33:44.536 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_background_compactions: -1 2022-09-07T19:33:44.536 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_subcompactions: 1 2022-09-07T19:33:44.536 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-09-07T19:33:44.537 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-09-07T19:33:44.537 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.delayed_write_rate : 16777216 2022-09-07T19:33:44.537 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_total_wal_size: 0 2022-09-07T19:33:44.537 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-09-07T19:33:44.537 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.stats_dump_period_sec: 600 2022-09-07T19:33:44.538 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.stats_persist_period_sec: 600 2022-09-07T19:33:44.538 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-09-07T19:33:44.538 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_open_files: -1 2022-09-07T19:33:44.538 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bytes_per_sync: 0 2022-09-07T19:33:44.539 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.wal_bytes_per_sync: 0 2022-09-07T19:33:44.539 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.strict_bytes_per_sync: 0 2022-09-07T19:33:44.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_readahead_size: 0 2022-09-07T19:33:44.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_background_flushes: -1 2022-09-07T19:33:44.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Compression algorithms supported: 2022-09-07T19:33:44.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-09-07T19:33:44.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kZSTD supported: 0 2022-09-07T19:33:44.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kXpressCompression supported: 0 2022-09-07T19:33:44.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kLZ4HCCompression supported: 1 2022-09-07T19:33:44.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kZlibCompression supported: 1 2022-09-07T19:33:44.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kSnappyCompression supported: 1 2022-09-07T19:33:44.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kLZ4Compression supported: 1 2022-09-07T19:33:44.542 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: kBZip2Compression supported: 0 2022-09-07T19:33:44.542 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Fast CRC32 supported: Supported on x86 2022-09-07T19:33:44.542 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2022-09-07T19:33:44.542 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2022-09-07T19:33:44.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-09-07T19:33:44.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.merge_operator: 2022-09-07T19:33:44.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_filter: None 2022-09-07T19:33:44.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_filter_factory: None 2022-09-07T19:33:44.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.sst_partitioner_factory: None 2022-09-07T19:33:44.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.memtable_factory: SkipListFactory 2022-09-07T19:33:44.545 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.table_factory: BlockBasedTable 2022-09-07T19:33:44.545 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5629b08f2d48) 2022-09-07T19:33:44.545 INFO:journalctl@ceph.mon.a.smithi080.stdout: cache_index_and_filter_blocks: 1 2022-09-07T19:33:44.545 INFO:journalctl@ceph.mon.a.smithi080.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-09-07T19:33:44.545 INFO:journalctl@ceph.mon.a.smithi080.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-09-07T19:33:44.546 INFO:journalctl@ceph.mon.a.smithi080.stdout: pin_top_level_index_and_filter: 1 2022-09-07T19:33:44.546 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_type: 0 2022-09-07T19:33:44.546 INFO:journalctl@ceph.mon.a.smithi080.stdout: data_block_index_type: 0 2022-09-07T19:33:44.547 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_shortening: 1 2022-09-07T19:33:44.547 INFO:journalctl@ceph.mon.a.smithi080.stdout: data_block_hash_table_util_ratio: 0.750000 2022-09-07T19:33:44.547 INFO:journalctl@ceph.mon.a.smithi080.stdout: hash_index_allow_collision: 1 2022-09-07T19:33:44.547 INFO:journalctl@ceph.mon.a.smithi080.stdout: checksum: 1 2022-09-07T19:33:44.547 INFO:journalctl@ceph.mon.a.smithi080.stdout: no_block_cache: 0 2022-09-07T19:33:44.548 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache: 0x5629b095e9b0 2022-09-07T19:33:44.548 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_name: BinnedLRUCache 2022-09-07T19:33:44.548 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_options: 2022-09-07T19:33:44.548 INFO:journalctl@ceph.mon.a.smithi080.stdout: capacity : 536870912 2022-09-07T19:33:44.549 INFO:journalctl@ceph.mon.a.smithi080.stdout: num_shard_bits : 4 2022-09-07T19:33:44.549 INFO:journalctl@ceph.mon.a.smithi080.stdout: strict_capacity_limit : 0 2022-09-07T19:33:44.549 INFO:journalctl@ceph.mon.a.smithi080.stdout: high_pri_pool_ratio: 0.000 2022-09-07T19:33:44.549 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_compressed: (nil) 2022-09-07T19:33:44.550 INFO:journalctl@ceph.mon.a.smithi080.stdout: persistent_cache: (nil) 2022-09-07T19:33:44.550 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_size: 4096 2022-09-07T19:33:44.550 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_size_deviation: 10 2022-09-07T19:33:44.550 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_restart_interval: 16 2022-09-07T19:33:44.551 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_block_restart_interval: 1 2022-09-07T19:33:44.551 INFO:journalctl@ceph.mon.a.smithi080.stdout: metadata_block_size: 4096 2022-09-07T19:33:44.551 INFO:journalctl@ceph.mon.a.smithi080.stdout: partition_filters: 0 2022-09-07T19:33:44.551 INFO:journalctl@ceph.mon.a.smithi080.stdout: use_delta_encoding: 1 2022-09-07T19:33:44.551 INFO:journalctl@ceph.mon.a.smithi080.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-09-07T19:33:44.552 INFO:journalctl@ceph.mon.a.smithi080.stdout: whole_key_filtering: 1 2022-09-07T19:33:44.552 INFO:journalctl@ceph.mon.a.smithi080.stdout: verify_compression: 0 2022-09-07T19:33:44.552 INFO:journalctl@ceph.mon.a.smithi080.stdout: read_amp_bytes_per_bit: 0 2022-09-07T19:33:44.552 INFO:journalctl@ceph.mon.a.smithi080.stdout: format_version: 4 2022-09-07T19:33:44.553 INFO:journalctl@ceph.mon.a.smithi080.stdout: enable_index_compression: 1 2022-09-07T19:33:44.553 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_align: 0 2022-09-07T19:33:44.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.write_buffer_size: 33554432 2022-09-07T19:33:44.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_write_buffer_number: 2 2022-09-07T19:33:44.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression: NoCompression 2022-09-07T19:33:44.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression: Disabled 2022-09-07T19:33:44.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.prefix_extractor: nullptr 2022-09-07T19:33:44.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-09-07T19:33:44.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.num_levels: 7 2022-09-07T19:33:44.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-09-07T19:33:44.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-09-07T19:33:44.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-09-07T19:33:44.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-09-07T19:33:44.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-09-07T19:33:44.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-09-07T19:33:44.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-09-07T19:33:44.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-09-07T19:33:44.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-09-07T19:33:44.557 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-09-07T19:33:44.557 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.window_bits: -14 2022-09-07T19:33:44.557 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.level: 32767 2022-09-07T19:33:44.557 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.strategy: 0 2022-09-07T19:33:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-09-07T19:33:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-09-07T19:33:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-09-07T19:33:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compression_opts.enabled: false 2022-09-07T19:33:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-09-07T19:33:44.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-09-07T19:33:44.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-09-07T19:33:44.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.target_file_size_base: 67108864 2022-09-07T19:33:44.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.target_file_size_multiplier: 1 2022-09-07T19:33:44.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-09-07T19:33:44.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-09-07T19:33:44.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-09-07T19:33:44.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-09-07T19:33:44.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-09-07T19:33:44.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-09-07T19:33:44.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-09-07T19:33:44.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-09-07T19:33:44.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-09-07T19:33:44.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-09-07T19:33:44.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-09-07T19:33:44.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-09-07T19:33:44.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.arena_block_size: 4194304 2022-09-07T19:33:44.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-09-07T19:33:44.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-09-07T19:33:44.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-09-07T19:33:44.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.disable_auto_compactions: 0 2022-09-07T19:33:44.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-09-07T19:33:44.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-09-07T19:33:44.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-09-07T19:33:44.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-09-07T19:33:44.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-09-07T19:33:44.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-09-07T19:33:44.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-09-07T19:33:44.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-09-07T19:33:44.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-09-07T19:33:44.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-09-07T19:33:44.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.table_properties_collectors: 2022-09-07T19:33:44.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.inplace_update_support: 0 2022-09-07T19:33:44.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.inplace_update_num_locks: 10000 2022-09-07T19:33:44.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-09-07T19:33:44.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-09-07T19:33:44.568 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.memtable_huge_page_size: 0 2022-09-07T19:33:44.568 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.bloom_locality: 0 2022-09-07T19:33:44.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.max_successive_merges: 0 2022-09-07T19:33:44.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.optimize_filters_for_hits: 0 2022-09-07T19:33:44.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.paranoid_file_checks: 0 2022-09-07T19:33:44.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.force_consistency_checks: 1 2022-09-07T19:33:44.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.report_bg_io_stats: 0 2022-09-07T19:33:44.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.ttl: 2592000 2022-09-07T19:33:44.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.periodic_compaction_seconds: 0 2022-09-07T19:33:44.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.enable_blob_files: false 2022-09-07T19:33:44.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.min_blob_size: 0 2022-09-07T19:33:44.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.blob_file_size: 268435456 2022-09-07T19:33:44.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.blob_compression_type: NoCompression 2022-09-07T19:33:44.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.enable_blob_garbage_collection: false 2022-09-07T19:33:44.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-09-07T19:33:44.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-09-07T19:33:44.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2022-09-07T19:33:44.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2022-09-07T19:33:44.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579224201605, "job": 1, "event": "recovery_started", "wal_files": [10]} 2022-09-07T19:33:44.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2022-09-07T19:33:44.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-09-07T19:33:44.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579224203946, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92919, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91005, "index_size": 274, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13658, "raw_average_key_size": 50, "raw_value_size": 83488, "raw_average_value_size": 305, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1662579224, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "17f62bf3-1243-4048-8be9-fb9a1df87de1", "db_session_id": "6FK9WCPZCKUK3C4UI404"}} 2022-09-07T19:33:44.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2022-09-07T19:33:44.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579224206857, "job": 1, "event": "recovery_finished"} 2022-09-07T19:33:44.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-09-07T19:33:44.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 systemd[1]: Started Ceph mon.a for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:33:44.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5629b0945880 2022-09-07T19:33:44.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: DB pointer 0x5629b0954000 2022-09-07T19:33:44.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2022-09-07T19:33:44.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-09-07T19:33:44.580 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** DB Stats ** 2022-09-07T19:33:44.580 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:33:44.581 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-09-07T19:33:44.581 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-09-07T19:33:44.581 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-09-07T19:33:44.582 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-09-07T19:33:44.582 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-09-07T19:33:44.583 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-09-07T19:33:44.583 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.584 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2022-09-07T19:33:44.584 INFO:journalctl@ceph.mon.a.smithi080.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:33:44.584 INFO:journalctl@ceph.mon.a.smithi080.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:33:44.585 INFO:journalctl@ceph.mon.a.smithi080.stdout: L0 2/0 92.50 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.585 INFO:journalctl@ceph.mon.a.smithi080.stdout: Sum 2/0 92.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.587 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2022-09-07T19:33:44.587 INFO:journalctl@ceph.mon.a.smithi080.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:33:44.588 INFO:journalctl@ceph.mon.a.smithi080.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:33:44.588 INFO:journalctl@ceph.mon.a.smithi080.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.588 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:33:44.589 INFO:journalctl@ceph.mon.a.smithi080.stdout: Flush(GB): cumulative 0.000, interval 0.000 2022-09-07T19:33:44.589 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-09-07T19:33:44.590 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-09-07T19:33:44.590 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-09-07T19:33:44.591 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Keys): cumulative 0, interval 0 2022-09-07T19:33:44.591 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative compaction: 0.00 GB write, 7.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:33:44.591 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval compaction: 0.00 GB write, 7.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:33:44.592 INFO:journalctl@ceph.mon.a.smithi080.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-09-07T19:33:44.592 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.593 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** File Read Latency Histogram By Level [default] ** 2022-09-07T19:33:44.593 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.594 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2022-09-07T19:33:44.594 INFO:journalctl@ceph.mon.a.smithi080.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:33:44.594 INFO:journalctl@ceph.mon.a.smithi080.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:33:44.595 INFO:journalctl@ceph.mon.a.smithi080.stdout: L0 2/0 92.50 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.595 INFO:journalctl@ceph.mon.a.smithi080.stdout: Sum 2/0 92.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.596 INFO:journalctl@ceph.mon.a.smithi080.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-09-07T19:33:44.596 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.597 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2022-09-07T19:33:44.597 INFO:journalctl@ceph.mon.a.smithi080.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:33:44.598 INFO:journalctl@ceph.mon.a.smithi080.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:33:44.598 INFO:journalctl@ceph.mon.a.smithi080.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 52.2 0.00 0.00 1 0.002 0 0 2022-09-07T19:33:44.599 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:33:44.599 INFO:journalctl@ceph.mon.a.smithi080.stdout: Flush(GB): cumulative 0.000, interval 0.000 2022-09-07T19:33:44.599 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-09-07T19:33:44.600 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-09-07T19:33:44.600 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-09-07T19:33:44.601 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Keys): cumulative 0, interval 0 2022-09-07T19:33:44.601 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative compaction: 0.00 GB write, 7.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:33:44.602 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:33:44.602 INFO:journalctl@ceph.mon.a.smithi080.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-09-07T19:33:44.602 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.602 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** File Read Latency Histogram By Level [default] ** 2022-09-07T19:33:44.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:44.603 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???) e1 preinit fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:33:44.603 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).mds e1 new map 2022-09-07T19:33:44.603 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).mds e1 print_map 2022-09-07T19:33:44.603 INFO:journalctl@ceph.mon.a.smithi080.stdout: e1 2022-09-07T19:33:44.604 INFO:journalctl@ceph.mon.a.smithi080.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-09-07T19:33:44.604 INFO:journalctl@ceph.mon.a.smithi080.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-09-07T19:33:44.604 INFO:journalctl@ceph.mon.a.smithi080.stdout: legacy client fscid: -1 2022-09-07T19:33:44.604 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2022-09-07T19:33:44.604 INFO:journalctl@ceph.mon.a.smithi080.stdout: No filesystems configured 2022-09-07T19:33:44.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2022-09-07T19:33:44.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:33:44.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:33:44.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:33:44.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2022-09-07T19:33:44.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mon.a is new leader, mons a in quorum (ranks 0) 2022-09-07T19:33:44.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} 2022-09-07T19:33:44.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: fsmap 2022-09-07T19:33:44.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: osdmap e1: 0 total, 0 up, 0 in 2022-09-07T19:33:44.607 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:44 smithi080 ceph-mon[90124]: mgrmap e1: no daemons active 2022-09-07T19:33:45.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.808+0000 7fb5c8c1f700 1 Processor -- start 2022-09-07T19:33:45.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.808+0000 7fb5c8c1f700 1 -- start start 2022-09-07T19:33:45.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.809+0000 7fb5c8c1f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c4078310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:45.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.809+0000 7fb5c8c1f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4078850 con 0x7fb5c4079d90 2022-09-07T19:33:45.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.809+0000 7fb5c259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c4078310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:45.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.810+0000 7fb5c259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c4078310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48156/0 (socket says 172.21.15.80:48156) 2022-09-07T19:33:45.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.810+0000 7fb5c259c700 1 -- 172.21.15.80:0/1889156588 learned_addr learned my addr 172.21.15.80:0/1889156588 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:45.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.810+0000 7fb5c259c700 1 -- 172.21.15.80:0/1889156588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4078990 con 0x7fb5c4079d90 2022-09-07T19:33:45.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.810+0000 7fb5c259c700 1 --2- 172.21.15.80:0/1889156588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c4078310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009700 tx=0x7fb5b4009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f9ead49f6a9ed server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:45.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c159a700 1 -- 172.21.15.80:0/1889156588 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5b4004160 con 0x7fb5c4079d90 2022-09-07T19:33:45.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c159a700 1 -- 172.21.15.80:0/1889156588 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fb5b40042c0 con 0x7fb5c4079d90 2022-09-07T19:33:45.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c159a700 1 -- 172.21.15.80:0/1889156588 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5b40039d0 con 0x7fb5c4079d90 2022-09-07T19:33:45.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/1889156588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 msgr2=0x7fb5c4078310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:45.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c8c1f700 1 --2- 172.21.15.80:0/1889156588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c4078310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009700 tx=0x7fb5b4009a10 comp rx=0 tx=0).stop 2022-09-07T19:33:45.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/1889156588 shutdown_connections 2022-09-07T19:33:45.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c8c1f700 1 --2- 172.21.15.80:0/1889156588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c4078310 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:45.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.811+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/1889156588 >> 172.21.15.80:0/1889156588 conn(0x7fb5c40febf0 msgr2=0x7fb5c4101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:45.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.812+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/1889156588 shutdown_connections 2022-09-07T19:33:45.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.812+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/1889156588 wait complete. 2022-09-07T19:33:45.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.813+0000 7fb5c8c1f700 1 Processor -- start 2022-09-07T19:33:45.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.813+0000 7fb5c8c1f700 1 -- start start 2022-09-07T19:33:45.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.813+0000 7fb5c8c1f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:45.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.813+0000 7fb5c8c1f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c419db40 con 0x7fb5c4079d90 2022-09-07T19:33:45.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.814+0000 7fb5c259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:45.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.814+0000 7fb5c259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48160/0 (socket says 172.21.15.80:48160) 2022-09-07T19:33:45.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.814+0000 7fb5c259c700 1 -- 172.21.15.80:0/87941818 learned_addr learned my addr 172.21.15.80:0/87941818 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:45.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.814+0000 7fb5c259c700 1 -- 172.21.15.80:0/87941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40093e0 con 0x7fb5c4079d90 2022-09-07T19:33:45.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.814+0000 7fb5c259c700 1 --2- 172.21.15.80:0/87941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c419d600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4004000 tx=0x7fb5b40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:45.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5b4011840 con 0x7fb5c4079d90 2022-09-07T19:33:45.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fb5b401a430 con 0x7fb5c4079d90 2022-09-07T19:33:45.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c419dd40 con 0x7fb5c4079d90 2022-09-07T19:33:45.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5b4019530 con 0x7fb5c4079d90 2022-09-07T19:33:45.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c419e170 con 0x7fb5c4079d90 2022-09-07T19:33:45.344 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fb5b402a020 con 0x7fb5c4079d90 2022-09-07T19:33:45.344 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.815+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb5b402d780 con 0x7fb5c4079d90 2022-09-07T19:33:45.345 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.816+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4060310 con 0x7fb5c4079d90 2022-09-07T19:33:45.345 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.819+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fb5b401a5a0 con 0x7fb5c4079d90 2022-09-07T19:33:45.345 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.888+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb5c405fa00 con 0x7fb5c4079d90 2022-09-07T19:33:45.346 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.891+0000 7fb5b37fe700 1 -- 172.21.15.80:0/87941818 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb5b401a8a0 con 0x7fb5c4079d90 2022-09-07T19:33:45.346 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 msgr2=0x7fb5c419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:45.347 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 --2- 172.21.15.80:0/87941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c419d600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4004000 tx=0x7fb5b40040e0 comp rx=0 tx=0).stop 2022-09-07T19:33:45.347 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 shutdown_connections 2022-09-07T19:33:45.348 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 --2- 172.21.15.80:0/87941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c4079d90 0x7fb5c419d600 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:45.348 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 >> 172.21.15.80:0/87941818 conn(0x7fb5c40febf0 msgr2=0x7fb5c4101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:45.349 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 shutdown_connections 2022-09-07T19:33:45.349 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:44.892+0000 7fb5c8c1f700 1 -- 172.21.15.80:0/87941818 wait complete. 2022-09-07T19:33:45.349 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote config to /etc/ceph/ceph.conf 2022-09-07T19:33:45.350 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2022-09-07T19:33:45.350 INFO:teuthology.orchestra.run.smithi080.stdout:Creating mgr... 2022-09-07T19:33:45.351 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying port 9283 ... 2022-09-07T19:33:45.351 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying port 8765 ... 2022-09-07T19:33:45.694 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.x 2022-09-07T19:33:45.695 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.x.service: Unit ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.x.service not loaded. 2022-09-07T19:33:45.965 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c.target.wants/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@.service. 2022-09-07T19:33:45.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:45 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/87941818' entity='client.admin' 2022-09-07T19:33:46.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:45 smithi080 systemd[1]: Starting Ceph mgr.x for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:33:46.827 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:46 smithi080 podman[90352]: 2022-09-07T19:33:46.887 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2022-09-07T19:33:46.888 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2022-09-07T19:33:46.908 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2022-09-07T19:33:46.909 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2022-09-07T19:33:46.909 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2022-09-07T19:33:46.909 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to enable service . firewalld.service is not available 2022-09-07T19:33:46.932 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2022-09-07T19:33:46.932 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2022-09-07T19:33:46.953 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2022-09-07T19:33:46.954 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2022-09-07T19:33:46.954 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2022-09-07T19:33:46.954 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2022-09-07T19:33:46.955 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr to start... 2022-09-07T19:33:46.955 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr... 2022-09-07T19:33:47.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:46 smithi080 bash[90352]: a11bd664fcab2f97f44aee89fd9bb9f9ff55c3483159587ab5af9967de88d0b4 2022-09-07T19:33:47.119 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:46 smithi080 systemd[1]: Started Ceph mgr.x for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:33:47.119 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:47 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:47.026+0000 7f3875d46080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:33:47.414 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:47 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:47.140+0000 7f3875d46080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:33:47.415 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:47 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:47.275+0000 7f3875d46080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:33:47.667 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:47 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:47.414+0000 7f3875d46080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:33:47.667 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:47 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:47.666+0000 7f3875d46080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:33:48.064 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:48.067 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:33:48.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:33:48.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2022-09-07T19:33:48.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2022-09-07T19:33:48.068 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2022-09-07T19:33:48.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2022-09-07T19:33:48.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2022-09-07T19:33:48.069 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2022-09-07T19:33:48.070 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2022-09-07T19:33:48.070 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:48.070 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2022-09-07T19:33:48.070 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2022-09-07T19:33:48.071 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:48.071 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2022-09-07T19:33:48.071 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2022-09-07T19:33:48.071 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:48.072 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2022-09-07T19:33:48.072 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2022-09-07T19:33:48.072 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.072 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2022-09-07T19:33:48.073 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:48.073 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2022-09-07T19:33:48.073 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2022-09-07T19:33:48.073 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2022-09-07T19:33:48.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2022-09-07T19:33:48.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2022-09-07T19:33:48.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2022-09-07T19:33:48.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2022-09-07T19:33:48.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2022-09-07T19:33:48.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2022-09-07T19:33:48.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2022-09-07T19:33:48.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2022-09-07T19:33:48.085 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2022-09-07T19:33:48.085 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2022-09-07T19:33:48.085 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2022-09-07T19:33:48.085 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2022-09-07T19:33:48.085 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.086 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2022-09-07T19:33:48.086 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:48.086 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2022-09-07T19:33:48.086 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2022-09-07T19:33:48.087 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.087 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2022-09-07T19:33:48.087 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2022-09-07T19:33:48.087 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2022-09-07T19:33:48.088 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2022-09-07T19:33:48.088 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2022-09-07T19:33:48.088 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2022-09-07T19:33:48.088 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2022-09-07T19:33:48.088 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:48.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:33:48.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2022-09-07T19:33:48.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:48.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2022-09-07T19:33:38.885187+0000", 2022-09-07T19:33:48.090 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:33:48.090 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:48.090 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2022-09-07T19:33:48.091 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:33:48.091 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.584+0000 7fe94ce48700 1 Processor -- start 2022-09-07T19:33:48.091 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.585+0000 7fe94ce48700 1 -- start start 2022-09-07T19:33:48.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.585+0000 7fe94ce48700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe9480782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:48.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.585+0000 7fe94ce48700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94807a140 con 0x7fe948079d30 2022-09-07T19:33:48.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.586+0000 7fe94659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe9480782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:48.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.586+0000 7fe94659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe9480782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48186/0 (socket says 172.21.15.80:48186) 2022-09-07T19:33:48.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.586+0000 7fe94659c700 1 -- 172.21.15.80:0/2924914121 learned_addr learned my addr 172.21.15.80:0/2924914121 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:48.093 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.586+0000 7fe94659c700 1 -- 172.21.15.80:0/2924914121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9480787f0 con 0x7fe948079d30 2022-09-07T19:33:48.093 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.587+0000 7fe94659c700 1 --2- 172.21.15.80:0/2924914121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe9480782b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe938009700 tx=0x7fe938009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15f352fddbf60f2 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:48.093 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.587+0000 7fe94559a700 1 -- 172.21.15.80:0/2924914121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe938004160 con 0x7fe948079d30 2022-09-07T19:33:48.093 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.587+0000 7fe94559a700 1 -- 172.21.15.80:0/2924914121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fe9380042c0 con 0x7fe948079d30 2022-09-07T19:33:48.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.587+0000 7fe94559a700 1 -- 172.21.15.80:0/2924914121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9380039d0 con 0x7fe948079d30 2022-09-07T19:33:48.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 -- 172.21.15.80:0/2924914121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 msgr2=0x7fe9480782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:48.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 --2- 172.21.15.80:0/2924914121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe9480782b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe938009700 tx=0x7fe938009a10 comp rx=0 tx=0).stop 2022-09-07T19:33:48.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 -- 172.21.15.80:0/2924914121 shutdown_connections 2022-09-07T19:33:48.095 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 --2- 172.21.15.80:0/2924914121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe9480782b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:48.095 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 -- 172.21.15.80:0/2924914121 >> 172.21.15.80:0/2924914121 conn(0x7fe9480febf0 msgr2=0x7fe948101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:48.095 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 -- 172.21.15.80:0/2924914121 shutdown_connections 2022-09-07T19:33:48.095 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.588+0000 7fe94ce48700 1 -- 172.21.15.80:0/2924914121 wait complete. 2022-09-07T19:33:48.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.589+0000 7fe94ce48700 1 Processor -- start 2022-09-07T19:33:48.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.589+0000 7fe94ce48700 1 -- start start 2022-09-07T19:33:48.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.590+0000 7fe94ce48700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe948199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:48.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.590+0000 7fe94ce48700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948199740 con 0x7fe948079d30 2022-09-07T19:33:48.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.590+0000 7fe94659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe948199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:48.097 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.590+0000 7fe94659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe948199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48194/0 (socket says 172.21.15.80:48194) 2022-09-07T19:33:48.097 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.590+0000 7fe94659c700 1 -- 172.21.15.80:0/3176877492 learned_addr learned my addr 172.21.15.80:0/3176877492 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:48.097 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe94659c700 1 -- 172.21.15.80:0/3176877492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9380093e0 con 0x7fe948079d30 2022-09-07T19:33:48.097 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe94659c700 1 --2- 172.21.15.80:0/3176877492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe948199200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e90 tx=0x7fe938003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:48.098 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe938004140 con 0x7fe948079d30 2022-09-07T19:33:48.098 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fe938011cc0 con 0x7fe948079d30 2022-09-07T19:33:48.098 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9380193c0 con 0x7fe948079d30 2022-09-07T19:33:48.099 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948199940 con 0x7fe948079d30 2022-09-07T19:33:48.099 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.591+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe948199d70 con 0x7fe948079d30 2022-09-07T19:33:48.099 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.592+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fe93802a020 con 0x7fe948079d30 2022-09-07T19:33:48.100 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.592+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe93802d440 con 0x7fe948079d30 2022-09-07T19:33:48.100 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.592+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe948109800 con 0x7fe948079d30 2022-09-07T19:33:48.101 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.595+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fe938019e40 con 0x7fe948079d30 2022-09-07T19:33:48.101 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.670+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe94819cbb0 con 0x7fe948079d30 2022-09-07T19:33:48.101 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.671+0000 7fe9377fe700 1 -- 172.21.15.80:0/3176877492 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7fe93801a430 con 0x7fe948079d30 2022-09-07T19:33:48.102 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 msgr2=0x7fe948199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:48.102 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 --2- 172.21.15.80:0/3176877492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe948199200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e90 tx=0x7fe938003f20 comp rx=0 tx=0).stop 2022-09-07T19:33:48.103 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 shutdown_connections 2022-09-07T19:33:48.103 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 --2- 172.21.15.80:0/3176877492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe948079d30 0x7fe948199200 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:48.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 >> 172.21.15.80:0/3176877492 conn(0x7fe9480febf0 msgr2=0x7fe9481002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:48.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 shutdown_connections 2022-09-07T19:33:48.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:47.672+0000 7fe94ce48700 1 -- 172.21.15.80:0/3176877492 wait complete. 2022-09-07T19:33:48.105 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (1/15)... 2022-09-07T19:33:48.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:47 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3176877492' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-09-07T19:33:48.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:48 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:48.155+0000 7f3875d46080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:33:48.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:48 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:48.284+0000 7f3875d46080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:33:48.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:48 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:48.465+0000 7f3875d46080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:33:48.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:48 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:48.608+0000 7f3875d46080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:33:49.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:49 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:49.222+0000 7f3875d46080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:33:50.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:50 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:50.109+0000 7f3875d46080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:33:50.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:50 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:50.369+0000 7f3875d46080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:33:51.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:51.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:33:51.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:33:51.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2022-09-07T19:33:51.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2022-09-07T19:33:51.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2022-09-07T19:33:51.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2022-09-07T19:33:51.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2022-09-07T19:33:51.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2022-09-07T19:33:51.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2022-09-07T19:33:51.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:51.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2022-09-07T19:33:51.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2022-09-07T19:33:51.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:51.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2022-09-07T19:33:51.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2022-09-07T19:33:51.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:51.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2022-09-07T19:33:51.826 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2022-09-07T19:33:51.826 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.827 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2022-09-07T19:33:51.827 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:51.827 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2022-09-07T19:33:51.828 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2022-09-07T19:33:51.828 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2022-09-07T19:33:51.829 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2022-09-07T19:33:51.829 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2022-09-07T19:33:51.830 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2022-09-07T19:33:51.830 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.830 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2022-09-07T19:33:51.831 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2022-09-07T19:33:51.831 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2022-09-07T19:33:51.832 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2022-09-07T19:33:51.832 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2022-09-07T19:33:51.833 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2022-09-07T19:33:51.833 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2022-09-07T19:33:51.833 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2022-09-07T19:33:51.834 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2022-09-07T19:33:51.834 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.835 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2022-09-07T19:33:51.835 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:51.836 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2022-09-07T19:33:51.836 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2022-09-07T19:33:51.837 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.837 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2022-09-07T19:33:51.837 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2022-09-07T19:33:51.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2022-09-07T19:33:51.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2022-09-07T19:33:51.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2022-09-07T19:33:51.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2022-09-07T19:33:51.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2022-09-07T19:33:51.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:51.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:33:51.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2022-09-07T19:33:51.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:51.843 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2022-09-07T19:33:38.885187+0000", 2022-09-07T19:33:51.843 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:33:51.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:51.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2022-09-07T19:33:51.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:33:51.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.307+0000 7ffb23218700 1 Processor -- start 2022-09-07T19:33:51.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.307+0000 7ffb23218700 1 -- start start 2022-09-07T19:33:51.846 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.308+0000 7ffb23218700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c0782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:51.846 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.308+0000 7ffb23218700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c07a140 con 0x7ffb1c079d30 2022-09-07T19:33:51.847 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.308+0000 7ffb20fb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c0782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:51.847 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.308+0000 7ffb20fb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c0782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48196/0 (socket says 172.21.15.80:48196) 2022-09-07T19:33:51.848 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.308+0000 7ffb20fb4700 1 -- 172.21.15.80:0/3926518963 learned_addr learned my addr 172.21.15.80:0/3926518963 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:51.849 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.309+0000 7ffb20fb4700 1 -- 172.21.15.80:0/3926518963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0787f0 con 0x7ffb1c079d30 2022-09-07T19:33:51.849 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.309+0000 7ffb20fb4700 1 --2- 172.21.15.80:0/3926518963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c0782b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009700 tx=0x7ffb10009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538e380aedcb307c server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:51.850 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.309+0000 7ffb1b7fe700 1 -- 172.21.15.80:0/3926518963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb10004160 con 0x7ffb1c079d30 2022-09-07T19:33:51.850 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.309+0000 7ffb1b7fe700 1 -- 172.21.15.80:0/3926518963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ffb100042c0 con 0x7ffb1c079d30 2022-09-07T19:33:51.850 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.309+0000 7ffb1b7fe700 1 -- 172.21.15.80:0/3926518963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb100039d0 con 0x7ffb1c079d30 2022-09-07T19:33:51.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.310+0000 7ffb23218700 1 -- 172.21.15.80:0/3926518963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 msgr2=0x7ffb1c0782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:51.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.310+0000 7ffb23218700 1 --2- 172.21.15.80:0/3926518963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c0782b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009700 tx=0x7ffb10009a10 comp rx=0 tx=0).stop 2022-09-07T19:33:51.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.310+0000 7ffb23218700 1 -- 172.21.15.80:0/3926518963 shutdown_connections 2022-09-07T19:33:51.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.310+0000 7ffb23218700 1 --2- 172.21.15.80:0/3926518963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c0782b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:51.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.310+0000 7ffb23218700 1 -- 172.21.15.80:0/3926518963 >> 172.21.15.80:0/3926518963 conn(0x7ffb1c0febf0 msgr2=0x7ffb1c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:51.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.310+0000 7ffb23218700 1 -- 172.21.15.80:0/3926518963 shutdown_connections 2022-09-07T19:33:51.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.311+0000 7ffb23218700 1 -- 172.21.15.80:0/3926518963 wait complete. 2022-09-07T19:33:51.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.312+0000 7ffb23218700 1 Processor -- start 2022-09-07T19:33:51.855 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.312+0000 7ffb23218700 1 -- start start 2022-09-07T19:33:51.855 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.312+0000 7ffb23218700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:51.856 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.312+0000 7ffb23218700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c199730 con 0x7ffb1c079d30 2022-09-07T19:33:51.856 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.313+0000 7ffb20fb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:51.856 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.313+0000 7ffb20fb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48210/0 (socket says 172.21.15.80:48210) 2022-09-07T19:33:51.857 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.313+0000 7ffb20fb4700 1 -- 172.21.15.80:0/2073833084 learned_addr learned my addr 172.21.15.80:0/2073833084 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:51.857 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.313+0000 7ffb20fb4700 1 -- 172.21.15.80:0/2073833084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100093e0 con 0x7ffb1c079d30 2022-09-07T19:33:51.858 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.313+0000 7ffb20fb4700 1 --2- 172.21.15.80:0/2073833084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c1991f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009e90 tx=0x7ffb10003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:51.858 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb10004140 con 0x7ffb1c079d30 2022-09-07T19:33:51.859 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ffb10011cc0 con 0x7ffb1c079d30 2022-09-07T19:33:51.859 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c199930 con 0x7ffb1c079d30 2022-09-07T19:33:51.860 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb100193c0 con 0x7ffb1c079d30 2022-09-07T19:33:51.860 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c199d60 con 0x7ffb1c079d30 2022-09-07T19:33:51.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ffb1002a020 con 0x7ffb1c079d30 2022-09-07T19:33:51.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.314+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffb10019970 con 0x7ffb1c079d30 2022-09-07T19:33:51.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.315+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c060380 con 0x7ffb1c079d30 2022-09-07T19:33:51.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.318+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7ffb1c060380 con 0x7ffb1c079d30 2022-09-07T19:33:51.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.393+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ffb1c109800 con 0x7ffb1c079d30 2022-09-07T19:33:51.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.394+0000 7ffb19ffb700 1 -- 172.21.15.80:0/2073833084 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7ffb10011840 con 0x7ffb1c079d30 2022-09-07T19:33:51.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.395+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 msgr2=0x7ffb1c1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:51.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.395+0000 7ffb23218700 1 --2- 172.21.15.80:0/2073833084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c1991f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009e90 tx=0x7ffb10003f20 comp rx=0 tx=0).stop 2022-09-07T19:33:51.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.395+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 shutdown_connections 2022-09-07T19:33:51.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.395+0000 7ffb23218700 1 --2- 172.21.15.80:0/2073833084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb1c079d30 0x7ffb1c1991f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:51.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.395+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 >> 172.21.15.80:0/2073833084 conn(0x7ffb1c0febf0 msgr2=0x7ffb1c0ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:51.864 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.396+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 shutdown_connections 2022-09-07T19:33:51.864 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:51.396+0000 7ffb23218700 1 -- 172.21.15.80:0/2073833084 wait complete. 2022-09-07T19:33:51.864 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (2/15)... 2022-09-07T19:33:51.865 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:51 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2073833084' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-09-07T19:33:51.865 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:51 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:51.502+0000 7f3875d46080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:33:51.866 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:51 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:51.659+0000 7f3875d46080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:33:52.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:51 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:51.966+0000 7f3875d46080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:33:52.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:52 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:52.273+0000 7f3875d46080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:33:52.619 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:52 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:52.501+0000 7f3875d46080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:33:53.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:53 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:53.096+0000 7f3875d46080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:33:54.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:54 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:54.020+0000 7f3875d46080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:33:54.727 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:54 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:54.461+0000 7f3875d46080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:33:54.992 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:54 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:54.821+0000 7f3875d46080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:33:55.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:33:55.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:33:55.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:33:55.034 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2022-09-07T19:33:55.034 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2022-09-07T19:33:55.035 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2022-09-07T19:33:55.035 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2022-09-07T19:33:55.035 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.036 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2022-09-07T19:33:55.036 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2022-09-07T19:33:55.037 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2022-09-07T19:33:55.037 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:55.037 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2022-09-07T19:33:55.038 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2022-09-07T19:33:55.038 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:55.038 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2022-09-07T19:33:55.038 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2022-09-07T19:33:55.039 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:55.039 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2022-09-07T19:33:55.039 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2022-09-07T19:33:55.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2022-09-07T19:33:55.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:55.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2022-09-07T19:33:55.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2022-09-07T19:33:55.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2022-09-07T19:33:55.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2022-09-07T19:33:55.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2022-09-07T19:33:55.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2022-09-07T19:33:55.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2022-09-07T19:33:55.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2022-09-07T19:33:55.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2022-09-07T19:33:55.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2022-09-07T19:33:55.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2022-09-07T19:33:55.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2022-09-07T19:33:55.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2022-09-07T19:33:55.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2022-09-07T19:33:55.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2022-09-07T19:33:55.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2022-09-07T19:33:55.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:55.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2022-09-07T19:33:55.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2022-09-07T19:33:55.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2022-09-07T19:33:55.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2022-09-07T19:33:55.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2022-09-07T19:33:55.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2022-09-07T19:33:55.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2022-09-07T19:33:55.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2022-09-07T19:33:55.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2022-09-07T19:33:55.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:33:55.050 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:33:55.050 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.050 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2022-09-07T19:33:55.050 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:33:55.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2022-09-07T19:33:38.885187+0000", 2022-09-07T19:33:55.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:33:55.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:33:55.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2022-09-07T19:33:55.051 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:33:55.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.471+0000 7feed2d91700 1 Processor -- start 2022-09-07T19:33:55.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.471+0000 7feed2d91700 1 -- start start 2022-09-07T19:33:55.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.471+0000 7feed2d91700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc0782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:55.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.471+0000 7feed2d91700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc07a140 con 0x7feecc079d30 2022-09-07T19:33:55.052 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.472+0000 7feed0b2d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc0782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:55.053 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.472+0000 7feed0b2d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc0782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42478/0 (socket says 172.21.15.80:42478) 2022-09-07T19:33:55.053 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.472+0000 7feed0b2d700 1 -- 172.21.15.80:0/2867502969 learned_addr learned my addr 172.21.15.80:0/2867502969 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:55.053 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.472+0000 7feed0b2d700 1 -- 172.21.15.80:0/2867502969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0787f0 con 0x7feecc079d30 2022-09-07T19:33:55.053 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.473+0000 7feed0b2d700 1 --2- 172.21.15.80:0/2867502969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc0782b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feec0009700 tx=0x7feec0009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c74182242240be server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:55.054 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.473+0000 7feecb7fe700 1 -- 172.21.15.80:0/2867502969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0004160 con 0x7feecc079d30 2022-09-07T19:33:55.054 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.473+0000 7feecb7fe700 1 -- 172.21.15.80:0/2867502969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7feec00042c0 con 0x7feecc079d30 2022-09-07T19:33:55.054 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.473+0000 7feecb7fe700 1 -- 172.21.15.80:0/2867502969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec00039d0 con 0x7feecc079d30 2022-09-07T19:33:55.054 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.473+0000 7feed2d91700 1 -- 172.21.15.80:0/2867502969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 msgr2=0x7feecc0782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:55.055 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.473+0000 7feed2d91700 1 --2- 172.21.15.80:0/2867502969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc0782b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feec0009700 tx=0x7feec0009a10 comp rx=0 tx=0).stop 2022-09-07T19:33:55.055 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.474+0000 7feed2d91700 1 -- 172.21.15.80:0/2867502969 shutdown_connections 2022-09-07T19:33:55.055 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.474+0000 7feed2d91700 1 --2- 172.21.15.80:0/2867502969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc0782b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:55.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.474+0000 7feed2d91700 1 -- 172.21.15.80:0/2867502969 >> 172.21.15.80:0/2867502969 conn(0x7feecc0febf0 msgr2=0x7feecc101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:55.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.474+0000 7feed2d91700 1 -- 172.21.15.80:0/2867502969 shutdown_connections 2022-09-07T19:33:55.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.474+0000 7feed2d91700 1 -- 172.21.15.80:0/2867502969 wait complete. 2022-09-07T19:33:55.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.475+0000 7feed2d91700 1 Processor -- start 2022-09-07T19:33:55.057 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.475+0000 7feed2d91700 1 -- start start 2022-09-07T19:33:55.057 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.475+0000 7feed2d91700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:33:55.057 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.475+0000 7feed2d91700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc199730 con 0x7feecc079d30 2022-09-07T19:33:55.057 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.476+0000 7feed0b2d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:33:55.058 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.476+0000 7feed0b2d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42490/0 (socket says 172.21.15.80:42490) 2022-09-07T19:33:55.058 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.476+0000 7feed0b2d700 1 -- 172.21.15.80:0/971477680 learned_addr learned my addr 172.21.15.80:0/971477680 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:33:55.058 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.476+0000 7feed0b2d700 1 -- 172.21.15.80:0/971477680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00093e0 con 0x7feecc079d30 2022-09-07T19:33:55.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.476+0000 7feed0b2d700 1 --2- 172.21.15.80:0/971477680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc1991f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feec0003ea0 tx=0x7feec0003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:33:55.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0011840 con 0x7feecc079d30 2022-09-07T19:33:55.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc199930 con 0x7feecc079d30 2022-09-07T19:33:55.059 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7feec001a430 con 0x7feecc079d30 2022-09-07T19:33:55.060 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0019530 con 0x7feecc079d30 2022-09-07T19:33:55.060 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc199d60 con 0x7feecc079d30 2022-09-07T19:33:55.060 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7feec002a020 con 0x7feecc079d30 2022-09-07T19:33:55.060 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.477+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feec0019ab0 con 0x7feecc079d30 2022-09-07T19:33:55.060 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.478+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc060380 con 0x7feecc079d30 2022-09-07T19:33:55.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.482+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7feecc060380 con 0x7feecc079d30 2022-09-07T19:33:55.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.557+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7feecc109800 con 0x7feecc079d30 2022-09-07T19:33:55.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.557+0000 7feec9ffb700 1 -- 172.21.15.80:0/971477680 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1241 (secure 0 0 0) 0x7feec001a5a0 con 0x7feecc079d30 2022-09-07T19:33:55.061 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.558+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 msgr2=0x7feecc1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:33:55.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.558+0000 7feed2d91700 1 --2- 172.21.15.80:0/971477680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc1991f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feec0003ea0 tx=0x7feec0003f80 comp rx=0 tx=0).stop 2022-09-07T19:33:55.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.558+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 shutdown_connections 2022-09-07T19:33:55.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.558+0000 7feed2d91700 1 --2- 172.21.15.80:0/971477680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feecc079d30 0x7feecc1991f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:33:55.062 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.558+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 >> 172.21.15.80:0/971477680 conn(0x7feecc0febf0 msgr2=0x7feecc0ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:33:55.063 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.558+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 shutdown_connections 2022-09-07T19:33:55.063 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:33:54.559+0000 7feed2d91700 1 -- 172.21.15.80:0/971477680 wait complete. 2022-09-07T19:33:55.063 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (3/15)... 2022-09-07T19:33:55.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:55 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/971477680' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-09-07T19:33:55.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:55 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:55.026+0000 7f3875d46080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:33:55.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:55 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:55.384+0000 7f3875d46080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:33:56.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:33:56.404+0000 7f3875d46080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:33:56.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: Activating manager daemon x 2022-09-07T19:33:56.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: mgrmap e2: x(active, starting, since 0.00428352s) 2022-09-07T19:33:56.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-09-07T19:33:56.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-09-07T19:33:56.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-09-07T19:33:56.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:33:56.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-09-07T19:33:56.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: Manager daemon x is now available 2022-09-07T19:33:56.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:33:56.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:33:56.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' 2022-09-07T19:33:56.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' 2022-09-07T19:33:56.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:56 smithi080 ceph-mon[90124]: from='mgr.14100 172.21.15.80:0/2477078533' entity='mgr.x' 2022-09-07T19:33:58.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:58 smithi080 ceph-mon[90124]: mgrmap e3: x(active, since 1.01056s) 2022-09-07T19:33:59.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:33:59 smithi080 ceph-mon[90124]: mgrmap e4: x(active, since 2s) 2022-09-07T19:34:01.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:34:01.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:34:01.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:34:01.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2022-09-07T19:34:01.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2022-09-07T19:34:01.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2022-09-07T19:34:01.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2022-09-07T19:34:01.843 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.843 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2022-09-07T19:34:01.843 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2022-09-07T19:34:01.843 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2022-09-07T19:34:01.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:34:01.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2022-09-07T19:34:01.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2022-09-07T19:34:01.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:34:01.844 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2022-09-07T19:34:01.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2022-09-07T19:34:01.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:34:01.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2022-09-07T19:34:01.845 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2022-09-07T19:34:01.846 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.846 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2022-09-07T19:34:01.847 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:34:01.847 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2022-09-07T19:34:01.847 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2022-09-07T19:34:01.847 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2022-09-07T19:34:01.857 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2022-09-07T19:34:01.858 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2022-09-07T19:34:01.858 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2022-09-07T19:34:01.858 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.858 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2022-09-07T19:34:01.859 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2022-09-07T19:34:01.859 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2022-09-07T19:34:01.859 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2022-09-07T19:34:01.859 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2022-09-07T19:34:01.860 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2022-09-07T19:34:01.860 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2022-09-07T19:34:01.860 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2022-09-07T19:34:01.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2022-09-07T19:34:01.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2022-09-07T19:34:01.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:34:01.861 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2022-09-07T19:34:01.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2022-09-07T19:34:01.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2022-09-07T19:34:01.862 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2022-09-07T19:34:01.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2022-09-07T19:34:01.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2022-09-07T19:34:01.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2022-09-07T19:34:01.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2022-09-07T19:34:01.863 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2022-09-07T19:34:01.864 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2022-09-07T19:34:01.864 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:34:01.864 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.864 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2022-09-07T19:34:01.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2022-09-07T19:34:01.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2022-09-07T19:33:38.885187+0000", 2022-09-07T19:34:01.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2022-09-07T19:34:01.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2022-09-07T19:34:01.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2022-09-07T19:34:01.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:34:01.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.110+0000 7f471725a700 1 Processor -- start 2022-09-07T19:34:01.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.110+0000 7f471725a700 1 -- start start 2022-09-07T19:34:01.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.111+0000 7f471725a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f4710105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:01.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.111+0000 7f471725a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4710106120 con 0x7f47101057d0 2022-09-07T19:34:01.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.111+0000 7f4714ff6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f4710105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:01.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.112+0000 7f4714ff6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f4710105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42556/0 (socket says 172.21.15.80:42556) 2022-09-07T19:34:01.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.112+0000 7f4714ff6700 1 -- 172.21.15.80:0/3524455256 learned_addr learned my addr 172.21.15.80:0/3524455256 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:01.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.112+0000 7f4714ff6700 1 -- 172.21.15.80:0/3524455256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710106260 con 0x7f47101057d0 2022-09-07T19:34:01.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.112+0000 7f4714ff6700 1 --2- 172.21.15.80:0/3524455256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f4710105be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4704009700 tx=0x7f4704009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d3bad493d1221a server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:01.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f470f7fe700 1 -- 172.21.15.80:0/3524455256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4704004160 con 0x7f47101057d0 2022-09-07T19:34:01.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f470f7fe700 1 -- 172.21.15.80:0/3524455256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f47040042c0 con 0x7f47101057d0 2022-09-07T19:34:01.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f470f7fe700 1 -- 172.21.15.80:0/3524455256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47040039d0 con 0x7f47101057d0 2022-09-07T19:34:01.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 -- 172.21.15.80:0/3524455256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 msgr2=0x7f4710105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:01.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 --2- 172.21.15.80:0/3524455256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f4710105be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4704009700 tx=0x7f4704009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:01.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 -- 172.21.15.80:0/3524455256 shutdown_connections 2022-09-07T19:34:01.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 --2- 172.21.15.80:0/3524455256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f4710105be0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:01.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 -- 172.21.15.80:0/3524455256 >> 172.21.15.80:0/3524455256 conn(0x7f4710078c20 msgr2=0x7f4710079040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:01.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 -- 172.21.15.80:0/3524455256 shutdown_connections 2022-09-07T19:34:01.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.113+0000 7f471725a700 1 -- 172.21.15.80:0/3524455256 wait complete. 2022-09-07T19:34:01.871 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.114+0000 7f471725a700 1 Processor -- start 2022-09-07T19:34:01.871 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.115+0000 7f471725a700 1 -- start start 2022-09-07T19:34:01.871 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.115+0000 7f471725a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f47101991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:01.872 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.115+0000 7f471725a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47101996f0 con 0x7f47101057d0 2022-09-07T19:34:01.872 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.115+0000 7f4714ff6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f47101991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:01.872 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.115+0000 7f4714ff6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f47101991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42572/0 (socket says 172.21.15.80:42572) 2022-09-07T19:34:01.872 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.115+0000 7f4714ff6700 1 -- 172.21.15.80:0/1489030394 learned_addr learned my addr 172.21.15.80:0/1489030394 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:01.872 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f4714ff6700 1 -- 172.21.15.80:0/1489030394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040093e0 con 0x7f47101057d0 2022-09-07T19:34:01.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f4714ff6700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f47101991b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4704003fb0 tx=0x7f4704004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:01.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47040118c0 con 0x7f47101057d0 2022-09-07T19:34:01.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f4704011a20 con 0x7f47101057d0 2022-09-07T19:34:01.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47101998f0 con 0x7f47101057d0 2022-09-07T19:34:01.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4704019550 con 0x7f47101057d0 2022-09-07T19:34:01.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.116+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4710199d20 con 0x7f47101057d0 2022-09-07T19:34:01.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.117+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 42679+0+0 (secure 0 0 0) 0x7f470402a020 con 0x7f47101057d0 2022-09-07T19:34:01.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.117+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47101075b0 con 0x7f47101057d0 2022-09-07T19:34:01.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.118+0000 7f470dffb700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f46f40357d0 0x7f46f4037c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:01.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.118+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4704048970 con 0x7f47101057d0 2022-09-07T19:34:01.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.118+0000 7f470ffff700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f46f40357d0 0x7f46f4037c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:01.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.119+0000 7f470ffff700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f46f40357d0 0x7f46f4037c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009750 tx=0x7f46fc006cc0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:01.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.124+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f4704018b40 con 0x7f47101057d0 2022-09-07T19:34:01.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.399+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f471019cb60 con 0x7f47101057d0 2022-09-07T19:34:01.877 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.400+0000 7f470dffb700 1 -- 172.21.15.80:0/1489030394 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7f4704018b40 con 0x7f47101057d0 2022-09-07T19:34:01.877 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f46f40357d0 msgr2=0x7f46f4037c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:01.877 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f46f40357d0 0x7f46f4037c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009750 tx=0x7f46fc006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:01.877 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 msgr2=0x7f47101991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:01.878 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f47101991b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4704003fb0 tx=0x7f4704004090 comp rx=0 tx=0).stop 2022-09-07T19:34:01.878 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 shutdown_connections 2022-09-07T19:34:01.878 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f46f40357d0 0x7f46f4037c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:01.878 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 --2- 172.21.15.80:0/1489030394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47101057d0 0x7f47101991b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:01.879 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 >> 172.21.15.80:0/1489030394 conn(0x7f4710078c20 msgr2=0x7f47101036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:01.879 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 shutdown_connections 2022-09-07T19:34:01.879 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:01.402+0000 7f471725a700 1 -- 172.21.15.80:0/1489030394 wait complete. 2022-09-07T19:34:01.880 INFO:teuthology.orchestra.run.smithi080.stdout:mgr is available 2022-09-07T19:34:01.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:01 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1489030394' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-09-07T19:34:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:02 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/61863178' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-09-07T19:34:03.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:34:03.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [global] 2022-09-07T19:34:03.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout fsid = cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:34:03.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2022-09-07T19:34:03.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2022-09-07T19:34:03.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2022-09-07T19:34:03.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2022-09-07T19:34:03.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:34:03.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [mgr] 2022-09-07T19:34:03.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2022-09-07T19:34:03.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2022-09-07T19:34:03.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [osd] 2022-09-07T19:34:03.155 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2022-09-07T19:34:03.155 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2022-09-07T19:34:03.155 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2022-09-07T19:34:03.155 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2022-09-07T19:34:03.155 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2022-09-07T19:34:03.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.450+0000 7f4ca47f0700 1 Processor -- start 2022-09-07T19:34:03.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.451+0000 7f4ca47f0700 1 -- start start 2022-09-07T19:34:03.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.451+0000 7f4ca47f0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:03.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.451+0000 7f4ca47f0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c106120 con 0x7f4c9c1057d0 2022-09-07T19:34:03.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.452+0000 7f4ca258c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:03.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.452+0000 7f4ca258c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42574/0 (socket says 172.21.15.80:42574) 2022-09-07T19:34:03.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.452+0000 7f4ca258c700 1 -- 172.21.15.80:0/763550462 learned_addr learned my addr 172.21.15.80:0/763550462 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:03.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.452+0000 7f4ca258c700 1 -- 172.21.15.80:0/763550462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c106260 con 0x7f4c9c1057d0 2022-09-07T19:34:03.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.452+0000 7f4ca258c700 1 --2- 172.21.15.80:0/763550462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c105be0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009700 tx=0x7f4c98009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b608159ac50f59 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:03.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca158a700 1 -- 172.21.15.80:0/763550462 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c98004160 con 0x7f4c9c1057d0 2022-09-07T19:34:03.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca158a700 1 -- 172.21.15.80:0/763550462 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f4c980042c0 con 0x7f4c9c1057d0 2022-09-07T19:34:03.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca158a700 1 -- 172.21.15.80:0/763550462 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c980039d0 con 0x7f4c9c1057d0 2022-09-07T19:34:03.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca47f0700 1 -- 172.21.15.80:0/763550462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 msgr2=0x7f4c9c105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:03.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca47f0700 1 --2- 172.21.15.80:0/763550462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c105be0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009700 tx=0x7f4c98009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:03.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca47f0700 1 -- 172.21.15.80:0/763550462 shutdown_connections 2022-09-07T19:34:03.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca47f0700 1 --2- 172.21.15.80:0/763550462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c105be0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:03.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.453+0000 7f4ca47f0700 1 -- 172.21.15.80:0/763550462 >> 172.21.15.80:0/763550462 conn(0x7f4c9c078c20 msgr2=0x7f4c9c079040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:03.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.454+0000 7f4ca47f0700 1 -- 172.21.15.80:0/763550462 shutdown_connections 2022-09-07T19:34:03.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.454+0000 7f4ca47f0700 1 -- 172.21.15.80:0/763550462 wait complete. 2022-09-07T19:34:03.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.455+0000 7f4ca47f0700 1 Processor -- start 2022-09-07T19:34:03.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.455+0000 7f4ca47f0700 1 -- start start 2022-09-07T19:34:03.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.455+0000 7f4ca47f0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:03.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.455+0000 7f4ca47f0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c1996e0 con 0x7f4c9c1057d0 2022-09-07T19:34:03.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.456+0000 7f4ca258c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:03.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.456+0000 7f4ca258c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42588/0 (socket says 172.21.15.80:42588) 2022-09-07T19:34:03.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.456+0000 7f4ca258c700 1 -- 172.21.15.80:0/61863178 learned_addr learned my addr 172.21.15.80:0/61863178 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:03.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.456+0000 7f4ca258c700 1 -- 172.21.15.80:0/61863178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980093e0 con 0x7f4c9c1057d0 2022-09-07T19:34:03.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.456+0000 7f4ca258c700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c1991a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c98003fb0 tx=0x7f4c98004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:03.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.457+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c980118c0 con 0x7f4c9c1057d0 2022-09-07T19:34:03.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.457+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f4c98011a20 con 0x7f4c9c1057d0 2022-09-07T19:34:03.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.457+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c1998e0 con 0x7f4c9c1057d0 2022-09-07T19:34:03.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.457+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c98019550 con 0x7f4c9c1057d0 2022-09-07T19:34:03.164 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.457+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c199d10 con 0x7f4c9c1057d0 2022-09-07T19:34:03.164 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.458+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 42679+0+0 (secure 0 0 0) 0x7f4c9802a020 con 0x7f4c9c1057d0 2022-09-07T19:34:03.164 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.458+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c060310 con 0x7f4c9c1057d0 2022-09-07T19:34:03.164 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.458+0000 7f4c8b7fe700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f4c840357d0 0x7f4c84037c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:03.165 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.458+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4c98048950 con 0x7f4c9c1057d0 2022-09-07T19:34:03.165 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.459+0000 7f4ca1d8b700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f4c840357d0 0x7f4c84037c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:03.165 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.459+0000 7f4ca1d8b700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f4c840357d0 0x7f4c84037c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009750 tx=0x7f4c8c006cc0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:03.165 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.463+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f4c98018d20 con 0x7f4c9c1057d0 2022-09-07T19:34:03.166 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.665+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f4c9c19cd20 con 0x7f4c9c1057d0 2022-09-07T19:34:03.166 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.666+0000 7f4c8b7fe700 1 -- 172.21.15.80:0/61863178 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f4c98018b40 con 0x7f4c9c1057d0 2022-09-07T19:34:03.166 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.668+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f4c840357d0 msgr2=0x7f4c84037c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:03.166 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.668+0000 7f4ca47f0700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f4c840357d0 0x7f4c84037c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009750 tx=0x7f4c8c006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:03.167 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.668+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 msgr2=0x7f4c9c1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:03.167 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.668+0000 7f4ca47f0700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c1991a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c98003fb0 tx=0x7f4c98004090 comp rx=0 tx=0).stop 2022-09-07T19:34:03.167 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.669+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 shutdown_connections 2022-09-07T19:34:03.167 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.669+0000 7f4ca47f0700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f4c840357d0 0x7f4c84037c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:03.167 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.669+0000 7f4ca47f0700 1 --2- 172.21.15.80:0/61863178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9c1057d0 0x7f4c9c1991a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:03.168 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.669+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 >> 172.21.15.80:0/61863178 conn(0x7f4c9c078c20 msgr2=0x7f4c9c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:03.168 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.669+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 shutdown_connections 2022-09-07T19:34:03.168 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:02.669+0000 7f4ca47f0700 1 -- 172.21.15.80:0/61863178 wait complete. 2022-09-07T19:34:03.168 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling cephadm module... 2022-09-07T19:34:04.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2145062557' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2022-09-07T19:34:04.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: ignoring --setuser ceph since I am not root 2022-09-07T19:34:04.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: ignoring --setgroup ceph since I am not root 2022-09-07T19:34:04.556 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.758+0000 7fa4f3082700 1 Processor -- start 2022-09-07T19:34:04.558 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.759+0000 7fa4f3082700 1 -- start start 2022-09-07T19:34:04.558 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.759+0000 7fa4f3082700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec0782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:04.558 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.759+0000 7fa4f3082700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec07a140 con 0x7fa4ec079d30 2022-09-07T19:34:04.559 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.759+0000 7fa4f0e1e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec0782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:04.559 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.759+0000 7fa4f0e1e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec0782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41518/0 (socket says 172.21.15.80:41518) 2022-09-07T19:34:04.560 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.759+0000 7fa4f0e1e700 1 -- 172.21.15.80:0/1846449758 learned_addr learned my addr 172.21.15.80:0/1846449758 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:04.560 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.760+0000 7fa4f0e1e700 1 -- 172.21.15.80:0/1846449758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0787f0 con 0x7fa4ec079d30 2022-09-07T19:34:04.561 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.760+0000 7fa4f0e1e700 1 --2- 172.21.15.80:0/1846449758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec0782b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009700 tx=0x7fa4e0009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cd01b53323d110 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:04.561 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.760+0000 7fa4eb7fe700 1 -- 172.21.15.80:0/1846449758 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0004160 con 0x7fa4ec079d30 2022-09-07T19:34:04.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.760+0000 7fa4eb7fe700 1 -- 172.21.15.80:0/1846449758 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fa4e00042c0 con 0x7fa4ec079d30 2022-09-07T19:34:04.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.760+0000 7fa4eb7fe700 1 -- 172.21.15.80:0/1846449758 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4e00039d0 con 0x7fa4ec079d30 2022-09-07T19:34:04.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 -- 172.21.15.80:0/1846449758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 msgr2=0x7fa4ec0782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 --2- 172.21.15.80:0/1846449758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec0782b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009700 tx=0x7fa4e0009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 -- 172.21.15.80:0/1846449758 shutdown_connections 2022-09-07T19:34:04.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 --2- 172.21.15.80:0/1846449758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec0782b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:04.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 -- 172.21.15.80:0/1846449758 >> 172.21.15.80:0/1846449758 conn(0x7fa4ec0febf0 msgr2=0x7fa4ec101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:04.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 -- 172.21.15.80:0/1846449758 shutdown_connections 2022-09-07T19:34:04.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.761+0000 7fa4f3082700 1 -- 172.21.15.80:0/1846449758 wait complete. 2022-09-07T19:34:04.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.762+0000 7fa4f3082700 1 Processor -- start 2022-09-07T19:34:04.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.762+0000 7fa4f3082700 1 -- start start 2022-09-07T19:34:04.567 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.763+0000 7fa4f3082700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:04.567 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.763+0000 7fa4f3082700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec199770 con 0x7fa4ec079d30 2022-09-07T19:34:04.567 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.763+0000 7fa4f0e1e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:04.567 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.763+0000 7fa4f0e1e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41528/0 (socket says 172.21.15.80:41528) 2022-09-07T19:34:04.568 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.763+0000 7fa4f0e1e700 1 -- 172.21.15.80:0/2145062557 learned_addr learned my addr 172.21.15.80:0/2145062557 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:04.568 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.763+0000 7fa4f0e1e700 1 -- 172.21.15.80:0/2145062557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00093e0 con 0x7fa4ec079d30 2022-09-07T19:34:04.568 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.764+0000 7fa4f0e1e700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec199230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009e90 tx=0x7fa4e0003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:04.568 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.764+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0004140 con 0x7fa4ec079d30 2022-09-07T19:34:04.568 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.764+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fa4e0011cc0 con 0x7fa4ec079d30 2022-09-07T19:34:04.569 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.764+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4e00193c0 con 0x7fa4ec079d30 2022-09-07T19:34:04.569 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.764+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec199970 con 0x7fa4ec079d30 2022-09-07T19:34:04.569 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.764+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec199da0 con 0x7fa4ec079d30 2022-09-07T19:34:04.569 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.765+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 42679+0+0 (secure 0 0 0) 0x7fa4e002a020 con 0x7fa4ec079d30 2022-09-07T19:34:04.570 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.765+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec060310 con 0x7fa4ec079d30 2022-09-07T19:34:04.570 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.766+0000 7fa4e9ffb700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7fa4d00357d0 0x7fa4d0037c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:04.570 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.766+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa4e0048860 con 0x7fa4ec079d30 2022-09-07T19:34:04.570 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.766+0000 7fa4ebfff700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7fa4d00357d0 0x7fa4d0037c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:04.571 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.767+0000 7fa4ebfff700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7fa4d00357d0 0x7fa4d0037c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009750 tx=0x7fa4d8006cc0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:04.571 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:03.770+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa4e0011840 con 0x7fa4ec079d30 2022-09-07T19:34:04.571 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.032+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa4ec19cbe0 con 0x7fa4ec079d30 2022-09-07T19:34:04.571 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.085+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 5) v1 ==== 42690+0+0 (secure 0 0 0) 0x7fa4e0017020 con 0x7fa4ec079d30 2022-09-07T19:34:04.572 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.087+0000 7fa4e9ffb700 1 -- 172.21.15.80:0/2145062557 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa4e0018350 con 0x7fa4ec079d30 2022-09-07T19:34:04.572 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7fa4d00357d0 msgr2=0x7fa4d0037c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:04.572 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7fa4d00357d0 0x7fa4d0037c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009750 tx=0x7fa4d8006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:04.572 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 msgr2=0x7fa4ec199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:04.572 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec199230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009e90 tx=0x7fa4e0003f20 comp rx=0 tx=0).stop 2022-09-07T19:34:04.573 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 shutdown_connections 2022-09-07T19:34:04.573 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7fa4d00357d0 0x7fa4d0037c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:04.574 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 --2- 172.21.15.80:0/2145062557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec079d30 0x7fa4ec199230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:04.574 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.089+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 >> 172.21.15.80:0/2145062557 conn(0x7fa4ec0febf0 msgr2=0x7fa4ec100290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:04.574 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.090+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 shutdown_connections 2022-09-07T19:34:04.574 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:04.090+0000 7fa4f3082700 1 -- 172.21.15.80:0/2145062557 wait complete. 2022-09-07T19:34:04.719 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:04.461+0000 7f9ceb82a080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:34:04.719 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:04.578+0000 7f9ceb82a080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:34:05.088 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:04.719+0000 7f9ceb82a080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:34:05.088 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:04 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:04.852+0000 7f9ceb82a080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:34:05.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:05 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:05.132+0000 7f9ceb82a080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:34:05.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:05 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2145062557' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2022-09-07T19:34:05.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:05 smithi080 ceph-mon[90124]: mgrmap e5: x(active, since 7s) 2022-09-07T19:34:05.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:05 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:05.582+0000 7f9ceb82a080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:34:05.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:05 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:05.727+0000 7f9ceb82a080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:34:05.961 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:34:05.961 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 5, 2022-09-07T19:34:05.961 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2022-09-07T19:34:05.961 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "active_name": "x", 2022-09-07T19:34:05.962 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standby": 0 2022-09-07T19:34:05.962 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:34:05.962 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.178+0000 7f6cbddb8700 1 Processor -- start 2022-09-07T19:34:05.962 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.179+0000 7f6cbddb8700 1 -- start start 2022-09-07T19:34:05.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.179+0000 7f6cbddb8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb8105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:05.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.179+0000 7f6cbddb8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8106120 con 0x7f6cb81057d0 2022-09-07T19:34:05.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.179+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb8105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:05.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.179+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb8105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41564/0 (socket says 172.21.15.80:41564) 2022-09-07T19:34:05.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.179+0000 7f6cb77fe700 1 -- 172.21.15.80:0/2584543502 learned_addr learned my addr 172.21.15.80:0/2584543502 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:05.964 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.180+0000 7f6cb77fe700 1 -- 172.21.15.80:0/2584543502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8106260 con 0x7f6cb81057d0 2022-09-07T19:34:05.964 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.180+0000 7f6cb77fe700 1 --2- 172.21.15.80:0/2584543502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb8105be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009700 tx=0x7f6ca8009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820a435e5772e41a server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:05.964 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.180+0000 7f6cb67fc700 1 -- 172.21.15.80:0/2584543502 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8004160 con 0x7f6cb81057d0 2022-09-07T19:34:05.964 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.180+0000 7f6cb67fc700 1 -- 172.21.15.80:0/2584543502 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f6ca80042c0 con 0x7f6cb81057d0 2022-09-07T19:34:05.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.180+0000 7f6cb67fc700 1 -- 172.21.15.80:0/2584543502 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ca80039d0 con 0x7f6cb81057d0 2022-09-07T19:34:05.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 -- 172.21.15.80:0/2584543502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 msgr2=0x7f6cb8105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:05.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 --2- 172.21.15.80:0/2584543502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb8105be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009700 tx=0x7f6ca8009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:05.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 -- 172.21.15.80:0/2584543502 shutdown_connections 2022-09-07T19:34:05.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 --2- 172.21.15.80:0/2584543502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb8105be0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:05.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 -- 172.21.15.80:0/2584543502 >> 172.21.15.80:0/2584543502 conn(0x7f6cb8078c20 msgr2=0x7f6cb8079040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:05.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 -- 172.21.15.80:0/2584543502 shutdown_connections 2022-09-07T19:34:05.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.181+0000 7f6cbddb8700 1 -- 172.21.15.80:0/2584543502 wait complete. 2022-09-07T19:34:05.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cbddb8700 1 Processor -- start 2022-09-07T19:34:05.967 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cbddb8700 1 -- start start 2022-09-07T19:34:05.967 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cbddb8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:05.968 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cbddb8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb81996f0 con 0x7f6cb81057d0 2022-09-07T19:34:05.968 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:05.968 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb81991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41578/0 (socket says 172.21.15.80:41578) 2022-09-07T19:34:05.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.183+0000 7f6cb77fe700 1 -- 172.21.15.80:0/4246251625 learned_addr learned my addr 172.21.15.80:0/4246251625 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:05.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.184+0000 7f6cb77fe700 1 -- 172.21.15.80:0/4246251625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80093e0 con 0x7f6cb81057d0 2022-09-07T19:34:05.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.184+0000 7f6cb77fe700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb81991b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8003fb0 tx=0x7f6ca8004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:05.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.184+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ca80118c0 con 0x7f6cb81057d0 2022-09-07T19:34:05.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.184+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f6ca8011a20 con 0x7f6cb81057d0 2022-09-07T19:34:05.970 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.184+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb81998f0 con 0x7f6cb81057d0 2022-09-07T19:34:05.970 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.185+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8019550 con 0x7f6cb81057d0 2022-09-07T19:34:05.970 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.185+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb8199d20 con 0x7f6cb81057d0 2022-09-07T19:34:05.970 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.186+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb81075b0 con 0x7f6cb81057d0 2022-09-07T19:34:05.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.186+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f6ca802a020 con 0x7f6cb81057d0 2022-09-07T19:34:05.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.186+0000 7f6cb4ff9700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 0x7f6ca4037c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:05.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.186+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6ca8048c20 con 0x7f6cb81057d0 2022-09-07T19:34:05.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.187+0000 7f6cb6ffd700 1 -- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 msgr2=0x7f6ca4037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:05.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.187+0000 7f6cb6ffd700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 0x7f6ca4037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:34:05.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.191+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f6ca801a610 con 0x7f6cb81057d0 2022-09-07T19:34:05.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.388+0000 7f6cb6ffd700 1 -- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 msgr2=0x7f6ca4037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:05.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.388+0000 7f6cb6ffd700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 0x7f6ca4037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:34:05.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.463+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f6cb819cb60 con 0x7f6cb81057d0 2022-09-07T19:34:05.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.463+0000 7f6cb4ff9700 1 -- 172.21.15.80:0/4246251625 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f6ca802b340 con 0x7f6cb81057d0 2022-09-07T19:34:05.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 msgr2=0x7f6ca4037c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:34:05.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 0x7f6ca4037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:05.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 msgr2=0x7f6cb81991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:05.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb81991b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8003fb0 tx=0x7f6ca8004090 comp rx=0 tx=0).stop 2022-09-07T19:34:05.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 shutdown_connections 2022-09-07T19:34:05.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f6ca40357d0 0x7f6ca4037c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:05.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 --2- 172.21.15.80:0/4246251625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb81057d0 0x7f6cb81991b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:05.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 >> 172.21.15.80:0/4246251625 conn(0x7f6cb8078c20 msgr2=0x7f6cb81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:05.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 shutdown_connections 2022-09-07T19:34:05.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:05.466+0000 7f6cbddb8700 1 -- 172.21.15.80:0/4246251625 wait complete. 2022-09-07T19:34:05.975 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for the mgr to restart... 2022-09-07T19:34:05.975 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr epoch 5... 2022-09-07T19:34:06.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:06 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4246251625' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-09-07T19:34:06.258 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:05 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:05.909+0000 7f9ceb82a080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:34:06.258 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:06 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:06.057+0000 7f9ceb82a080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:34:07.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:06 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:06.687+0000 7f9ceb82a080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:34:07.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:07 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:07.500+0000 7f9ceb82a080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:34:07.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:07 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:07.733+0000 7f9ceb82a080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:34:09.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:08 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:08.786+0000 7f9ceb82a080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:34:09.119 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:08 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:08.934+0000 7f9ceb82a080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:34:09.519 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:09 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:09.211+0000 7f9ceb82a080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:34:09.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:09 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:09.519+0000 7f9ceb82a080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:34:09.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:09 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:09.747+0000 7f9ceb82a080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:34:10.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:10 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:10.336+0000 7f9ceb82a080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:34:11.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:11 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:11.237+0000 7f9ceb82a080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:34:11.986 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:11 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:11.660+0000 7f9ceb82a080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:34:12.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:11 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:11.986+0000 7f9ceb82a080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:34:12.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:12 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:12.173+0000 7f9ceb82a080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:34:12.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:12 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:12.529+0000 7f9ceb82a080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:34:13.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:13 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:13.525+0000 7f9ceb82a080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:34:13.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:13 smithi080 ceph-mon[90124]: Active manager daemon x restarted 2022-09-07T19:34:13.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:13 smithi080 ceph-mon[90124]: Activating manager daemon x 2022-09-07T19:34:13.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:13 smithi080 ceph-mon[90124]: osdmap e2: 0 total, 0 up, 0 in 2022-09-07T19:34:14.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: mgrmap e6: x(active, starting, since 0.053232s) 2022-09-07T19:34:14.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:34:14.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-09-07T19:34:14.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-09-07T19:34:14.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-09-07T19:34:14.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-09-07T19:34:14.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: Manager daemon x is now available 2022-09-07T19:34:14.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:14.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:14.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:14.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:14.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:14.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:34:14.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:14 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:34:15.088 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:34:15.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2022-09-07T19:34:15.089 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "initialized": true 2022-09-07T19:34:15.090 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:34:15.090 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.577+0000 7f1ebefd3700 1 Processor -- start 2022-09-07T19:34:15.090 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.577+0000 7f1ebefd3700 1 -- start start 2022-09-07T19:34:15.091 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.578+0000 7f1ebefd3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:15.091 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.578+0000 7f1ebefd3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8103e50 con 0x7f1eb8103500 2022-09-07T19:34:15.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.578+0000 7f1ebcd6f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:15.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.578+0000 7f1ebcd6f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41582/0 (socket says 172.21.15.80:41582) 2022-09-07T19:34:15.092 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.578+0000 7f1ebcd6f700 1 -- 172.21.15.80:0/2687766225 learned_addr learned my addr 172.21.15.80:0/2687766225 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:15.093 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.579+0000 7f1ebcd6f700 1 -- 172.21.15.80:0/2687766225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8103f90 con 0x7f1eb8103500 2022-09-07T19:34:15.093 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.579+0000 7f1ebcd6f700 1 --2- 172.21.15.80:0/2687766225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8103910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009700 tx=0x7f1eac009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dec3c920948da32 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:15.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.579+0000 7f1eb77fe700 1 -- 172.21.15.80:0/2687766225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1eac004160 con 0x7f1eb8103500 2022-09-07T19:34:15.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.579+0000 7f1eb77fe700 1 -- 172.21.15.80:0/2687766225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f1eac0042c0 con 0x7f1eb8103500 2022-09-07T19:34:15.094 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.579+0000 7f1eb77fe700 1 -- 172.21.15.80:0/2687766225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1eac0039d0 con 0x7f1eb8103500 2022-09-07T19:34:15.095 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 -- 172.21.15.80:0/2687766225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 msgr2=0x7f1eb8103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:15.095 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/2687766225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8103910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009700 tx=0x7f1eac009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:15.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 -- 172.21.15.80:0/2687766225 shutdown_connections 2022-09-07T19:34:15.096 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/2687766225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8103910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:15.097 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 -- 172.21.15.80:0/2687766225 >> 172.21.15.80:0/2687766225 conn(0x7f1eb80febf0 msgr2=0x7f1eb8101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:15.097 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 -- 172.21.15.80:0/2687766225 shutdown_connections 2022-09-07T19:34:15.098 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.580+0000 7f1ebefd3700 1 -- 172.21.15.80:0/2687766225 wait complete. 2022-09-07T19:34:15.098 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.581+0000 7f1ebefd3700 1 Processor -- start 2022-09-07T19:34:15.099 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.582+0000 7f1ebefd3700 1 -- start start 2022-09-07T19:34:15.099 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.582+0000 7f1ebefd3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:15.099 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.582+0000 7f1ebefd3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8197510 con 0x7f1eb8103500 2022-09-07T19:34:15.100 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.582+0000 7f1ebcd6f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:15.100 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.582+0000 7f1ebcd6f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41594/0 (socket says 172.21.15.80:41594) 2022-09-07T19:34:15.100 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.582+0000 7f1ebcd6f700 1 -- 172.21.15.80:0/293809942 learned_addr learned my addr 172.21.15.80:0/293809942 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:15.101 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1ebcd6f700 1 -- 172.21.15.80:0/293809942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac0093e0 con 0x7f1eb8103500 2022-09-07T19:34:15.101 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1ebcd6f700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8196fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1eac003fb0 tx=0x7f1eac004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:15.102 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1eac0118c0 con 0x7f1eb8103500 2022-09-07T19:34:15.102 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb8197710 con 0x7f1eb8103500 2022-09-07T19:34:15.102 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f1eac011a20 con 0x7f1eb8103500 2022-09-07T19:34:15.103 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1eac019550 con 0x7f1eb8103500 2022-09-07T19:34:15.103 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.583+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb8197b40 con 0x7f1eb8103500 2022-09-07T19:34:15.103 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.585+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f1eac02a020 con 0x7f1eb8103500 2022-09-07T19:34:15.103 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.585+0000 7f1eb5ffb700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:15.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.585+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 --> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e9c038390 con 0x7f1e9c0357d0 2022-09-07T19:34:15.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.585+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1eac048a30 con 0x7f1eb8103500 2022-09-07T19:34:15.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.585+0000 7f1eb7fff700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:15.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.585+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:34:15.104 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.786+0000 7f1eb7fff700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:15.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:06.786+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:34:15.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:07.187+0000 7f1eb7fff700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:15.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:07.187+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-09-07T19:34:15.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:07.988+0000 7f1eb7fff700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:15.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:07.988+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-09-07T19:34:15.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:09.588+0000 7f1eb7fff700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:15.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:09.588+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2022-09-07T19:34:15.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:12.792+0000 7f1eb7fff700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2842896476 2022-09-07T19:34:15.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:12.792+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2022-09-07T19:34:15.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:13.580+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 6) v1 ==== 42500+0+0 (secure 0 0 0) 0x7f1eac017020 con 0x7f1eb8103500 2022-09-07T19:34:15.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:13.580+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 msgr2=0x7f1e9c037c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:34:15.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:13.580+0000 7f1eb5ffb700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:15.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.587+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 7) v1 ==== 42610+0+0 (secure 0 0 0) 0x7f1eac00f050 con 0x7f1eb8103500 2022-09-07T19:34:15.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.588+0000 7f1eb5ffb700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f1e9c038fc0 0x7f1e9c03b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:15.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.588+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e9c038390 con 0x7f1e9c038fc0 2022-09-07T19:34:15.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.589+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f1e9c038fc0 0x7f1e9c03b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:15.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.590+0000 7f1eb7fff700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f1e9c038fc0 0x7f1e9c03b3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4006fd0 tx=0x7f1ea4006dc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:15.109 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.591+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6424 (secure 0 0 0) 0x7f1e9c038390 con 0x7f1e9c038fc0 2022-09-07T19:34:15.109 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.597+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1eb8198300 con 0x7f1e9c038fc0 2022-09-07T19:34:15.109 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1eb5ffb700 1 -- 172.21.15.80:0/293809942 <== mgr.14120 v2:172.21.15.80:6800/1499799081 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1eb8198300 con 0x7f1e9c038fc0 2022-09-07T19:34:15.109 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f1e9c038fc0 msgr2=0x7f1e9c03b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:15.109 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f1e9c038fc0 0x7f1e9c03b3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4006fd0 tx=0x7f1ea4006dc0 comp rx=0 tx=0).stop 2022-09-07T19:34:15.110 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 msgr2=0x7f1eb8196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:15.110 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8196fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1eac003fb0 tx=0x7f1eac004090 comp rx=0 tx=0).stop 2022-09-07T19:34:15.110 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 shutdown_connections 2022-09-07T19:34:15.110 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f1e9c038fc0 0x7f1e9c03b3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:15.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb8103500 0x7f1eb8196fd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:15.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 --2- 172.21.15.80:0/293809942 >> [v2:172.21.15.80:6800/2842896476,v1:172.21.15.80:6801/2842896476] conn(0x7f1e9c0357d0 0x7f1e9c037c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:15.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 >> 172.21.15.80:0/293809942 conn(0x7f1eb80febf0 msgr2=0x7f1eb80ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:15.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.598+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 shutdown_connections 2022-09-07T19:34:15.112 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:14.599+0000 7f1ebefd3700 1 -- 172.21.15.80:0/293809942 wait complete. 2022-09-07T19:34:15.112 INFO:teuthology.orchestra.run.smithi080.stdout:mgr epoch 5 is available 2022-09-07T19:34:15.112 INFO:teuthology.orchestra.run.smithi080.stdout:Setting orchestrator backend to cephadm... 2022-09-07T19:34:15.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:15 smithi080 ceph-mon[90124]: mgrmap e7: x(active, since 1.06284s) 2022-09-07T19:34:15.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:15 smithi080 ceph-mon[90124]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-09-07T19:34:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:15 smithi080 ceph-mon[90124]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-09-07T19:34:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:15 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:15 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:16.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.908+0000 7f2ccbd78700 1 Processor -- start 2022-09-07T19:34:16.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.908+0000 7f2ccbd78700 1 -- start start 2022-09-07T19:34:16.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.908+0000 7f2ccbd78700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc40782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:16.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.908+0000 7f2ccbd78700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc407a160 con 0x7f2cc4079d50 2022-09-07T19:34:16.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.909+0000 7f2cc9b14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc40782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:16.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.909+0000 7f2cc9b14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc40782d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38898/0 (socket says 172.21.15.80:38898) 2022-09-07T19:34:16.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.909+0000 7f2cc9b14700 1 -- 172.21.15.80:0/3171595032 learned_addr learned my addr 172.21.15.80:0/3171595032 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:16.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.909+0000 7f2cc9b14700 1 -- 172.21.15.80:0/3171595032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4078810 con 0x7f2cc4079d50 2022-09-07T19:34:16.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.910+0000 7f2cc9b14700 1 --2- 172.21.15.80:0/3171595032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc40782d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009700 tx=0x7f2cc0009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e49f94c7c32d68 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:16.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.910+0000 7f2cc8b12700 1 -- 172.21.15.80:0/3171595032 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc0004160 con 0x7f2cc4079d50 2022-09-07T19:34:16.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.910+0000 7f2cc8b12700 1 -- 172.21.15.80:0/3171595032 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f2cc00042c0 con 0x7f2cc4079d50 2022-09-07T19:34:16.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.910+0000 7f2cc8b12700 1 -- 172.21.15.80:0/3171595032 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc00039d0 con 0x7f2cc4079d50 2022-09-07T19:34:16.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3171595032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 msgr2=0x7f2cc40782d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 --2- 172.21.15.80:0/3171595032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc40782d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009700 tx=0x7f2cc0009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3171595032 shutdown_connections 2022-09-07T19:34:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 --2- 172.21.15.80:0/3171595032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc40782d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3171595032 >> 172.21.15.80:0/3171595032 conn(0x7f2cc40febf0 msgr2=0x7f2cc4101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3171595032 shutdown_connections 2022-09-07T19:34:16.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.911+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3171595032 wait complete. 2022-09-07T19:34:16.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.912+0000 7f2ccbd78700 1 Processor -- start 2022-09-07T19:34:16.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.912+0000 7f2ccbd78700 1 -- start start 2022-09-07T19:34:16.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.913+0000 7f2ccbd78700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:16.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.913+0000 7f2ccbd78700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4199740 con 0x7f2cc4079d50 2022-09-07T19:34:16.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.913+0000 7f2cc9b14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:16.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.913+0000 7f2cc9b14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc4199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38906/0 (socket says 172.21.15.80:38906) 2022-09-07T19:34:16.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.913+0000 7f2cc9b14700 1 -- 172.21.15.80:0/3157817802 learned_addr learned my addr 172.21.15.80:0/3157817802 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:16.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.913+0000 7f2cc9b14700 1 -- 172.21.15.80:0/3157817802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00093e0 con 0x7f2cc4079d50 2022-09-07T19:34:16.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.914+0000 7f2cc9b14700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc4199200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009e90 tx=0x7f2cc0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:16.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.914+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc0011840 con 0x7f2cc4079d50 2022-09-07T19:34:16.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.914+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f2cc001a430 con 0x7f2cc4079d50 2022-09-07T19:34:16.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.914+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc0019550 con 0x7f2cc4079d50 2022-09-07T19:34:16.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.914+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc4199940 con 0x7f2cc4079d50 2022-09-07T19:34:16.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.914+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc4199d70 con 0x7f2cc4079d50 2022-09-07T19:34:16.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.915+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f2cc002a020 con 0x7f2cc4079d50 2022-09-07T19:34:16.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.915+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4060310 con 0x7f2cc4079d50 2022-09-07T19:34:16.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.916+0000 7f2cb2ffd700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f2cac035770 0x7f2cac037c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:16.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.916+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2cc0048a80 con 0x7f2cc4079d50 2022-09-07T19:34:16.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.916+0000 7f2cc9313700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f2cac035770 0x7f2cac037c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:16.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.917+0000 7f2cc9313700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f2cac035770 0x7f2cac037c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009750 tx=0x7f2cb4006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:16.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:15.921+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f2cc00119a0 con 0x7f2cc4079d50 2022-09-07T19:34:16.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.159+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cc41000a0 con 0x7f2cac035770 2022-09-07T19:34:16.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.169+0000 7f2cb2ffd700 1 -- 172.21.15.80:0/3157817802 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2cc41000a0 con 0x7f2cac035770 2022-09-07T19:34:16.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f2cac035770 msgr2=0x7f2cac037c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:16.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f2cac035770 0x7f2cac037c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009750 tx=0x7f2cb4006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:16.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 msgr2=0x7f2cc4199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:16.598 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc4199200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009e90 tx=0x7f2cc0004040 comp rx=0 tx=0).stop 2022-09-07T19:34:16.598 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 shutdown_connections 2022-09-07T19:34:16.598 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f2cac035770 0x7f2cac037c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:16.599 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 --2- 172.21.15.80:0/3157817802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4079d50 0x7f2cc4199200 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:16.599 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 >> 172.21.15.80:0/3157817802 conn(0x7f2cc40febf0 msgr2=0x7f2cc40ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:16.599 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 shutdown_connections 2022-09-07T19:34:16.599 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:16.172+0000 7f2ccbd78700 1 -- 172.21.15.80:0/3157817802 wait complete. 2022-09-07T19:34:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: mgrmap e8: x(active, since 2s) 2022-09-07T19:34:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:16.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:16 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:17.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:17 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:16] ENGINE Bus STARTING 2022-09-07T19:34:17.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:17 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:16] ENGINE Serving on https://172.21.15.80:7150 2022-09-07T19:34:17.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:17 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:16] ENGINE Serving on https://:::8765 2022-09-07T19:34:17.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:17 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:16] ENGINE Bus STARTED 2022-09-07T19:34:17.898 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout value unchanged 2022-09-07T19:34:17.899 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.197+0000 7ff78dd5d700 1 Processor -- start 2022-09-07T19:34:17.899 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.197+0000 7ff78dd5d700 1 -- start start 2022-09-07T19:34:17.899 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.198+0000 7ff78dd5d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff788103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:17.899 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.198+0000 7ff78dd5d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788103e50 con 0x7ff788103500 2022-09-07T19:34:17.899 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.198+0000 7ff7877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff788103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:17.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.198+0000 7ff7877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff788103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38912/0 (socket says 172.21.15.80:38912) 2022-09-07T19:34:17.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.198+0000 7ff7877fe700 1 -- 172.21.15.80:0/2262735307 learned_addr learned my addr 172.21.15.80:0/2262735307 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:17.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.199+0000 7ff7877fe700 1 -- 172.21.15.80:0/2262735307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788103f90 con 0x7ff788103500 2022-09-07T19:34:17.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.199+0000 7ff7877fe700 1 --2- 172.21.15.80:0/2262735307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff788103910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff778009700 tx=0x7ff778009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88da719ad7493e14 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:17.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.199+0000 7ff7867fc700 1 -- 172.21.15.80:0/2262735307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff778004160 con 0x7ff788103500 2022-09-07T19:34:17.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.199+0000 7ff7867fc700 1 -- 172.21.15.80:0/2262735307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ff7780042c0 con 0x7ff788103500 2022-09-07T19:34:17.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.199+0000 7ff7867fc700 1 -- 172.21.15.80:0/2262735307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7780039d0 con 0x7ff788103500 2022-09-07T19:34:17.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2262735307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 msgr2=0x7ff788103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:17.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 --2- 172.21.15.80:0/2262735307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff788103910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff778009700 tx=0x7ff778009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:17.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2262735307 shutdown_connections 2022-09-07T19:34:17.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 --2- 172.21.15.80:0/2262735307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff788103910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:17.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2262735307 >> 172.21.15.80:0/2262735307 conn(0x7ff7880febf0 msgr2=0x7ff788101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:17.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2262735307 shutdown_connections 2022-09-07T19:34:17.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.200+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2262735307 wait complete. 2022-09-07T19:34:17.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.201+0000 7ff78dd5d700 1 Processor -- start 2022-09-07T19:34:17.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.201+0000 7ff78dd5d700 1 -- start start 2022-09-07T19:34:17.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.202+0000 7ff78dd5d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff7881991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:17.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.202+0000 7ff78dd5d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788199710 con 0x7ff788103500 2022-09-07T19:34:17.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.202+0000 7ff7877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff7881991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:17.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.202+0000 7ff7877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff7881991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38918/0 (socket says 172.21.15.80:38918) 2022-09-07T19:34:17.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.202+0000 7ff7877fe700 1 -- 172.21.15.80:0/2907118616 learned_addr learned my addr 172.21.15.80:0/2907118616 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:17.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.202+0000 7ff7877fe700 1 -- 172.21.15.80:0/2907118616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7780093e0 con 0x7ff788103500 2022-09-07T19:34:17.905 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.203+0000 7ff7877fe700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff7881991d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff778003fb0 tx=0x7ff778004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:17.905 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.203+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7780118c0 con 0x7ff788103500 2022-09-07T19:34:17.905 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.203+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ff778011a20 con 0x7ff788103500 2022-09-07T19:34:17.905 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.203+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff788199910 con 0x7ff788103500 2022-09-07T19:34:17.906 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.203+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff778019550 con 0x7ff788103500 2022-09-07T19:34:17.906 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.203+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff788199d40 con 0x7ff788103500 2022-09-07T19:34:17.906 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.204+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7ff77802a020 con 0x7ff788103500 2022-09-07T19:34:17.906 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.204+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff788060310 con 0x7ff788103500 2022-09-07T19:34:17.906 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.205+0000 7ff784ff9700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7ff7740357d0 0x7ff774037c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:17.907 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.205+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff778048b00 con 0x7ff788103500 2022-09-07T19:34:17.907 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.205+0000 7ff786ffd700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7ff7740357d0 0x7ff774037c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:17.907 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.205+0000 7ff786ffd700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7ff7740357d0 0x7ff774037c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009750 tx=0x7ff77c006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:17.907 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.209+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff77802b340 con 0x7ff788103500 2022-09-07T19:34:17.908 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.418+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff788100040 con 0x7ff7740357d0 2022-09-07T19:34:17.908 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.419+0000 7ff784ff9700 1 -- 172.21.15.80:0/2907118616 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff788100040 con 0x7ff7740357d0 2022-09-07T19:34:17.908 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7ff7740357d0 msgr2=0x7ff774037c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:17.908 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7ff7740357d0 0x7ff774037c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009750 tx=0x7ff77c006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:17.908 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 msgr2=0x7ff7881991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:17.909 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff7881991d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff778003fb0 tx=0x7ff778004090 comp rx=0 tx=0).stop 2022-09-07T19:34:17.909 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 shutdown_connections 2022-09-07T19:34:17.909 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7ff7740357d0 0x7ff774037c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:17.909 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 --2- 172.21.15.80:0/2907118616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff788103500 0x7ff7881991d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:17.909 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 >> 172.21.15.80:0/2907118616 conn(0x7ff7880febf0 msgr2=0x7ff7880ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:17.910 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.421+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 shutdown_connections 2022-09-07T19:34:17.910 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:17.422+0000 7ff78dd5d700 1 -- 172.21.15.80:0/2907118616 wait complete. 2022-09-07T19:34:17.910 INFO:teuthology.orchestra.run.smithi080.stdout:Generating ssh key... 2022-09-07T19:34:18.980 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-mon[90124]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:18.980 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: Generating public/private rsa key pair. 2022-09-07T19:34:18.981 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: Your identification has been saved in /tmp/tmpr442vbbt/key. 2022-09-07T19:34:18.981 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: Your public key has been saved in /tmp/tmpr442vbbt/key.pub. 2022-09-07T19:34:18.981 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: The key fingerprint is: 2022-09-07T19:34:18.981 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: SHA256:mOJnTucZUoTBhrRm/XUaz7ox+jfsn8pN86YH4ogT3Vs ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:34:18.982 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: The key's randomart image is: 2022-09-07T19:34:18.982 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: +---[RSA 3072]----+ 2022-09-07T19:34:18.982 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | ..o. | 2022-09-07T19:34:18.982 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | .ooo | 2022-09-07T19:34:18.983 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | +.o . o . | 2022-09-07T19:34:18.983 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | o = . * | 2022-09-07T19:34:18.983 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | . o S...o | 2022-09-07T19:34:18.983 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | . . .. ..o E | 2022-09-07T19:34:18.984 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | . = oo++ +o. | 2022-09-07T19:34:18.984 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | = +o+.=*o +o| 2022-09-07T19:34:18.984 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: | . +ooo++=+.| 2022-09-07T19:34:18.984 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: +----[SHA256]-----+ 2022-09-07T19:34:19.296 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.461+0000 7f61eec61700 1 Processor -- start 2022-09-07T19:34:19.296 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.461+0000 7f61eec61700 1 -- start start 2022-09-07T19:34:19.297 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.462+0000 7f61eec61700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e80782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:19.297 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.462+0000 7f61eec61700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e807a140 con 0x7f61e8079d30 2022-09-07T19:34:19.298 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.462+0000 7f61ec9fd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e80782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:19.299 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.462+0000 7f61ec9fd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e80782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38928/0 (socket says 172.21.15.80:38928) 2022-09-07T19:34:19.300 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.462+0000 7f61ec9fd700 1 -- 172.21.15.80:0/1181294389 learned_addr learned my addr 172.21.15.80:0/1181294389 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:19.300 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.462+0000 7f61ec9fd700 1 -- 172.21.15.80:0/1181294389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80787f0 con 0x7f61e8079d30 2022-09-07T19:34:19.301 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.463+0000 7f61ec9fd700 1 --2- 172.21.15.80:0/1181294389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e80782b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009700 tx=0x7f61dc009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f9b932a403564 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:19.301 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.463+0000 7f61e77fe700 1 -- 172.21.15.80:0/1181294389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc004160 con 0x7f61e8079d30 2022-09-07T19:34:19.314 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.463+0000 7f61e77fe700 1 -- 172.21.15.80:0/1181294389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f61dc0042c0 con 0x7f61e8079d30 2022-09-07T19:34:19.314 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.463+0000 7f61e77fe700 1 -- 172.21.15.80:0/1181294389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc0039d0 con 0x7f61e8079d30 2022-09-07T19:34:19.315 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.463+0000 7f61eec61700 1 -- 172.21.15.80:0/1181294389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 msgr2=0x7f61e80782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:19.315 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.463+0000 7f61eec61700 1 --2- 172.21.15.80:0/1181294389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e80782b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009700 tx=0x7f61dc009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:19.316 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.464+0000 7f61eec61700 1 -- 172.21.15.80:0/1181294389 shutdown_connections 2022-09-07T19:34:19.316 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.464+0000 7f61eec61700 1 --2- 172.21.15.80:0/1181294389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e80782b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:19.317 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.464+0000 7f61eec61700 1 -- 172.21.15.80:0/1181294389 >> 172.21.15.80:0/1181294389 conn(0x7f61e80febf0 msgr2=0x7f61e8101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:19.317 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.464+0000 7f61eec61700 1 -- 172.21.15.80:0/1181294389 shutdown_connections 2022-09-07T19:34:19.317 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.464+0000 7f61eec61700 1 -- 172.21.15.80:0/1181294389 wait complete. 2022-09-07T19:34:19.318 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.465+0000 7f61eec61700 1 Processor -- start 2022-09-07T19:34:19.318 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.465+0000 7f61eec61700 1 -- start start 2022-09-07T19:34:19.319 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.465+0000 7f61eec61700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:19.319 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.465+0000 7f61eec61700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8199730 con 0x7f61e8079d30 2022-09-07T19:34:19.320 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.466+0000 7f61ec9fd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:19.321 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.466+0000 7f61ec9fd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e81991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38944/0 (socket says 172.21.15.80:38944) 2022-09-07T19:34:19.322 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.466+0000 7f61ec9fd700 1 -- 172.21.15.80:0/2305216507 learned_addr learned my addr 172.21.15.80:0/2305216507 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:19.322 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.466+0000 7f61ec9fd700 1 -- 172.21.15.80:0/2305216507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0093e0 con 0x7f61e8079d30 2022-09-07T19:34:19.323 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.466+0000 7f61ec9fd700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e81991f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61dc003ea0 tx=0x7f61dc003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:19.323 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.467+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc011840 con 0x7f61e8079d30 2022-09-07T19:34:19.324 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.467+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f61dc01a430 con 0x7f61e8079d30 2022-09-07T19:34:19.324 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.467+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc019530 con 0x7f61e8079d30 2022-09-07T19:34:19.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.467+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8199930 con 0x7f61e8079d30 2022-09-07T19:34:19.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.467+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e8199d60 con 0x7f61e8079d30 2022-09-07T19:34:19.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.468+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f61dc02a020 con 0x7f61e8079d30 2022-09-07T19:34:19.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.468+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e8109800 con 0x7f61e8079d30 2022-09-07T19:34:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.469+0000 7f61e5ffb700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f61cc035830 0x7f61cc037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.469+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f61dc0488f0 con 0x7f61e8079d30 2022-09-07T19:34:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.469+0000 7f61e7fff700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f61cc035830 0x7f61cc037ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.470+0000 7f61e7fff700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f61cc035830 0x7f61cc037ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009750 tx=0x7f61d4006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.473+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f61dc01a5a0 con 0x7f61e8079d30 2022-09-07T19:34:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.688+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f61e8100100 con 0x7f61cc035830 2022-09-07T19:34:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.836+0000 7f61e5ffb700 1 -- 172.21.15.80:0/2305216507 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f61e8100100 con 0x7f61cc035830 2022-09-07T19:34:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f61cc035830 msgr2=0x7f61cc037ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f61cc035830 0x7f61cc037ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009750 tx=0x7f61d4006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 msgr2=0x7f61e81991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e81991f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61dc003ea0 tx=0x7f61dc003f80 comp rx=0 tx=0).stop 2022-09-07T19:34:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 shutdown_connections 2022-09-07T19:34:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f61cc035830 0x7f61cc037ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 --2- 172.21.15.80:0/2305216507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e8079d30 0x7f61e81991f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 >> 172.21.15.80:0/2305216507 conn(0x7f61e80febf0 msgr2=0x7f61e80ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 shutdown_connections 2022-09-07T19:34:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:18.838+0000 7f61eec61700 1 -- 172.21.15.80:0/2305216507 wait complete. 2022-09-07T19:34:19.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:19 smithi080 ceph-mon[90124]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:19.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:19 smithi080 ceph-mon[90124]: Generating ssh key... 2022-09-07T19:34:19.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:19 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:19.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:19 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:20.599 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:34:20.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.887+0000 7fb441ffb700 1 Processor -- start 2022-09-07T19:34:20.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.887+0000 7fb441ffb700 1 -- start start 2022-09-07T19:34:20.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.888+0000 7fb441ffb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:20.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.888+0000 7fb441ffb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c103e50 con 0x7fb43c103500 2022-09-07T19:34:20.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.888+0000 7fb43b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:20.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.888+0000 7fb43b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38956/0 (socket says 172.21.15.80:38956) 2022-09-07T19:34:20.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.888+0000 7fb43b7fe700 1 -- 172.21.15.80:0/2380096774 learned_addr learned my addr 172.21.15.80:0/2380096774 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:20.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.889+0000 7fb43b7fe700 1 -- 172.21.15.80:0/2380096774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c103f90 con 0x7fb43c103500 2022-09-07T19:34:20.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.889+0000 7fb43b7fe700 1 --2- 172.21.15.80:0/2380096774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c103910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009700 tx=0x7fb42c009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bb613ef4f0c5f6 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:20.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.889+0000 7fb43a7fc700 1 -- 172.21.15.80:0/2380096774 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb42c004160 con 0x7fb43c103500 2022-09-07T19:34:20.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.889+0000 7fb43a7fc700 1 -- 172.21.15.80:0/2380096774 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fb42c0042c0 con 0x7fb43c103500 2022-09-07T19:34:20.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.889+0000 7fb43a7fc700 1 -- 172.21.15.80:0/2380096774 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb42c0039d0 con 0x7fb43c103500 2022-09-07T19:34:20.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 -- 172.21.15.80:0/2380096774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 msgr2=0x7fb43c103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:20.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 --2- 172.21.15.80:0/2380096774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c103910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009700 tx=0x7fb42c009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:20.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 -- 172.21.15.80:0/2380096774 shutdown_connections 2022-09-07T19:34:20.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 --2- 172.21.15.80:0/2380096774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c103910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:20.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 -- 172.21.15.80:0/2380096774 >> 172.21.15.80:0/2380096774 conn(0x7fb43c0febf0 msgr2=0x7fb43c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:20.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 -- 172.21.15.80:0/2380096774 shutdown_connections 2022-09-07T19:34:20.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.890+0000 7fb441ffb700 1 -- 172.21.15.80:0/2380096774 wait complete. 2022-09-07T19:34:20.605 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.891+0000 7fb441ffb700 1 Processor -- start 2022-09-07T19:34:20.605 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.891+0000 7fb441ffb700 1 -- start start 2022-09-07T19:34:20.605 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.892+0000 7fb441ffb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:20.605 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.892+0000 7fb441ffb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c197510 con 0x7fb43c103500 2022-09-07T19:34:20.606 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.892+0000 7fb43b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:20.606 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.892+0000 7fb43b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38960/0 (socket says 172.21.15.80:38960) 2022-09-07T19:34:20.606 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.892+0000 7fb43b7fe700 1 -- 172.21.15.80:0/1567499212 learned_addr learned my addr 172.21.15.80:0/1567499212 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:20.606 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.892+0000 7fb43b7fe700 1 -- 172.21.15.80:0/1567499212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c0093e0 con 0x7fb43c103500 2022-09-07T19:34:20.607 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.893+0000 7fb43b7fe700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c196fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb42c003fb0 tx=0x7fb42c004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:20.607 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.893+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb42c0118c0 con 0x7fb43c103500 2022-09-07T19:34:20.607 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.893+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fb42c011a20 con 0x7fb43c103500 2022-09-07T19:34:20.607 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.893+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb42c019550 con 0x7fb43c103500 2022-09-07T19:34:20.608 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.893+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c197710 con 0x7fb43c103500 2022-09-07T19:34:20.608 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.893+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c197b40 con 0x7fb43c103500 2022-09-07T19:34:20.608 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.894+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7fb42c02a020 con 0x7fb43c103500 2022-09-07T19:34:20.608 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.894+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c060310 con 0x7fb43c103500 2022-09-07T19:34:20.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.895+0000 7fb438ff9700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fb428035810 0x7fb428037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:20.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.895+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb42c048a80 con 0x7fb43c103500 2022-09-07T19:34:20.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.895+0000 7fb43affd700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fb428035810 0x7fb428037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:20.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.896+0000 7fb43affd700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fb428035810 0x7fb428037cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb430009750 tx=0x7fb430006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:20.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:19.900+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb42c018d20 con 0x7fb43c103500 2022-09-07T19:34:20.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.110+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb43c100040 con 0x7fb428035810 2022-09-07T19:34:20.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.111+0000 7fb438ff9700 1 -- 172.21.15.80:0/1567499212 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb43c100040 con 0x7fb428035810 2022-09-07T19:34:20.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.113+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fb428035810 msgr2=0x7fb428037cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:20.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.113+0000 7fb441ffb700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fb428035810 0x7fb428037cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb430009750 tx=0x7fb430006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:20.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.113+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 msgr2=0x7fb43c196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:20.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.113+0000 7fb441ffb700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c196fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb42c003fb0 tx=0x7fb42c004090 comp rx=0 tx=0).stop 2022-09-07T19:34:20.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.114+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 shutdown_connections 2022-09-07T19:34:20.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.114+0000 7fb441ffb700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fb428035810 0x7fb428037cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:20.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.114+0000 7fb441ffb700 1 --2- 172.21.15.80:0/1567499212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb43c103500 0x7fb43c196fd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:20.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.114+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 >> 172.21.15.80:0/1567499212 conn(0x7fb43c0febf0 msgr2=0x7fb43c0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:20.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.114+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 shutdown_connections 2022-09-07T19:34:20.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:20.114+0000 7fb441ffb700 1 -- 172.21.15.80:0/1567499212 wait complete. 2022-09-07T19:34:20.613 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2022-09-07T19:34:20.613 INFO:teuthology.orchestra.run.smithi080.stdout:Adding key to root@localhost authorized_keys... 2022-09-07T19:34:20.614 INFO:teuthology.orchestra.run.smithi080.stdout:Adding host smithi080... 2022-09-07T19:34:21.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:20 smithi080 ceph-mon[90124]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:22.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:22 smithi080 ceph-mon[90124]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:23.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:23 smithi080 ceph-mon[90124]: Deploying cephadm binary to smithi080 2022-09-07T19:34:25.110 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Added host 'smithi080' with addr '172.21.15.80' 2022-09-07T19:34:25.110 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.190+0000 7f46c0669700 1 Processor -- start 2022-09-07T19:34:25.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.190+0000 7f46c0669700 1 -- start start 2022-09-07T19:34:25.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.191+0000 7f46c0669700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b8103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:25.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.191+0000 7f46c0669700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8103e50 con 0x7f46b8103500 2022-09-07T19:34:25.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.191+0000 7f46be405700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b8103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:25.111 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.191+0000 7f46be405700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b8103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38974/0 (socket says 172.21.15.80:38974) 2022-09-07T19:34:25.112 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.191+0000 7f46be405700 1 -- 172.21.15.80:0/2687575821 learned_addr learned my addr 172.21.15.80:0/2687575821 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:25.112 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.192+0000 7f46be405700 1 -- 172.21.15.80:0/2687575821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b8103f90 con 0x7f46b8103500 2022-09-07T19:34:25.112 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.192+0000 7f46be405700 1 --2- 172.21.15.80:0/2687575821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b8103910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009700 tx=0x7f46b4009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a1231b738e96bc server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:25.112 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.192+0000 7f46bd403700 1 -- 172.21.15.80:0/2687575821 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b4004160 con 0x7f46b8103500 2022-09-07T19:34:25.113 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.192+0000 7f46bd403700 1 -- 172.21.15.80:0/2687575821 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f46b40042c0 con 0x7f46b8103500 2022-09-07T19:34:25.113 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.192+0000 7f46bd403700 1 -- 172.21.15.80:0/2687575821 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b40039d0 con 0x7f46b8103500 2022-09-07T19:34:25.113 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 -- 172.21.15.80:0/2687575821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 msgr2=0x7f46b8103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:25.113 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 --2- 172.21.15.80:0/2687575821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b8103910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009700 tx=0x7f46b4009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:25.114 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 -- 172.21.15.80:0/2687575821 shutdown_connections 2022-09-07T19:34:25.114 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 --2- 172.21.15.80:0/2687575821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b8103910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:25.114 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 -- 172.21.15.80:0/2687575821 >> 172.21.15.80:0/2687575821 conn(0x7f46b80febf0 msgr2=0x7f46b8101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:25.114 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 -- 172.21.15.80:0/2687575821 shutdown_connections 2022-09-07T19:34:25.115 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.193+0000 7f46c0669700 1 -- 172.21.15.80:0/2687575821 wait complete. 2022-09-07T19:34:25.115 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.195+0000 7f46c0669700 1 Processor -- start 2022-09-07T19:34:25.115 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.195+0000 7f46c0669700 1 -- start start 2022-09-07T19:34:25.115 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46c0669700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:25.116 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46c0669700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b81996f0 con 0x7f46b8103500 2022-09-07T19:34:25.116 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46be405700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:25.116 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46be405700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b81991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38980/0 (socket says 172.21.15.80:38980) 2022-09-07T19:34:25.116 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46be405700 1 -- 172.21.15.80:0/178288564 learned_addr learned my addr 172.21.15.80:0/178288564 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:25.117 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46be405700 1 -- 172.21.15.80:0/178288564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40093e0 con 0x7f46b8103500 2022-09-07T19:34:25.117 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.196+0000 7f46be405700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b81991b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46b4003fb0 tx=0x7f46b4004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:25.117 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.197+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b40118c0 con 0x7f46b8103500 2022-09-07T19:34:25.118 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.197+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f46b4011a20 con 0x7f46b8103500 2022-09-07T19:34:25.118 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.197+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b4019550 con 0x7f46b8103500 2022-09-07T19:34:25.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.197+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b81998f0 con 0x7f46b8103500 2022-09-07T19:34:25.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.197+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b8199d20 con 0x7f46b8103500 2022-09-07T19:34:25.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.198+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f46b402a020 con 0x7f46b8103500 2022-09-07T19:34:25.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.198+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b8060310 con 0x7f46b8103500 2022-09-07T19:34:25.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.198+0000 7f46a77fe700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f46a0035810 0x7f46a0037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:25.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.198+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f46b40489e0 con 0x7f46b8103500 2022-09-07T19:34:25.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.199+0000 7f46bdc04700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f46a0035810 0x7f46a0037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:25.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.199+0000 7f46bdc04700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f46a0035810 0x7f46a0037cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009750 tx=0x7f46a8006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:25.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.203+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f46b4018d20 con 0x7f46b8103500 2022-09-07T19:34:25.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:21.417+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}) v1 -- 0x7f46b8100020 con 0x7f46a0035810 2022-09-07T19:34:25.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.653+0000 7f46a77fe700 1 -- 172.21.15.80:0/178288564 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f46b8100020 con 0x7f46a0035810 2022-09-07T19:34:25.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f46a0035810 msgr2=0x7f46a0037cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:25.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f46a0035810 0x7f46a0037cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009750 tx=0x7f46a8006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:25.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 msgr2=0x7f46b81991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:25.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b81991b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46b4003fb0 tx=0x7f46b4004090 comp rx=0 tx=0).stop 2022-09-07T19:34:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 shutdown_connections 2022-09-07T19:34:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f46a0035810 0x7f46a0037cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 --2- 172.21.15.80:0/178288564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b8103500 0x7f46b81991b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 >> 172.21.15.80:0/178288564 conn(0x7f46b80febf0 msgr2=0x7f46b80ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:25.124 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 shutdown_connections 2022-09-07T19:34:25.124 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:24.656+0000 7f46c0669700 1 -- 172.21.15.80:0/178288564 wait complete. 2022-09-07T19:34:25.124 INFO:teuthology.orchestra.run.smithi080.stdout:Deploying unmanaged mon service... 2022-09-07T19:34:25.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:25 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:25 smithi080 ceph-mon[90124]: Added host smithi080 2022-09-07T19:34:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:25 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:26.462 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2022-09-07T19:34:26.462 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.698+0000 7f56ffe6d700 1 Processor -- start 2022-09-07T19:34:26.462 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.699+0000 7f56ffe6d700 1 -- start start 2022-09-07T19:34:26.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.699+0000 7f56ffe6d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f8103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:26.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.699+0000 7f56ffe6d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8103e50 con 0x7f56f8103500 2022-09-07T19:34:26.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.699+0000 7f56fdc09700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f8103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:26.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.700+0000 7f56fdc09700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f8103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56732/0 (socket says 172.21.15.80:56732) 2022-09-07T19:34:26.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.700+0000 7f56fdc09700 1 -- 172.21.15.80:0/516261383 learned_addr learned my addr 172.21.15.80:0/516261383 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:26.464 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.700+0000 7f56fdc09700 1 -- 172.21.15.80:0/516261383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8103f90 con 0x7f56f8103500 2022-09-07T19:34:26.464 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.700+0000 7f56fdc09700 1 --2- 172.21.15.80:0/516261383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f8103910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009700 tx=0x7f56f4009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54abd48c6771789 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:26.464 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.700+0000 7f56fcc07700 1 -- 172.21.15.80:0/516261383 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f4004160 con 0x7f56f8103500 2022-09-07T19:34:26.464 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56fcc07700 1 -- 172.21.15.80:0/516261383 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f56f40042c0 con 0x7f56f8103500 2022-09-07T19:34:26.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56fcc07700 1 -- 172.21.15.80:0/516261383 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f40039d0 con 0x7f56f8103500 2022-09-07T19:34:26.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 -- 172.21.15.80:0/516261383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 msgr2=0x7f56f8103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:26.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 --2- 172.21.15.80:0/516261383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f8103910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009700 tx=0x7f56f4009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:26.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 -- 172.21.15.80:0/516261383 shutdown_connections 2022-09-07T19:34:26.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 --2- 172.21.15.80:0/516261383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f8103910 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:26.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 -- 172.21.15.80:0/516261383 >> 172.21.15.80:0/516261383 conn(0x7f56f80febf0 msgr2=0x7f56f8101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:26.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 -- 172.21.15.80:0/516261383 shutdown_connections 2022-09-07T19:34:26.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.701+0000 7f56ffe6d700 1 -- 172.21.15.80:0/516261383 wait complete. 2022-09-07T19:34:26.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.703+0000 7f56ffe6d700 1 Processor -- start 2022-09-07T19:34:26.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.703+0000 7f56ffe6d700 1 -- start start 2022-09-07T19:34:26.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.703+0000 7f56ffe6d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:26.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.703+0000 7f56ffe6d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81996f0 con 0x7f56f8103500 2022-09-07T19:34:26.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.704+0000 7f56fdc09700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:26.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.704+0000 7f56fdc09700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f81991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56740/0 (socket says 172.21.15.80:56740) 2022-09-07T19:34:26.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.704+0000 7f56fdc09700 1 -- 172.21.15.80:0/750183037 learned_addr learned my addr 172.21.15.80:0/750183037 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:26.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.704+0000 7f56fdc09700 1 -- 172.21.15.80:0/750183037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40093e0 con 0x7f56f8103500 2022-09-07T19:34:26.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.704+0000 7f56fdc09700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f81991b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56f4003fb0 tx=0x7f56f4004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:26.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.705+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f40118c0 con 0x7f56f8103500 2022-09-07T19:34:26.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.705+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f81998f0 con 0x7f56f8103500 2022-09-07T19:34:26.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.705+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f56f4011a20 con 0x7f56f8103500 2022-09-07T19:34:26.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.705+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f4019550 con 0x7f56f8103500 2022-09-07T19:34:26.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.705+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f8199d20 con 0x7f56f8103500 2022-09-07T19:34:26.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.706+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f56f402a020 con 0x7f56f8103500 2022-09-07T19:34:26.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.706+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f8105340 con 0x7f56f8103500 2022-09-07T19:34:26.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.706+0000 7f56e6ffd700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f56e0035810 0x7f56e0037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:26.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.706+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f56f4048aa0 con 0x7f56f8103500 2022-09-07T19:34:26.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.707+0000 7f56fd408700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f56e0035810 0x7f56e0037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:26.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.707+0000 7f56fd408700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f56e0035810 0x7f56e0037cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009750 tx=0x7f56e8006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:26.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.712+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f56f402b340 con 0x7f56f8103500 2022-09-07T19:34:26.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.955+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f56f8100020 con 0x7f56e0035810 2022-09-07T19:34:26.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.961+0000 7f56e6ffd700 1 -- 172.21.15.80:0/750183037 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f56f8100020 con 0x7f56e0035810 2022-09-07T19:34:26.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f56e0035810 msgr2=0x7f56e0037cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:26.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f56e0035810 0x7f56e0037cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009750 tx=0x7f56e8006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:26.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 msgr2=0x7f56f81991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:26.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f81991b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56f4003fb0 tx=0x7f56f4004090 comp rx=0 tx=0).stop 2022-09-07T19:34:26.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 shutdown_connections 2022-09-07T19:34:26.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f56e0035810 0x7f56e0037cc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:26.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 --2- 172.21.15.80:0/750183037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f8103500 0x7f56f81991b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:26.474 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.963+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 >> 172.21.15.80:0/750183037 conn(0x7f56f80febf0 msgr2=0x7f56f80ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:26.474 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.964+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 shutdown_connections 2022-09-07T19:34:26.474 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:25.964+0000 7f56ffe6d700 1 -- 172.21.15.80:0/750183037 wait complete. 2022-09-07T19:34:26.474 INFO:teuthology.orchestra.run.smithi080.stdout:Deploying unmanaged mgr service... 2022-09-07T19:34:27.171 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:26 smithi080 ceph-mon[90124]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:27.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:26 smithi080 ceph-mon[90124]: Saving service mon spec with placement count:5 2022-09-07T19:34:27.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:26 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:27.878 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2022-09-07T19:34:27.879 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.204+0000 7fb01c92a700 1 Processor -- start 2022-09-07T19:34:27.879 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.204+0000 7fb01c92a700 1 -- start start 2022-09-07T19:34:27.879 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.205+0000 7fb01c92a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb018105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:27.880 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.205+0000 7fb01c92a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018106120 con 0x7fb0181057d0 2022-09-07T19:34:27.880 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.205+0000 7fb01659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb018105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:27.881 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.205+0000 7fb01659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb018105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56752/0 (socket says 172.21.15.80:56752) 2022-09-07T19:34:27.881 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.205+0000 7fb01659c700 1 -- 172.21.15.80:0/2419713480 learned_addr learned my addr 172.21.15.80:0/2419713480 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:27.881 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.206+0000 7fb01659c700 1 -- 172.21.15.80:0/2419713480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018106260 con 0x7fb0181057d0 2022-09-07T19:34:27.881 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.206+0000 7fb01659c700 1 --2- 172.21.15.80:0/2419713480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb018105be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb008009700 tx=0x7fb008009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328028602db582d9 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:27.882 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.206+0000 7fb01559a700 1 -- 172.21.15.80:0/2419713480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb008004160 con 0x7fb0181057d0 2022-09-07T19:34:27.882 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.206+0000 7fb01559a700 1 -- 172.21.15.80:0/2419713480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fb0080042c0 con 0x7fb0181057d0 2022-09-07T19:34:27.882 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.206+0000 7fb01559a700 1 -- 172.21.15.80:0/2419713480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0080039d0 con 0x7fb0181057d0 2022-09-07T19:34:27.882 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 -- 172.21.15.80:0/2419713480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 msgr2=0x7fb018105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:27.883 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 --2- 172.21.15.80:0/2419713480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb018105be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb008009700 tx=0x7fb008009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:27.883 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 -- 172.21.15.80:0/2419713480 shutdown_connections 2022-09-07T19:34:27.883 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 --2- 172.21.15.80:0/2419713480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb018105be0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:27.883 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 -- 172.21.15.80:0/2419713480 >> 172.21.15.80:0/2419713480 conn(0x7fb018078c20 msgr2=0x7fb018079040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:27.884 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 -- 172.21.15.80:0/2419713480 shutdown_connections 2022-09-07T19:34:27.884 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.207+0000 7fb01c92a700 1 -- 172.21.15.80:0/2419713480 wait complete. 2022-09-07T19:34:27.884 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.208+0000 7fb01c92a700 1 Processor -- start 2022-09-07T19:34:27.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.209+0000 7fb01c92a700 1 -- start start 2022-09-07T19:34:27.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.209+0000 7fb01c92a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb0181991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:27.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.209+0000 7fb01c92a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018199720 con 0x7fb0181057d0 2022-09-07T19:34:27.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.209+0000 7fb01659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb0181991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:27.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.209+0000 7fb01659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb0181991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56764/0 (socket says 172.21.15.80:56764) 2022-09-07T19:34:27.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.209+0000 7fb01659c700 1 -- 172.21.15.80:0/1305243199 learned_addr learned my addr 172.21.15.80:0/1305243199 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:27.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb01659c700 1 -- 172.21.15.80:0/1305243199 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080093e0 con 0x7fb0181057d0 2022-09-07T19:34:27.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb01659c700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb0181991e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb008003fb0 tx=0x7fb008004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:27.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0080118c0 con 0x7fb0181057d0 2022-09-07T19:34:27.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fb008011a20 con 0x7fb0181057d0 2022-09-07T19:34:27.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb008019550 con 0x7fb0181057d0 2022-09-07T19:34:27.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018199920 con 0x7fb0181057d0 2022-09-07T19:34:27.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.210+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018199d50 con 0x7fb0181057d0 2022-09-07T19:34:27.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.211+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7fb00802a020 con 0x7fb0181057d0 2022-09-07T19:34:27.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.211+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0181075b0 con 0x7fb0181057d0 2022-09-07T19:34:27.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.212+0000 7fb0077fe700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7faffc035810 0x7faffc037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:27.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.212+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb008048aa0 con 0x7fb0181057d0 2022-09-07T19:34:27.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.212+0000 7fb015d9b700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7faffc035810 0x7faffc037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:27.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.213+0000 7fb015d9b700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7faffc035810 0x7faffc037cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009750 tx=0x7fb00c006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:27.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.217+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb008011b90 con 0x7fb0181057d0 2022-09-07T19:34:27.890 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.444+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb018103de0 con 0x7faffc035810 2022-09-07T19:34:27.890 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.453+0000 7fb0077fe700 1 -- 172.21.15.80:0/1305243199 <== mgr.14120 v2:172.21.15.80:6800/1499799081 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb018103de0 con 0x7faffc035810 2022-09-07T19:34:27.890 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7faffc035810 msgr2=0x7faffc037cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:27.890 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7faffc035810 0x7faffc037cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009750 tx=0x7fb00c006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:27.891 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 msgr2=0x7fb0181991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:27.891 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb0181991e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb008003fb0 tx=0x7fb008004090 comp rx=0 tx=0).stop 2022-09-07T19:34:27.891 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 shutdown_connections 2022-09-07T19:34:27.891 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7faffc035810 0x7faffc037cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:27.892 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 --2- 172.21.15.80:0/1305243199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0181057d0 0x7fb0181991e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:27.892 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 >> 172.21.15.80:0/1305243199 conn(0x7fb018078c20 msgr2=0x7fb0181036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:27.892 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.455+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 shutdown_connections 2022-09-07T19:34:27.892 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:27.456+0000 7fb01c92a700 1 -- 172.21.15.80:0/1305243199 wait complete. 2022-09-07T19:34:28.794 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:28 smithi080 ceph-mon[90124]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:28.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:28 smithi080 ceph-mon[90124]: Saving service mgr spec with placement count:2 2022-09-07T19:34:28.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:28 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:28.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:28 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:28.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:28 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:29.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.522+0000 7f5146468700 1 Processor -- start 2022-09-07T19:34:29.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.522+0000 7f5146468700 1 -- start start 2022-09-07T19:34:29.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.522+0000 7f5146468700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51400782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:29.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.522+0000 7f5146468700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514007a140 con 0x7f5140079d30 2022-09-07T19:34:29.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.523+0000 7f5145466700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51400782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:29.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.523+0000 7f5145466700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51400782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56778/0 (socket says 172.21.15.80:56778) 2022-09-07T19:34:29.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.523+0000 7f5145466700 1 -- 172.21.15.80:0/2465812895 learned_addr learned my addr 172.21.15.80:0/2465812895 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:29.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.523+0000 7f5145466700 1 -- 172.21.15.80:0/2465812895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400787f0 con 0x7f5140079d30 2022-09-07T19:34:29.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.523+0000 7f5145466700 1 --2- 172.21.15.80:0/2465812895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51400782b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f513c009700 tx=0x7f513c009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa016e85003710d server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:29.185 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.524+0000 7f512ffff700 1 -- 172.21.15.80:0/2465812895 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f513c004160 con 0x7f5140079d30 2022-09-07T19:34:29.185 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.524+0000 7f512ffff700 1 -- 172.21.15.80:0/2465812895 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f513c0042c0 con 0x7f5140079d30 2022-09-07T19:34:29.185 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.524+0000 7f512ffff700 1 -- 172.21.15.80:0/2465812895 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f513c003a10 con 0x7f5140079d30 2022-09-07T19:34:29.185 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.524+0000 7f5146468700 1 -- 172.21.15.80:0/2465812895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 msgr2=0x7f51400782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:29.186 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.524+0000 7f5146468700 1 --2- 172.21.15.80:0/2465812895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51400782b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f513c009700 tx=0x7f513c009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:29.186 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.525+0000 7f5146468700 1 -- 172.21.15.80:0/2465812895 shutdown_connections 2022-09-07T19:34:29.186 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.525+0000 7f5146468700 1 --2- 172.21.15.80:0/2465812895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51400782b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:29.186 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.525+0000 7f5146468700 1 -- 172.21.15.80:0/2465812895 >> 172.21.15.80:0/2465812895 conn(0x7f51400fea40 msgr2=0x7f5140100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:29.186 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.525+0000 7f5146468700 1 -- 172.21.15.80:0/2465812895 shutdown_connections 2022-09-07T19:34:29.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.525+0000 7f5146468700 1 -- 172.21.15.80:0/2465812895 wait complete. 2022-09-07T19:34:29.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.526+0000 7f5146468700 1 Processor -- start 2022-09-07T19:34:29.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.526+0000 7f5146468700 1 -- start start 2022-09-07T19:34:29.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.526+0000 7f5146468700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51401990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:29.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.526+0000 7f5146468700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140199600 con 0x7f5140079d30 2022-09-07T19:34:29.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.527+0000 7f5145466700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51401990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:29.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.527+0000 7f5145466700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51401990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56782/0 (socket says 172.21.15.80:56782) 2022-09-07T19:34:29.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.527+0000 7f5145466700 1 -- 172.21.15.80:0/3575695153 learned_addr learned my addr 172.21.15.80:0/3575695153 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:29.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.527+0000 7f5145466700 1 -- 172.21.15.80:0/3575695153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c0093e0 con 0x7f5140079d30 2022-09-07T19:34:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.528+0000 7f5145466700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51401990c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f513c003560 tx=0x7f513c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.528+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f513c011840 con 0x7f5140079d30 2022-09-07T19:34:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.528+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f513c01a430 con 0x7f5140079d30 2022-09-07T19:34:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.528+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f513c0193c0 con 0x7f5140079d30 2022-09-07T19:34:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.528+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5140199800 con 0x7f5140079d30 2022-09-07T19:34:29.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.528+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140199c30 con 0x7f5140079d30 2022-09-07T19:34:29.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.529+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f513c02a020 con 0x7f5140079d30 2022-09-07T19:34:29.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.529+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5140109640 con 0x7f5140079d30 2022-09-07T19:34:29.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.530+0000 7f512e7fc700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f5128035830 0x7f5128037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:29.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.530+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f513c048830 con 0x7f5140079d30 2022-09-07T19:34:29.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.530+0000 7f5144c65700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f5128035830 0x7f5128037ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:29.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.531+0000 7f5144c65700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f5128035830 0x7f5128037ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5130009750 tx=0x7f5130006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:29.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.535+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f513c01a5a0 con 0x7f5140079d30 2022-09-07T19:34:29.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.756+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f514019cee0 con 0x7f5140079d30 2022-09-07T19:34:29.192 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.763+0000 7f512e7fc700 1 -- 172.21.15.80:0/3575695153 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f513c02b7b0 con 0x7f5140079d30 2022-09-07T19:34:29.192 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.765+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f5128035830 msgr2=0x7f5128037ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:29.193 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.765+0000 7f5146468700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f5128035830 0x7f5128037ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5130009750 tx=0x7f5130006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:29.193 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.765+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 msgr2=0x7f51401990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:29.193 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.765+0000 7f5146468700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51401990c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f513c003560 tx=0x7f513c003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:29.193 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.765+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 shutdown_connections 2022-09-07T19:34:29.193 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.766+0000 7f5146468700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f5128035830 0x7f5128037ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:29.194 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.766+0000 7f5146468700 1 --2- 172.21.15.80:0/3575695153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5140079d30 0x7f51401990c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:29.194 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.766+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 >> 172.21.15.80:0/3575695153 conn(0x7f51400fea40 msgr2=0x7f5140100100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:29.195 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.766+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 shutdown_connections 2022-09-07T19:34:29.195 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:28.766+0000 7f5146468700 1 -- 172.21.15.80:0/3575695153 wait complete. 2022-09-07T19:34:30.074 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:29 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3575695153' entity='client.admin' 2022-09-07T19:34:30.486 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.774+0000 7f95edfe4700 1 Processor -- start 2022-09-07T19:34:30.486 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.775+0000 7f95edfe4700 1 -- start start 2022-09-07T19:34:30.486 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.775+0000 7f95edfe4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8106160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:30.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.775+0000 7f95edfe4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e81066a0 con 0x7f95e8077c10 2022-09-07T19:34:30.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.775+0000 7f95e77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8106160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:30.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.775+0000 7f95e77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8106160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56784/0 (socket says 172.21.15.80:56784) 2022-09-07T19:34:30.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.775+0000 7f95e77fe700 1 -- 172.21.15.80:0/453404536 learned_addr learned my addr 172.21.15.80:0/453404536 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:30.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.776+0000 7f95e77fe700 1 -- 172.21.15.80:0/453404536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e81067e0 con 0x7f95e8077c10 2022-09-07T19:34:30.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.776+0000 7f95e77fe700 1 --2- 172.21.15.80:0/453404536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8106160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009700 tx=0x7f95d8009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476582c49543aa22 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:30.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.776+0000 7f95e67fc700 1 -- 172.21.15.80:0/453404536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d8004160 con 0x7f95e8077c10 2022-09-07T19:34:30.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.776+0000 7f95e67fc700 1 -- 172.21.15.80:0/453404536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f95d80042c0 con 0x7f95e8077c10 2022-09-07T19:34:30.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.776+0000 7f95e67fc700 1 -- 172.21.15.80:0/453404536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d8003a10 con 0x7f95e8077c10 2022-09-07T19:34:30.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 -- 172.21.15.80:0/453404536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 msgr2=0x7f95e8106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:30.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 --2- 172.21.15.80:0/453404536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8106160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009700 tx=0x7f95d8009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:30.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 -- 172.21.15.80:0/453404536 shutdown_connections 2022-09-07T19:34:30.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 --2- 172.21.15.80:0/453404536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8106160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:30.491 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 -- 172.21.15.80:0/453404536 >> 172.21.15.80:0/453404536 conn(0x7f95e80fdaf0 msgr2=0x7f95e80fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:30.491 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 -- 172.21.15.80:0/453404536 shutdown_connections 2022-09-07T19:34:30.491 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.777+0000 7f95edfe4700 1 -- 172.21.15.80:0/453404536 wait complete. 2022-09-07T19:34:30.492 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95edfe4700 1 Processor -- start 2022-09-07T19:34:30.492 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95edfe4700 1 -- start start 2022-09-07T19:34:30.493 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95edfe4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:30.493 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95edfe4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8199760 con 0x7f95e8077c10 2022-09-07T19:34:30.493 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95e77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:30.494 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95e77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56790/0 (socket says 172.21.15.80:56790) 2022-09-07T19:34:30.494 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.779+0000 7f95e77fe700 1 -- 172.21.15.80:0/2167523866 learned_addr learned my addr 172.21.15.80:0/2167523866 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:30.495 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.780+0000 7f95e77fe700 1 -- 172.21.15.80:0/2167523866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80093e0 con 0x7f95e8077c10 2022-09-07T19:34:30.495 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.780+0000 7f95e77fe700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8199220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95d8003560 tx=0x7f95d8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:30.495 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.780+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d8011840 con 0x7f95e8077c10 2022-09-07T19:34:30.496 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.780+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e81999c0 con 0x7f95e8077c10 2022-09-07T19:34:30.496 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.780+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f95d80119a0 con 0x7f95e8077c10 2022-09-07T19:34:30.496 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.780+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d80193c0 con 0x7f95e8077c10 2022-09-07T19:34:30.497 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.781+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e8199e50 con 0x7f95e8077c10 2022-09-07T19:34:30.497 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.782+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e8060380 con 0x7f95e8077c10 2022-09-07T19:34:30.497 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.782+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f95d8017020 con 0x7f95e8077c10 2022-09-07T19:34:30.497 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.782+0000 7f95e4ff9700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f95d4035830 0x7f95d4037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:30.498 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.782+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f95d8048580 con 0x7f95e8077c10 2022-09-07T19:34:30.498 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.783+0000 7f95e6ffd700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f95d4035830 0x7f95d4037ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:30.498 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.783+0000 7f95e6ffd700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f95d4035830 0x7f95d4037ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009750 tx=0x7f95dc006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:30.498 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:29.788+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f95e8060380 con 0x7f95e8077c10 2022-09-07T19:34:30.499 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.033+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f95e819ce60 con 0x7f95e8077c10 2022-09-07T19:34:30.499 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.040+0000 7f95e4ff9700 1 -- 172.21.15.80:0/2167523866 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f95d8011b10 con 0x7f95e8077c10 2022-09-07T19:34:30.499 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f95d4035830 msgr2=0x7f95d4037ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:30.499 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f95d4035830 0x7f95d4037ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009750 tx=0x7f95dc006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 msgr2=0x7f95e8199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8199220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95d8003560 tx=0x7f95d8003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 shutdown_connections 2022-09-07T19:34:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f95d4035830 0x7f95d4037ce0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 --2- 172.21.15.80:0/2167523866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e8077c10 0x7f95e8199220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 >> 172.21.15.80:0/2167523866 conn(0x7f95e80fdaf0 msgr2=0x7f95e80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.042+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 shutdown_connections 2022-09-07T19:34:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:30.043+0000 7f95edfe4700 1 -- 172.21.15.80:0/2167523866 wait complete. 2022-09-07T19:34:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling the dashboard module... 2022-09-07T19:34:31.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:31 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2167523866' entity='client.admin' 2022-09-07T19:34:32.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-mon[90124]: from='mgr.14120 172.21.15.80:0/2155356230' entity='mgr.x' 2022-09-07T19:34:32.550 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1993559950' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2022-09-07T19:34:32.551 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: ignoring --setuser ceph since I am not root 2022-09-07T19:34:32.551 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: ignoring --setgroup ceph since I am not root 2022-09-07T19:34:32.795 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.167+0000 7f0d22052700 1 Processor -- start 2022-09-07T19:34:32.795 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.168+0000 7f0d22052700 1 -- start start 2022-09-07T19:34:32.796 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.168+0000 7f0d22052700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:32.796 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.168+0000 7f0d22052700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c103e50 con 0x7f0d1c103500 2022-09-07T19:34:32.796 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.169+0000 7f0d1b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:32.796 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.169+0000 7f0d1b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56796/0 (socket says 172.21.15.80:56796) 2022-09-07T19:34:32.797 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.169+0000 7f0d1b7fe700 1 -- 172.21.15.80:0/1316944138 learned_addr learned my addr 172.21.15.80:0/1316944138 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:32.797 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.169+0000 7f0d1b7fe700 1 -- 172.21.15.80:0/1316944138 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c103f90 con 0x7f0d1c103500 2022-09-07T19:34:32.797 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.169+0000 7f0d1b7fe700 1 --2- 172.21.15.80:0/1316944138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c103910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009700 tx=0x7f0d0c009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f204b6535ead3906 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:32.797 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.169+0000 7f0d1a7fc700 1 -- 172.21.15.80:0/1316944138 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c004160 con 0x7f0d1c103500 2022-09-07T19:34:32.798 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d1a7fc700 1 -- 172.21.15.80:0/1316944138 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f0d0c0042c0 con 0x7f0d1c103500 2022-09-07T19:34:32.798 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d1a7fc700 1 -- 172.21.15.80:0/1316944138 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c003a10 con 0x7f0d1c103500 2022-09-07T19:34:32.798 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d22052700 1 -- 172.21.15.80:0/1316944138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 msgr2=0x7f0d1c103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:32.798 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d22052700 1 --2- 172.21.15.80:0/1316944138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c103910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009700 tx=0x7f0d0c009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:32.799 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d22052700 1 -- 172.21.15.80:0/1316944138 shutdown_connections 2022-09-07T19:34:32.799 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d22052700 1 --2- 172.21.15.80:0/1316944138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c103910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:32.799 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d22052700 1 -- 172.21.15.80:0/1316944138 >> 172.21.15.80:0/1316944138 conn(0x7f0d1c0febf0 msgr2=0x7f0d1c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:32.799 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.170+0000 7f0d22052700 1 -- 172.21.15.80:0/1316944138 shutdown_connections 2022-09-07T19:34:32.800 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.171+0000 7f0d22052700 1 -- 172.21.15.80:0/1316944138 wait complete. 2022-09-07T19:34:32.800 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d22052700 1 Processor -- start 2022-09-07T19:34:32.800 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d22052700 1 -- start start 2022-09-07T19:34:32.800 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d22052700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:32.800 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d22052700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c199770 con 0x7f0d1c103500 2022-09-07T19:34:32.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d1b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:32.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d1b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56808/0 (socket says 172.21.15.80:56808) 2022-09-07T19:34:32.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.172+0000 7f0d1b7fe700 1 -- 172.21.15.80:0/1993559950 learned_addr learned my addr 172.21.15.80:0/1993559950 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:32.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.173+0000 7f0d1b7fe700 1 -- 172.21.15.80:0/1993559950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0093e0 con 0x7f0d1c103500 2022-09-07T19:34:32.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.173+0000 7f0d1b7fe700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c199230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c003560 tx=0x7f0d0c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:32.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.173+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c011840 con 0x7f0d1c103500 2022-09-07T19:34:32.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.173+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c199970 con 0x7f0d1c103500 2022-09-07T19:34:32.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.173+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f0d0c0119a0 con 0x7f0d1c103500 2022-09-07T19:34:32.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.173+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c0193c0 con 0x7f0d1c103500 2022-09-07T19:34:32.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.174+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c199da0 con 0x7f0d1c103500 2022-09-07T19:34:32.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.175+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 42690+0+0 (secure 0 0 0) 0x7f0d0c02a020 con 0x7f0d1c103500 2022-09-07T19:34:32.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.175+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c060310 con 0x7f0d1c103500 2022-09-07T19:34:32.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.175+0000 7f0d18ff9700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f0d08035830 0x7f0d08037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:32.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.175+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0d0c0488a0 con 0x7f0d1c103500 2022-09-07T19:34:32.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.176+0000 7f0d1affd700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f0d08035830 0x7f0d08037ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:32.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.176+0000 7f0d1affd700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f0d08035830 0x7f0d08037ce0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009750 tx=0x7f0d10006cc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:32.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.180+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f0d0c02b940 con 0x7f0d1c103500 2022-09-07T19:34:32.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:31.467+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f0d1c105360 con 0x7f0d1c103500 2022-09-07T19:34:32.806 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.294+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 9) v1 ==== 42703+0+0 (secure 0 0 0) 0x7f0d0c017020 con 0x7f0d1c103500 2022-09-07T19:34:32.806 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.296+0000 7f0d18ff9700 1 -- 172.21.15.80:0/1993559950 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f0d0c02bd30 con 0x7f0d1c103500 2022-09-07T19:34:32.806 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f0d08035830 msgr2=0x7f0d08037ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:32.806 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f0d08035830 0x7f0d08037ce0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009750 tx=0x7f0d10006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:32.807 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 msgr2=0x7f0d1c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:32.807 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c199230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c003560 tx=0x7f0d0c003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:32.807 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 shutdown_connections 2022-09-07T19:34:32.808 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f0d08035830 0x7f0d08037ce0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:32.808 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 --2- 172.21.15.80:0/1993559950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d1c103500 0x7f0d1c199230 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:32.808 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 >> 172.21.15.80:0/1993559950 conn(0x7f0d1c0febf0 msgr2=0x7f0d1c0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:32.808 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 shutdown_connections 2022-09-07T19:34:32.809 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:32.300+0000 7f0d22052700 1 -- 172.21.15.80:0/1993559950 wait complete. 2022-09-07T19:34:32.819 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:32.699+0000 7f6c6996f080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:34:33.100 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:32.819+0000 7f6c6996f080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:34:33.101 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:32 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:32.966+0000 7f6c6996f080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:34:33.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:33 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1993559950' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2022-09-07T19:34:33.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:33 smithi080 ceph-mon[90124]: mgrmap e9: x(active, since 18s) 2022-09-07T19:34:33.359 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:33 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:33.100+0000 7f6c6996f080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:34:33.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:33 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:33.358+0000 7f6c6996f080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:34:34.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:33 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:33.812+0000 7f6c6996f080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:34:34.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:33 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:33.960+0000 7f6c6996f080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:34:34.204 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:34:34.205 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 9, 2022-09-07T19:34:34.205 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2022-09-07T19:34:34.205 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "active_name": "x", 2022-09-07T19:34:34.206 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standby": 0 2022-09-07T19:34:34.206 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:34:34.206 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.433+0000 7fe4b670b700 1 Processor -- start 2022-09-07T19:34:34.206 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.433+0000 7fe4b670b700 1 -- start start 2022-09-07T19:34:34.207 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.434+0000 7fe4b670b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b00782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:34.207 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.434+0000 7fe4b670b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b007a140 con 0x7fe4b0079d30 2022-09-07T19:34:34.207 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.434+0000 7fe4affff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b00782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:34.207 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.434+0000 7fe4affff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b00782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56724/0 (socket says 172.21.15.80:56724) 2022-09-07T19:34:34.208 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.434+0000 7fe4affff700 1 -- 172.21.15.80:0/2995424080 learned_addr learned my addr 172.21.15.80:0/2995424080 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:34.208 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.435+0000 7fe4affff700 1 -- 172.21.15.80:0/2995424080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00787f0 con 0x7fe4b0079d30 2022-09-07T19:34:34.208 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.435+0000 7fe4affff700 1 --2- 172.21.15.80:0/2995424080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b00782b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009700 tx=0x7fe4a0009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3b9407b9fa4992 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:34.208 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.435+0000 7fe4aeffd700 1 -- 172.21.15.80:0/2995424080 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0004160 con 0x7fe4b0079d30 2022-09-07T19:34:34.209 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.435+0000 7fe4aeffd700 1 -- 172.21.15.80:0/2995424080 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fe4a00042c0 con 0x7fe4b0079d30 2022-09-07T19:34:34.209 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.435+0000 7fe4aeffd700 1 -- 172.21.15.80:0/2995424080 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0003a10 con 0x7fe4b0079d30 2022-09-07T19:34:34.209 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 -- 172.21.15.80:0/2995424080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 msgr2=0x7fe4b00782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:34.209 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 --2- 172.21.15.80:0/2995424080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b00782b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009700 tx=0x7fe4a0009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:34.210 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 -- 172.21.15.80:0/2995424080 shutdown_connections 2022-09-07T19:34:34.210 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 --2- 172.21.15.80:0/2995424080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b00782b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:34.210 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 -- 172.21.15.80:0/2995424080 >> 172.21.15.80:0/2995424080 conn(0x7fe4b00febf0 msgr2=0x7fe4b0101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:34.210 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 -- 172.21.15.80:0/2995424080 shutdown_connections 2022-09-07T19:34:34.211 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.436+0000 7fe4b670b700 1 -- 172.21.15.80:0/2995424080 wait complete. 2022-09-07T19:34:34.211 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.437+0000 7fe4b670b700 1 Processor -- start 2022-09-07T19:34:34.211 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.438+0000 7fe4b670b700 1 -- start start 2022-09-07T19:34:34.211 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.438+0000 7fe4b670b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:34.212 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.438+0000 7fe4b670b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0199790 con 0x7fe4b0079d30 2022-09-07T19:34:34.212 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.438+0000 7fe4affff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:34.212 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.438+0000 7fe4affff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b0199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56742/0 (socket says 172.21.15.80:56742) 2022-09-07T19:34:34.212 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.438+0000 7fe4affff700 1 -- 172.21.15.80:0/3265779846 learned_addr learned my addr 172.21.15.80:0/3265779846 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:34.213 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.439+0000 7fe4affff700 1 -- 172.21.15.80:0/3265779846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00093e0 con 0x7fe4b0079d30 2022-09-07T19:34:34.213 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.439+0000 7fe4affff700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b0199250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0003560 tx=0x7fe4a0003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:34.213 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.439+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0011840 con 0x7fe4b0079d30 2022-09-07T19:34:34.213 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.439+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fe4a001a430 con 0x7fe4b0079d30 2022-09-07T19:34:34.213 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.439+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00193c0 con 0x7fe4b0079d30 2022-09-07T19:34:34.214 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.439+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b0199990 con 0x7fe4b0079d30 2022-09-07T19:34:34.214 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.440+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b0199dc0 con 0x7fe4b0079d30 2022-09-07T19:34:34.214 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.441+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) v1 ==== 42703+0+0 (secure 0 0 0) 0x7fe4a002a020 con 0x7fe4b0079d30 2022-09-07T19:34:34.215 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.441+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b0060310 con 0x7fe4b0079d30 2022-09-07T19:34:34.215 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.441+0000 7fe4ad7fa700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 0x7fe49c037d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:34.215 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.442+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe4a00487e0 con 0x7fe4b0079d30 2022-09-07T19:34:34.215 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.442+0000 7fe4af7fe700 1 -- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 msgr2=0x7fe49c037d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:34.216 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.442+0000 7fe4af7fe700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 0x7fe49c037d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:34:34.216 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.446+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fe4a001a5a0 con 0x7fe4b0079d30 2022-09-07T19:34:34.216 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.643+0000 7fe4af7fe700 1 -- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 msgr2=0x7fe49c037d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:34.216 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.643+0000 7fe4af7fe700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 0x7fe49c037d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:34:34.217 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.722+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe4b019cc00 con 0x7fe4b0079d30 2022-09-07T19:34:34.217 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.723+0000 7fe4ad7fa700 1 -- 172.21.15.80:0/3265779846 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fe4a002b7b0 con 0x7fe4b0079d30 2022-09-07T19:34:34.217 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 msgr2=0x7fe49c037d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:34:34.217 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 0x7fe49c037d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:34.217 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 msgr2=0x7fe4b0199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:34.218 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b0199250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0003560 tx=0x7fe4a0003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:34.218 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 shutdown_connections 2022-09-07T19:34:34.218 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7fe49c035870 0x7fe49c037d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:34.218 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 --2- 172.21.15.80:0/3265779846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b0079d30 0x7fe4b0199250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:34.219 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 >> 172.21.15.80:0/3265779846 conn(0x7fe4b00febf0 msgr2=0x7fe4b01002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:34.219 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 shutdown_connections 2022-09-07T19:34:34.219 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:33.725+0000 7fe4b670b700 1 -- 172.21.15.80:0/3265779846 wait complete. 2022-09-07T19:34:34.219 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for the mgr to restart... 2022-09-07T19:34:34.219 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr epoch 9... 2022-09-07T19:34:34.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:34 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3265779846' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-09-07T19:34:34.483 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:34 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:34.141+0000 7f6c6996f080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:34:34.484 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:34 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:34.291+0000 7f6c6996f080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:34:35.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:34 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:34.916+0000 7f6c6996f080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:34:36.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:35 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:35.728+0000 7f6c6996f080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:34:36.119 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:35 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:35.959+0000 7f6c6996f080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:34:37.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:37 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:37.013+0000 7f6c6996f080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:34:37.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:37 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:37.162+0000 7f6c6996f080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:34:37.748 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:37 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:37.441+0000 7f6c6996f080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:34:38.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:37 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:37.749+0000 7f6c6996f080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:34:38.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:37 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:37.977+0000 7f6c6996f080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:34:38.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:38 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:38.567+0000 7f6c6996f080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:34:39.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:39.471+0000 7f6c6996f080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:34:40.223 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:39.900+0000 7f6c6996f080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:34:40.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:40 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:40.223+0000 7f6c6996f080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:34:40.619 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:40 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:40.412+0000 7f6c6996f080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:34:41.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:40 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:40.772+0000 7f6c6996f080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:34:42.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:41 smithi080 ceph-mon[90124]: Active manager daemon x restarted 2022-09-07T19:34:42.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:41 smithi080 ceph-mon[90124]: Activating manager daemon x 2022-09-07T19:34:42.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:41 smithi080 ceph-mon[90124]: osdmap e3: 0 total, 0 up, 0 in 2022-09-07T19:34:42.120 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:34:41 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:34:41.779+0000 7f6c6996f080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:34:43.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: mgrmap e10: x(active, starting, since 0.0535939s) 2022-09-07T19:34:43.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:34:43.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-09-07T19:34:43.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-09-07T19:34:43.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-09-07T19:34:43.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-09-07T19:34:43.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: Manager daemon x is now available 2022-09-07T19:34:43.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:43.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:43.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:34:43.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:34:43.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2022-09-07T19:34:43.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2022-09-07T19:34:43.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "initialized": true 2022-09-07T19:34:43.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2022-09-07T19:34:43.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.791+0000 7f6c861b2700 1 Processor -- start 2022-09-07T19:34:43.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.792+0000 7f6c861b2700 1 -- start start 2022-09-07T19:34:43.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.792+0000 7f6c861b2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:43.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.792+0000 7f6c861b2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80103e50 con 0x7f6c80103500 2022-09-07T19:34:43.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.792+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:43.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.792+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56754/0 (socket says 172.21.15.80:56754) 2022-09-07T19:34:43.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.792+0000 7f6c7f7fe700 1 -- 172.21.15.80:0/827970068 learned_addr learned my addr 172.21.15.80:0/827970068 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:43.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.793+0000 7f6c7f7fe700 1 -- 172.21.15.80:0/827970068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80103f90 con 0x7f6c80103500 2022-09-07T19:34:43.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.793+0000 7f6c7f7fe700 1 --2- 172.21.15.80:0/827970068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80103910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009700 tx=0x7f6c70009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a5cf75f91ac8d3 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:43.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.793+0000 7f6c7e7fc700 1 -- 172.21.15.80:0/827970068 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c70004160 con 0x7f6c80103500 2022-09-07T19:34:43.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c7e7fc700 1 -- 172.21.15.80:0/827970068 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6c700042c0 con 0x7f6c80103500 2022-09-07T19:34:43.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c7e7fc700 1 -- 172.21.15.80:0/827970068 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c70003a10 con 0x7f6c80103500 2022-09-07T19:34:43.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 -- 172.21.15.80:0/827970068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 msgr2=0x7f6c80103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:43.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 --2- 172.21.15.80:0/827970068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80103910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009700 tx=0x7f6c70009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:43.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 -- 172.21.15.80:0/827970068 shutdown_connections 2022-09-07T19:34:43.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 --2- 172.21.15.80:0/827970068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80103910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:43.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 -- 172.21.15.80:0/827970068 >> 172.21.15.80:0/827970068 conn(0x7f6c800febf0 msgr2=0x7f6c80101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:43.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 -- 172.21.15.80:0/827970068 shutdown_connections 2022-09-07T19:34:43.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.794+0000 7f6c861b2700 1 -- 172.21.15.80:0/827970068 wait complete. 2022-09-07T19:34:43.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c861b2700 1 Processor -- start 2022-09-07T19:34:43.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c861b2700 1 -- start start 2022-09-07T19:34:43.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c861b2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:43.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c861b2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80199750 con 0x7f6c80103500 2022-09-07T19:34:43.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:43.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56762/0 (socket says 172.21.15.80:56762) 2022-09-07T19:34:43.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.796+0000 7f6c7f7fe700 1 -- 172.21.15.80:0/1427869905 learned_addr learned my addr 172.21.15.80:0/1427869905 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:43.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.797+0000 7f6c7f7fe700 1 -- 172.21.15.80:0/1427869905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700093e0 con 0x7f6c80103500 2022-09-07T19:34:43.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.797+0000 7f6c7f7fe700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80199210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6c70003560 tx=0x7f6c70003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:43.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.797+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c70011840 con 0x7f6c80103500 2022-09-07T19:34:43.344 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.797+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c80199950 con 0x7f6c80103500 2022-09-07T19:34:43.344 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.797+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6c700119a0 con 0x7f6c80103500 2022-09-07T19:34:43.344 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.798+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c700193c0 con 0x7f6c80103500 2022-09-07T19:34:43.344 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.798+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80199d80 con 0x7f6c80103500 2022-09-07T19:34:43.345 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.799+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) v1 ==== 42703+0+0 (secure 0 0 0) 0x7f6c7002a020 con 0x7f6c80103500 2022-09-07T19:34:43.345 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.799+0000 7f6c7cff9700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:43.345 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.799+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 --> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c6c0383f0 con 0x7f6c6c035830 2022-09-07T19:34:43.346 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.799+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6c70048920 con 0x7f6c80103500 2022-09-07T19:34:43.346 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.799+0000 7f6c7effd700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:43.346 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:34.799+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:34:43.346 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:35.000+0000 7f6c7effd700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:43.347 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:35.000+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:34:43.347 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:35.401+0000 7f6c7effd700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:43.347 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:35.401+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-09-07T19:34:43.347 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:36.202+0000 7f6c7effd700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:43.348 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:36.202+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-09-07T19:34:43.348 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:37.804+0000 7f6c7effd700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:43.348 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:37.804+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2022-09-07T19:34:43.348 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:41.005+0000 7f6c7effd700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1499799081 2022-09-07T19:34:43.349 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:41.005+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2022-09-07T19:34:43.349 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:41.834+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 10) v1 ==== 42513+0+0 (secure 0 0 0) 0x7f6c70017020 con 0x7f6c80103500 2022-09-07T19:34:43.349 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:41.834+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 msgr2=0x7f6c6c037ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:34:43.349 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:41.834+0000 7f6c7cff9700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:43.350 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.845+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 11) v1 ==== 42623+0+0 (secure 0 0 0) 0x7f6c7000f050 con 0x7f6c80103500 2022-09-07T19:34:43.350 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.845+0000 7f6c7cff9700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c6c039290 0x7f6c6c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:43.350 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.845+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c6c0383f0 con 0x7f6c6c039290 2022-09-07T19:34:43.350 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.846+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c6c039290 0x7f6c6c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:43.351 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.848+0000 7f6c7effd700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c6c039290 0x7f6c6c03b670 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6c74006fd0 tx=0x7f6c74006dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:43.351 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.848+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6424 (secure 0 0 0) 0x7f6c6c0383f0 con 0x7f6c6c039290 2022-09-07T19:34:43.351 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.856+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6c8019a540 con 0x7f6c6c039290 2022-09-07T19:34:43.351 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c7cff9700 1 -- 172.21.15.80:0/1427869905 <== mgr.14152 v2:172.21.15.80:6800/202237256 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f6c8019a540 con 0x7f6c6c039290 2022-09-07T19:34:43.351 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c6c039290 msgr2=0x7f6c6c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:43.352 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c6c039290 0x7f6c6c03b670 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6c74006fd0 tx=0x7f6c74006dc0 comp rx=0 tx=0).stop 2022-09-07T19:34:43.352 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 msgr2=0x7f6c80199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:43.352 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80199210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6c70003560 tx=0x7f6c70003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:43.352 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 shutdown_connections 2022-09-07T19:34:43.353 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c6c039290 0x7f6c6c03b670 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:43.353 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c80103500 0x7f6c80199210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:43.353 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 --2- 172.21.15.80:0/1427869905 >> [v2:172.21.15.80:6800/1499799081,v1:172.21.15.80:6801/1499799081] conn(0x7f6c6c035830 0x7f6c6c037ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:43.353 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 >> 172.21.15.80:0/1427869905 conn(0x7f6c800febf0 msgr2=0x7f6c800ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:43.353 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 shutdown_connections 2022-09-07T19:34:43.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:42.857+0000 7f6c861b2700 1 -- 172.21.15.80:0/1427869905 wait complete. 2022-09-07T19:34:43.354 INFO:teuthology.orchestra.run.smithi080.stdout:mgr epoch 9 is available 2022-09-07T19:34:43.354 INFO:teuthology.orchestra.run.smithi080.stdout:Generating a dashboard self-signed certificate... 2022-09-07T19:34:44.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:43 smithi080 ceph-mon[90124]: mgrmap e11: x(active, since 1.06581s) 2022-09-07T19:34:44.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:43 smithi080 ceph-mon[90124]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-09-07T19:34:44.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:43 smithi080 ceph-mon[90124]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-09-07T19:34:44.961 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2022-09-07T19:34:44.962 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.970+0000 7ffaf22e2700 1 Processor -- start 2022-09-07T19:34:44.962 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.971+0000 7ffaf22e2700 1 -- start start 2022-09-07T19:34:44.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.971+0000 7ffaf22e2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:44.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.971+0000 7ffaf22e2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec103e50 con 0x7ffaec103500 2022-09-07T19:34:44.963 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.971+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:44.964 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.971+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48620/0 (socket says 172.21.15.80:48620) 2022-09-07T19:34:44.964 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.971+0000 7ffaebfff700 1 -- 172.21.15.80:0/272169345 learned_addr learned my addr 172.21.15.80:0/272169345 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:44.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.972+0000 7ffaebfff700 1 -- 172.21.15.80:0/272169345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec103f90 con 0x7ffaec103500 2022-09-07T19:34:44.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.972+0000 7ffaebfff700 1 --2- 172.21.15.80:0/272169345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec103910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009700 tx=0x7ffadc009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f240a9a51d844352 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:44.965 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.972+0000 7ffaeaffd700 1 -- 172.21.15.80:0/272169345 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc004160 con 0x7ffaec103500 2022-09-07T19:34:44.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.972+0000 7ffaeaffd700 1 -- 172.21.15.80:0/272169345 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ffadc0042c0 con 0x7ffaec103500 2022-09-07T19:34:44.966 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.972+0000 7ffaeaffd700 1 -- 172.21.15.80:0/272169345 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc003a10 con 0x7ffaec103500 2022-09-07T19:34:44.967 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.973+0000 7ffaf22e2700 1 -- 172.21.15.80:0/272169345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 msgr2=0x7ffaec103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:44.967 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.973+0000 7ffaf22e2700 1 --2- 172.21.15.80:0/272169345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec103910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009700 tx=0x7ffadc009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:44.968 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.973+0000 7ffaf22e2700 1 -- 172.21.15.80:0/272169345 shutdown_connections 2022-09-07T19:34:44.968 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.973+0000 7ffaf22e2700 1 --2- 172.21.15.80:0/272169345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec103910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:44.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.973+0000 7ffaf22e2700 1 -- 172.21.15.80:0/272169345 >> 172.21.15.80:0/272169345 conn(0x7ffaec0febf0 msgr2=0x7ffaec101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:44.969 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.973+0000 7ffaf22e2700 1 -- 172.21.15.80:0/272169345 shutdown_connections 2022-09-07T19:34:44.970 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.974+0000 7ffaf22e2700 1 -- 172.21.15.80:0/272169345 wait complete. 2022-09-07T19:34:44.970 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaf22e2700 1 Processor -- start 2022-09-07T19:34:44.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaf22e2700 1 -- start start 2022-09-07T19:34:44.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaf22e2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:44.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaf22e2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec199750 con 0x7ffaec103500 2022-09-07T19:34:44.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:44.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48624/0 (socket says 172.21.15.80:48624) 2022-09-07T19:34:44.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.975+0000 7ffaebfff700 1 -- 172.21.15.80:0/2285530206 learned_addr learned my addr 172.21.15.80:0/2285530206 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:44.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.976+0000 7ffaebfff700 1 -- 172.21.15.80:0/2285530206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0093e0 con 0x7ffaec103500 2022-09-07T19:34:44.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.976+0000 7ffaebfff700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec199210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffadc003560 tx=0x7ffadc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:44.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.976+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc011840 con 0x7ffaec103500 2022-09-07T19:34:44.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.976+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ffadc0119a0 con 0x7ffaec103500 2022-09-07T19:34:44.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.976+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec199950 con 0x7ffaec103500 2022-09-07T19:34:44.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.976+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc0193c0 con 0x7ffaec103500 2022-09-07T19:34:44.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.977+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec199d80 con 0x7ffaec103500 2022-09-07T19:34:44.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.978+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec105360 con 0x7ffaec103500 2022-09-07T19:34:44.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.978+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) v1 ==== 42703+0+0 (secure 0 0 0) 0x7ffadc02a020 con 0x7ffaec103500 2022-09-07T19:34:44.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.979+0000 7ffae97fa700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffad8035870 0x7ffad8037d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:44.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.979+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffadc0489a0 con 0x7ffaec103500 2022-09-07T19:34:44.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.979+0000 7ffaeb7fe700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffad8035870 0x7ffad8037d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:44.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.980+0000 7ffaeb7fe700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffad8035870 0x7ffad8037d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009750 tx=0x7ffae0006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:44.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:43.984+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ffadc011b10 con 0x7ffaec103500 2022-09-07T19:34:44.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.223+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaec100040 con 0x7ffad8035870 2022-09-07T19:34:44.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.345+0000 7ffae97fa700 1 -- 172.21.15.80:0/2285530206 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ffaec100040 con 0x7ffad8035870 2022-09-07T19:34:44.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffad8035870 msgr2=0x7ffad8037d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:44.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffad8035870 0x7ffad8037d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009750 tx=0x7ffae0006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:44.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 msgr2=0x7ffaec199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:44.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec199210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffadc003560 tx=0x7ffadc003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:44.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 shutdown_connections 2022-09-07T19:34:44.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffad8035870 0x7ffad8037d20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:44.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 --2- 172.21.15.80:0/2285530206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaec103500 0x7ffaec199210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:44.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 >> 172.21.15.80:0/2285530206 conn(0x7ffaec0febf0 msgr2=0x7ffaec0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:44.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 shutdown_connections 2022-09-07T19:34:44.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:44.348+0000 7ffaf22e2700 1 -- 172.21.15.80:0/2285530206 wait complete. 2022-09-07T19:34:44.980 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial admin user... 2022-09-07T19:34:45.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: mgrmap e12: x(active, since 2s) 2022-09-07T19:34:45.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:44] ENGINE Bus STARTING 2022-09-07T19:34:45.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:45.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:44] ENGINE Serving on https://:::8765 2022-09-07T19:34:45.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:45.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:45.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:44] ENGINE Serving on https://172.21.15.80:7150 2022-09-07T19:34:45.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:44 smithi080 ceph-mon[90124]: [07/Sep/2022:19:34:44] ENGINE Bus STARTED 2022-09-07T19:34:46.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:46.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:46.677 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$5T3Er2zp4wiTn7OZvZXCnuM.vPtV2FlGhwZ2.tIrY98ZpRP7Lq8Zi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1662579286, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2022-09-07T19:34:46.678 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.575+0000 7ff8649cb700 1 Processor -- start 2022-09-07T19:34:46.678 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.576+0000 7ff8649cb700 1 -- start start 2022-09-07T19:34:46.679 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.576+0000 7ff8649cb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff860106180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:46.679 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.576+0000 7ff8649cb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601066c0 con 0x7ff860077bf0 2022-09-07T19:34:46.679 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.577+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff860106180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:46.680 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.577+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff860106180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48630/0 (socket says 172.21.15.80:48630) 2022-09-07T19:34:46.680 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.577+0000 7ff85e59c700 1 -- 172.21.15.80:0/3755366740 learned_addr learned my addr 172.21.15.80:0/3755366740 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:46.681 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.577+0000 7ff85e59c700 1 -- 172.21.15.80:0/3755366740 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860106800 con 0x7ff860077bf0 2022-09-07T19:34:46.682 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.578+0000 7ff85e59c700 1 --2- 172.21.15.80:0/3755366740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff860106180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff850009700 tx=0x7ff850009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455cceaa8a98162 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:46.683 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.578+0000 7ff85d59a700 1 -- 172.21.15.80:0/3755366740 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff850004160 con 0x7ff860077bf0 2022-09-07T19:34:46.683 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.578+0000 7ff85d59a700 1 -- 172.21.15.80:0/3755366740 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff8500042c0 con 0x7ff860077bf0 2022-09-07T19:34:46.684 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.578+0000 7ff85d59a700 1 -- 172.21.15.80:0/3755366740 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff850003a10 con 0x7ff860077bf0 2022-09-07T19:34:46.684 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 -- 172.21.15.80:0/3755366740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 msgr2=0x7ff860106180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:46.685 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 --2- 172.21.15.80:0/3755366740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff860106180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff850009700 tx=0x7ff850009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:46.685 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 -- 172.21.15.80:0/3755366740 shutdown_connections 2022-09-07T19:34:46.685 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 --2- 172.21.15.80:0/3755366740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff860106180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:46.686 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 -- 172.21.15.80:0/3755366740 >> 172.21.15.80:0/3755366740 conn(0x7ff8600fdaf0 msgr2=0x7ff8600fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:46.686 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 -- 172.21.15.80:0/3755366740 shutdown_connections 2022-09-07T19:34:46.687 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.579+0000 7ff8649cb700 1 -- 172.21.15.80:0/3755366740 wait complete. 2022-09-07T19:34:46.687 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.581+0000 7ff8649cb700 1 Processor -- start 2022-09-07T19:34:46.687 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.581+0000 7ff8649cb700 1 -- start start 2022-09-07T19:34:46.688 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.582+0000 7ff8649cb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff8601992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:46.688 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.582+0000 7ff8649cb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601997e0 con 0x7ff860077bf0 2022-09-07T19:34:46.688 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.582+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff8601992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:46.688 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.582+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff8601992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48634/0 (socket says 172.21.15.80:48634) 2022-09-07T19:34:46.689 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.582+0000 7ff85e59c700 1 -- 172.21.15.80:0/486518937 learned_addr learned my addr 172.21.15.80:0/486518937 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:46.689 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.582+0000 7ff85e59c700 1 -- 172.21.15.80:0/486518937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500093e0 con 0x7ff860077bf0 2022-09-07T19:34:46.689 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.583+0000 7ff85e59c700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff8601992a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff850003560 tx=0x7ff850003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:46.689 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.583+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff850011840 con 0x7ff860077bf0 2022-09-07T19:34:46.689 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.583+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff85001a430 con 0x7ff860077bf0 2022-09-07T19:34:46.690 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.583+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8500193c0 con 0x7ff860077bf0 2022-09-07T19:34:46.690 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.583+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8601999e0 con 0x7ff860077bf0 2022-09-07T19:34:46.690 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.583+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff860199e10 con 0x7ff860077bf0 2022-09-07T19:34:46.690 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.584+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) v1 ==== 42703+0+0 (secure 0 0 0) 0x7ff85002a020 con 0x7ff860077bf0 2022-09-07T19:34:46.691 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.584+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff860107590 con 0x7ff860077bf0 2022-09-07T19:34:46.691 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.585+0000 7ff84f7fe700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff844035830 0x7ff844037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:46.691 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.585+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff850048920 con 0x7ff860077bf0 2022-09-07T19:34:46.691 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.585+0000 7ff85dd9b700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff844035830 0x7ff844037ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:46.692 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.586+0000 7ff85dd9b700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff844035830 0x7ff844037ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff854009750 tx=0x7ff854006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:46.692 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.590+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff85001a5a0 con 0x7ff860077bf0 2022-09-07T19:34:46.692 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:45.847+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff860060130 con 0x7ff844035830 2022-09-07T19:34:46.693 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.075+0000 7ff84f7fe700 1 -- 172.21.15.80:0/486518937 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff860060130 con 0x7ff844035830 2022-09-07T19:34:46.693 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.077+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff844035830 msgr2=0x7ff844037ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:46.693 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.077+0000 7ff8649cb700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff844035830 0x7ff844037ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff854009750 tx=0x7ff854006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:46.694 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.077+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 msgr2=0x7ff8601992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:46.695 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.077+0000 7ff8649cb700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff8601992a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff850003560 tx=0x7ff850003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:46.695 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.077+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 shutdown_connections 2022-09-07T19:34:46.696 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.078+0000 7ff8649cb700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff844035830 0x7ff844037ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:46.696 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.078+0000 7ff8649cb700 1 --2- 172.21.15.80:0/486518937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff860077bf0 0x7ff8601992a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:46.697 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.078+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 >> 172.21.15.80:0/486518937 conn(0x7ff8600fdaf0 msgr2=0x7ff8600ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:46.697 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.078+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 shutdown_connections 2022-09-07T19:34:46.698 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:46.078+0000 7ff8649cb700 1 -- 172.21.15.80:0/486518937 wait complete. 2022-09-07T19:34:46.698 INFO:teuthology.orchestra.run.smithi080.stdout:Fetching dashboard port number... 2022-09-07T19:34:47.273 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:47 smithi080 ceph-mon[90124]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:47.274 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:47 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:47.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 8443 2022-09-07T19:34:47.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.325+0000 7f623c202700 1 Processor -- start 2022-09-07T19:34:47.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.325+0000 7f623c202700 1 -- start start 2022-09-07T19:34:47.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.325+0000 7f623c202700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f6234078290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:47.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.325+0000 7f623c202700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623407a120 con 0x7f6234079d10 2022-09-07T19:34:47.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.326+0000 7f6239f9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f6234078290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:47.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.326+0000 7f6239f9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f6234078290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48638/0 (socket says 172.21.15.80:48638) 2022-09-07T19:34:47.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.326+0000 7f6239f9e700 1 -- 172.21.15.80:0/3465110003 learned_addr learned my addr 172.21.15.80:0/3465110003 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:47.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.326+0000 7f6239f9e700 1 -- 172.21.15.80:0/3465110003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340787d0 con 0x7f6234079d10 2022-09-07T19:34:47.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.326+0000 7f6239f9e700 1 --2- 172.21.15.80:0/3465110003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f6234078290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6230009700 tx=0x7f6230009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da8eb1b6325654d server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:47.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f6238f9c700 1 -- 172.21.15.80:0/3465110003 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6230004160 con 0x7f6234079d10 2022-09-07T19:34:47.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f6238f9c700 1 -- 172.21.15.80:0/3465110003 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f62300042c0 con 0x7f6234079d10 2022-09-07T19:34:48.000 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f6238f9c700 1 -- 172.21.15.80:0/3465110003 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6230003a10 con 0x7f6234079d10 2022-09-07T19:34:48.000 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f623c202700 1 -- 172.21.15.80:0/3465110003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 msgr2=0x7f6234078290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:48.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f623c202700 1 --2- 172.21.15.80:0/3465110003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f6234078290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6230009700 tx=0x7f6230009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:48.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f623c202700 1 -- 172.21.15.80:0/3465110003 shutdown_connections 2022-09-07T19:34:48.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f623c202700 1 --2- 172.21.15.80:0/3465110003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f6234078290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:48.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.327+0000 7f623c202700 1 -- 172.21.15.80:0/3465110003 >> 172.21.15.80:0/3465110003 conn(0x7f62340febf0 msgr2=0x7f6234101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:48.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.328+0000 7f623c202700 1 -- 172.21.15.80:0/3465110003 shutdown_connections 2022-09-07T19:34:48.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.328+0000 7f623c202700 1 -- 172.21.15.80:0/3465110003 wait complete. 2022-09-07T19:34:48.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.329+0000 7f623c202700 1 Processor -- start 2022-09-07T19:34:48.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.330+0000 7f623c202700 1 -- start start 2022-09-07T19:34:48.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.330+0000 7f623c202700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f62341992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:48.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.330+0000 7f623c202700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62341997f0 con 0x7f6234079d10 2022-09-07T19:34:48.005 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.330+0000 7f6239f9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f62341992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:48.005 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.330+0000 7f6239f9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f62341992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48652/0 (socket says 172.21.15.80:48652) 2022-09-07T19:34:48.006 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.330+0000 7f6239f9e700 1 -- 172.21.15.80:0/2650803473 learned_addr learned my addr 172.21.15.80:0/2650803473 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:48.006 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.331+0000 7f6239f9e700 1 -- 172.21.15.80:0/2650803473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300093e0 con 0x7f6234079d10 2022-09-07T19:34:48.006 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.331+0000 7f6239f9e700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f62341992b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6230003560 tx=0x7f6230003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:48.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.332+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6230011840 con 0x7f6234079d10 2022-09-07T19:34:48.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.332+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f623001a430 con 0x7f6234079d10 2022-09-07T19:34:48.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.332+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62300193c0 con 0x7f6234079d10 2022-09-07T19:34:48.008 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.332+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62341999f0 con 0x7f6234079d10 2022-09-07T19:34:48.008 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.332+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6234199e20 con 0x7f6234079d10 2022-09-07T19:34:48.009 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.333+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) v1 ==== 42703+0+0 (secure 0 0 0) 0x7f623002a020 con 0x7f6234079d10 2022-09-07T19:34:48.009 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.333+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6234060310 con 0x7f6234079d10 2022-09-07T19:34:48.009 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.333+0000 7f6222ffd700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f621c035830 0x7f621c037ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:48.010 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.333+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6230048880 con 0x7f6234079d10 2022-09-07T19:34:48.010 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.334+0000 7f623979d700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f621c035830 0x7f621c037ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:48.011 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.334+0000 7f623979d700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f621c035830 0x7f621c037ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6224009750 tx=0x7f6224006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:48.011 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.338+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f623001a8f0 con 0x7f6234079d10 2022-09-07T19:34:48.012 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.561+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f623419ce30 con 0x7f6234079d10 2022-09-07T19:34:48.012 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.561+0000 7f6222ffd700 1 -- 172.21.15.80:0/2650803473 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f623002b7b0 con 0x7f6234079d10 2022-09-07T19:34:48.013 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.563+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f621c035830 msgr2=0x7f621c037ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:48.013 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.563+0000 7f623c202700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f621c035830 0x7f621c037ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6224009750 tx=0x7f6224006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:48.013 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.563+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 msgr2=0x7f62341992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:48.014 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.563+0000 7f623c202700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f62341992b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6230003560 tx=0x7f6230003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:48.014 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.564+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 shutdown_connections 2022-09-07T19:34:48.015 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.564+0000 7f623c202700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f621c035830 0x7f621c037ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:48.015 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.564+0000 7f623c202700 1 --2- 172.21.15.80:0/2650803473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6234079d10 0x7f62341992b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:48.016 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.564+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 >> 172.21.15.80:0/2650803473 conn(0x7f62340febf0 msgr2=0x7f62341002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:48.016 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.564+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 shutdown_connections 2022-09-07T19:34:48.017 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:47.564+0000 7f623c202700 1 -- 172.21.15.80:0/2650803473 wait complete. 2022-09-07T19:34:48.018 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2022-09-07T19:34:48.019 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2022-09-07T19:34:48.038 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2022-09-07T19:34:48.039 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2022-09-07T19:34:48.039 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2022-09-07T19:34:48.039 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2022-09-07T19:34:48.041 INFO:teuthology.orchestra.run.smithi080.stdout:Ceph Dashboard is now available at: 2022-09-07T19:34:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: URL: https://smithi080.front.sepia.ceph.com:8443/ 2022-09-07T19:34:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: User: admin 2022-09-07T19:34:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: Password: p71pqdj79l 2022-09-07T19:34:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:48.043 INFO:teuthology.orchestra.run.smithi080.stdout:Saving cluster configuration to /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config directory 2022-09-07T19:34:48.044 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling autotune for osd_memory_target 2022-09-07T19:34:48.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:48 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2650803473' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2022-09-07T19:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.685+0000 7f079db7a700 1 Processor -- start 2022-09-07T19:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.685+0000 7f079db7a700 1 -- start start 2022-09-07T19:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.686+0000 7f079db7a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07980782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.686+0000 7f079db7a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079807a160 con 0x7f0798079d50 2022-09-07T19:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.686+0000 7f07977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07980782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.687+0000 7f07977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07980782d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48668/0 (socket says 172.21.15.80:48668) 2022-09-07T19:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.687+0000 7f07977fe700 1 -- 172.21.15.80:0/1249258098 learned_addr learned my addr 172.21.15.80:0/1249258098 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.687+0000 7f07977fe700 1 -- 172.21.15.80:0/1249258098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798078810 con 0x7f0798079d50 2022-09-07T19:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.687+0000 7f07977fe700 1 --2- 172.21.15.80:0/1249258098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07980782d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0788009700 tx=0x7f0788009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c9bc9a53d49ea5 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.687+0000 7f07967fc700 1 -- 172.21.15.80:0/1249258098 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0788004160 con 0x7f0798079d50 2022-09-07T19:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.687+0000 7f07967fc700 1 -- 172.21.15.80:0/1249258098 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f07880042c0 con 0x7f0798079d50 2022-09-07T19:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f07967fc700 1 -- 172.21.15.80:0/1249258098 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0788003a10 con 0x7f0798079d50 2022-09-07T19:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 -- 172.21.15.80:0/1249258098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 msgr2=0x7f07980782d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 --2- 172.21.15.80:0/1249258098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07980782d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0788009700 tx=0x7f0788009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 -- 172.21.15.80:0/1249258098 shutdown_connections 2022-09-07T19:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 --2- 172.21.15.80:0/1249258098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07980782d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 -- 172.21.15.80:0/1249258098 >> 172.21.15.80:0/1249258098 conn(0x7f07980febf0 msgr2=0x7f0798101020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 -- 172.21.15.80:0/1249258098 shutdown_connections 2022-09-07T19:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.688+0000 7f079db7a700 1 -- 172.21.15.80:0/1249258098 wait complete. 2022-09-07T19:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.690+0000 7f079db7a700 1 Processor -- start 2022-09-07T19:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.690+0000 7f079db7a700 1 -- start start 2022-09-07T19:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.690+0000 7f079db7a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07981992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.690+0000 7f079db7a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07981997f0 con 0x7f0798079d50 2022-09-07T19:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.690+0000 7f07977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07981992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f07977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07981992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48684/0 (socket says 172.21.15.80:48684) 2022-09-07T19:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f07977fe700 1 -- 172.21.15.80:0/2813127486 learned_addr learned my addr 172.21.15.80:0/2813127486 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:49.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f07977fe700 1 -- 172.21.15.80:0/2813127486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880093e0 con 0x7f0798079d50 2022-09-07T19:34:49.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f07977fe700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07981992b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0788003560 tx=0x7f0788003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:49.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0788011840 con 0x7f0798079d50 2022-09-07T19:34:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f078801a430 con 0x7f0798079d50 2022-09-07T19:34:49.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.691+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07981999f0 con 0x7f0798079d50 2022-09-07T19:34:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.692+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07880193c0 con 0x7f0798079d50 2022-09-07T19:34:49.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.692+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0798199e20 con 0x7f0798079d50 2022-09-07T19:34:49.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.693+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f078802a020 con 0x7f0798079d50 2022-09-07T19:34:49.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.693+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0798060310 con 0x7f0798079d50 2022-09-07T19:34:49.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.693+0000 7f0794ff9700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0784035910 0x7f0784037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:49.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.693+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f07880489c0 con 0x7f0798079d50 2022-09-07T19:34:49.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.694+0000 7f0796ffd700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0784035910 0x7f0784037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:49.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.694+0000 7f0796ffd700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0784035910 0x7f0784037dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f078c009750 tx=0x7f078c006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:49.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.698+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f07880187c0 con 0x7f0798079d50 2022-09-07T19:34:49.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.944+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f079819cdb0 con 0x7f0798079d50 2022-09-07T19:34:49.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.944+0000 7f0794ff9700 1 -- 172.21.15.80:0/2813127486 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f07880187c0 con 0x7f0798079d50 2022-09-07T19:34:49.471 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0784035910 msgr2=0x7f0784037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:49.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0784035910 0x7f0784037dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f078c009750 tx=0x7f078c006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:49.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 msgr2=0x7f07981992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:49.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07981992b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0788003560 tx=0x7f0788003fb0 comp rx=0 tx=0).stop 2022-09-07T19:34:49.472 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 shutdown_connections 2022-09-07T19:34:49.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0784035910 0x7f0784037dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:49.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 --2- 172.21.15.80:0/2813127486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0798079d50 0x7f07981992b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:49.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.946+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 >> 172.21.15.80:0/2813127486 conn(0x7f07980febf0 msgr2=0x7f07981002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:49.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.947+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 shutdown_connections 2022-09-07T19:34:49.473 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:48.947+0000 7f079db7a700 1 -- 172.21.15.80:0/2813127486 wait complete. 2022-09-07T19:34:49.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:49 smithi080 ceph-mon[90124]: mgrmap e13: x(active, since 6s) 2022-09-07T19:34:50.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.215+0000 7fcd2954c700 1 Processor -- start 2022-09-07T19:34:50.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.215+0000 7fcd2954c700 1 -- start start 2022-09-07T19:34:50.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.216+0000 7fcd2954c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:50.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.216+0000 7fcd2954c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd24106120 con 0x7fcd241057d0 2022-09-07T19:34:50.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.216+0000 7fcd22ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:50.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.216+0000 7fcd22ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48692/0 (socket says 172.21.15.80:48692) 2022-09-07T19:34:50.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.216+0000 7fcd22ffd700 1 -- 172.21.15.80:0/3616891202 learned_addr learned my addr 172.21.15.80:0/3616891202 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:50.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.217+0000 7fcd22ffd700 1 -- 172.21.15.80:0/3616891202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24106260 con 0x7fcd241057d0 2022-09-07T19:34:50.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.217+0000 7fcd22ffd700 1 --2- 172.21.15.80:0/3616891202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24105be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009700 tx=0x7fcd14009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a45baf6a70b5bc server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:50.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.217+0000 7fcd21ffb700 1 -- 172.21.15.80:0/3616891202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd14004160 con 0x7fcd241057d0 2022-09-07T19:34:50.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.217+0000 7fcd21ffb700 1 -- 172.21.15.80:0/3616891202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcd140042c0 con 0x7fcd241057d0 2022-09-07T19:34:50.992 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.217+0000 7fcd21ffb700 1 -- 172.21.15.80:0/3616891202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd14003a10 con 0x7fcd241057d0 2022-09-07T19:34:50.992 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 -- 172.21.15.80:0/3616891202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 msgr2=0x7fcd24105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:50.993 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 --2- 172.21.15.80:0/3616891202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24105be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009700 tx=0x7fcd14009a10 comp rx=0 tx=0).stop 2022-09-07T19:34:50.994 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 -- 172.21.15.80:0/3616891202 shutdown_connections 2022-09-07T19:34:50.994 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 --2- 172.21.15.80:0/3616891202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24105be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:50.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 -- 172.21.15.80:0/3616891202 >> 172.21.15.80:0/3616891202 conn(0x7fcd24078c20 msgr2=0x7fcd24079040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:50.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 -- 172.21.15.80:0/3616891202 shutdown_connections 2022-09-07T19:34:50.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.218+0000 7fcd2954c700 1 -- 172.21.15.80:0/3616891202 wait complete. 2022-09-07T19:34:50.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.219+0000 7fcd2954c700 1 Processor -- start 2022-09-07T19:34:50.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.219+0000 7fcd2954c700 1 -- start start 2022-09-07T19:34:50.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.220+0000 7fcd2954c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:50.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.220+0000 7fcd2954c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd24199780 con 0x7fcd241057d0 2022-09-07T19:34:50.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.220+0000 7fcd22ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:50.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.220+0000 7fcd22ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48694/0 (socket says 172.21.15.80:48694) 2022-09-07T19:34:50.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.220+0000 7fcd22ffd700 1 -- 172.21.15.80:0/539402323 learned_addr learned my addr 172.21.15.80:0/539402323 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:50.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.220+0000 7fcd22ffd700 1 -- 172.21.15.80:0/539402323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140093e0 con 0x7fcd241057d0 2022-09-07T19:34:51.000 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.221+0000 7fcd22ffd700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24199240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd14003560 tx=0x7fcd14003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:51.000 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.221+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd14011840 con 0x7fcd241057d0 2022-09-07T19:34:51.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.221+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcd140119a0 con 0x7fcd241057d0 2022-09-07T19:34:51.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.221+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd24199980 con 0x7fcd241057d0 2022-09-07T19:34:51.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.221+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd140193c0 con 0x7fcd241057d0 2022-09-07T19:34:51.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.221+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd24199db0 con 0x7fcd241057d0 2022-09-07T19:34:51.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.222+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7fcd1402a020 con 0x7fcd241057d0 2022-09-07T19:34:51.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.222+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd24060310 con 0x7fcd241057d0 2022-09-07T19:34:51.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.223+0000 7fcd0bfff700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcd100358d0 0x7fcd10037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:51.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.223+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcd14048b20 con 0x7fcd241057d0 2022-09-07T19:34:51.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.223+0000 7fcd227fc700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcd100358d0 0x7fcd10037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:51.005 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.224+0000 7fcd227fc700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcd100358d0 0x7fcd10037d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009750 tx=0x7fcd18006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:51.005 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.228+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fcd1402b990 con 0x7fcd241057d0 2022-09-07T19:34:51.006 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.548+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fcd2419cdc0 con 0x7fcd241057d0 2022-09-07T19:34:51.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.550+0000 7fcd0bfff700 1 -- 172.21.15.80:0/539402323 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v29)=0 set mgr/dashboard/cluster/status v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7fcd1402b7b0 con 0x7fcd241057d0 2022-09-07T19:34:51.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcd100358d0 msgr2=0x7fcd10037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:51.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcd100358d0 0x7fcd10037d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009750 tx=0x7fcd18006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:51.007 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 msgr2=0x7fcd24199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:51.008 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24199240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd14003560 tx=0x7fcd14003f60 comp rx=0 tx=0).stop 2022-09-07T19:34:51.008 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 shutdown_connections 2022-09-07T19:34:51.008 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcd100358d0 0x7fcd10037d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:51.009 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 --2- 172.21.15.80:0/539402323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd241057d0 0x7fcd24199240 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:51.009 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 >> 172.21.15.80:0/539402323 conn(0x7fcd24078c20 msgr2=0x7fcd24104020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:51.009 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 shutdown_connections 2022-09-07T19:34:51.010 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2022-09-07T19:34:50.553+0000 7fcd2954c700 1 -- 172.21.15.80:0/539402323 wait complete. 2022-09-07T19:34:51.010 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2022-09-07T19:34:51.010 INFO:teuthology.orchestra.run.smithi080.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2022-09-07T19:34:51.011 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.011 INFO:teuthology.orchestra.run.smithi080.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2022-09-07T19:34:51.011 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.011 INFO:teuthology.orchestra.run.smithi080.stdout:Or, if you are only running a single cluster on this host: 2022-09-07T19:34:51.012 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.012 INFO:teuthology.orchestra.run.smithi080.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2022-09-07T19:34:51.012 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.012 INFO:teuthology.orchestra.run.smithi080.stdout:Please consider enabling telemetry to help improve Ceph: 2022-09-07T19:34:51.012 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.013 INFO:teuthology.orchestra.run.smithi080.stdout: ceph telemetry on 2022-09-07T19:34:51.013 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.013 INFO:teuthology.orchestra.run.smithi080.stdout:For more information see: 2022-09-07T19:34:51.013 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.013 INFO:teuthology.orchestra.run.smithi080.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2022-09-07T19:34:51.014 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:34:51.014 INFO:teuthology.orchestra.run.smithi080.stdout:Bootstrap complete. 2022-09-07T19:34:51.048 INFO:tasks.cephadm:Fetching config... 2022-09-07T19:34:51.049 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:34:51.049 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2022-09-07T19:34:51.117 INFO:tasks.cephadm:Fetching client.admin keyring... 2022-09-07T19:34:51.118 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:34:51.119 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2022-09-07T19:34:51.182 INFO:tasks.cephadm:Fetching mon keyring... 2022-09-07T19:34:51.183 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:34:51.184 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/keyring of=/dev/stdout 2022-09-07T19:34:51.273 INFO:tasks.cephadm:Fetching pub ssh key... 2022-09-07T19:34:51.274 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:34:51.274 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2022-09-07T19:34:51.341 INFO:tasks.cephadm:Installing pub ssh key for root users... 2022-09-07T19:34:51.341 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-09-07T19:34:51.464 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:34:51.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-09-07T19:34:51.548 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:34:51.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-09-07T19:34:51.606 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaO3YTsJcM6QfYr5wmL3hYJg25LF5ffzcUxlIgyej6QY6/Iuhv8lRx1lx0owhpN5riR4pBJcHd+03hnl1JRpFLH+Lm4RuDF8BYkjZtZw/LpyzvtrPBFXyQ5sw6qwz7H3R05joztaUmemyrW2fdpy/SB1OtGtZFN9LxoiKT0HgzGyuOp0enGleV4b3rs5J0euzh+H3KuswWVKvEKVXKFybXGFzrkUKAFt/N9OYhozVn7yjOxw1YP9it/2t77GkuHc2Muvg4wt9UcSCon9AOro/r5Ulg9E2IzQi4WVrOAZnp4S47nnCInfZOEEKm5cu5Hs8ZRR1GH4buliK9y7srw5I6vfZtorQGkGFA8HPEuzpo5NwSkSVP8tDlTwpkCJQkD95ytWNvqraa+M+c3Xf+WjUPy02ubUSiDUxoUxZGlUPnhOFbkQ0z7MuPDG01HU2r+wB8G0Uw5UVimHuzQZZgJi1B8euHbbHiKQ7of4QWpTsGA+Q1bsyK4MnB1U7Uwilcc00= ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:34:51.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2022-09-07T19:34:51.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:51 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/539402323' entity='client.admin' 2022-09-07T19:34:52.712 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:34:53.924 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:53.924 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:53.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:34:53.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:53.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:53.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 -- 172.21.15.80:0/491440543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 msgr2=0x7f06980fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 --2- 172.21.15.80:0/491440543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f06980fdc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0694009790 tx=0x7f0694009aa0 comp rx=0 tx=0).stop 2022-09-07T19:34:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 -- 172.21.15.80:0/491440543 shutdown_connections 2022-09-07T19:34:54.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 --2- 172.21.15.80:0/491440543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f06980fdc60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:54.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 -- 172.21.15.80:0/491440543 >> 172.21.15.80:0/491440543 conn(0x7f06980f8f40 msgr2=0x7f06980fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:54.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 -- 172.21.15.80:0/491440543 shutdown_connections 2022-09-07T19:34:54.222 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.220+0000 7f06a0778700 1 -- 172.21.15.80:0/491440543 wait complete. 2022-09-07T19:34:54.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.221+0000 7f06a0778700 1 Processor -- start 2022-09-07T19:34:54.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.221+0000 7f06a0778700 1 -- start start 2022-09-07T19:34:54.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.222+0000 7f06a0778700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f0698072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:54.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.222+0000 7f06a0778700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0698072fd0 con 0x7f06980fd850 2022-09-07T19:34:54.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.222+0000 7f069e514700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f0698072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:54.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.222+0000 7f069e514700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f0698072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54890/0 (socket says 172.21.15.80:54890) 2022-09-07T19:34:54.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.222+0000 7f069e514700 1 -- 172.21.15.80:0/2266004282 learned_addr learned my addr 172.21.15.80:0/2266004282 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:54.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.222+0000 7f069e514700 1 -- 172.21.15.80:0/2266004282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009470 con 0x7f06980fd850 2022-09-07T19:34:54.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.223+0000 7f069e514700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f0698072a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06940059c0 tx=0x7f069400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:54.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.223+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f069401d070 con 0x7f06980fd850 2022-09-07T19:34:54.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.223+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f069400fde0 con 0x7f06980fd850 2022-09-07T19:34:54.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.223+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980710d0 con 0x7f06980fd850 2022-09-07T19:34:54.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.223+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f069400b460 con 0x7f06980fd850 2022-09-07T19:34:54.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.223+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0698071580 con 0x7f06980fd850 2022-09-07T19:34:54.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.224+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f0694028020 con 0x7f06980fd850 2022-09-07T19:34:54.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.224+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698060310 con 0x7f06980fd850 2022-09-07T19:34:54.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.225+0000 7f068f7fe700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0684035910 0x7f0684037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:54.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.225+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0694048ba0 con 0x7f06980fd850 2022-09-07T19:34:54.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.225+0000 7f069dd13700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0684035910 0x7f0684037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:54.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.225+0000 7f069dd13700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0684035910 0x7f0684037dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0688009750 tx=0x7f0688006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:54.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.229+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f06940176b0 con 0x7f06980fd850 2022-09-07T19:34:54.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.443+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f06981034a0 con 0x7f06980fd850 2022-09-07T19:34:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.446+0000 7f068f7fe700 1 -- 172.21.15.80:0/2266004282 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0694021830 con 0x7f06980fd850 2022-09-07T19:34:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0684035910 msgr2=0x7f0684037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0684035910 0x7f0684037dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0688009750 tx=0x7f0688006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 msgr2=0x7f0698072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f0698072a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06940059c0 tx=0x7f069400f460 comp rx=0 tx=0).stop 2022-09-07T19:34:54.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 shutdown_connections 2022-09-07T19:34:54.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0684035910 0x7f0684037dc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:54.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 --2- 172.21.15.80:0/2266004282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06980fd850 0x7f0698072a90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:54.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 >> 172.21.15.80:0/2266004282 conn(0x7f06980f8f40 msgr2=0x7f06980f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:54.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 shutdown_connections 2022-09-07T19:34:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:54.449+0000 7f06a0778700 1 -- 172.21.15.80:0/2266004282 wait complete. 2022-09-07T19:34:54.881 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2022-09-07T19:34:54.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2022-09-07T19:34:55.744 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:34:55.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:55 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2266004282' entity='client.admin' 2022-09-07T19:34:55.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:55.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 -- 172.21.15.80:0/1262329871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 msgr2=0x7f003c0fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:57.383 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 --2- 172.21.15.80:0/1262329871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c0fdc50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f002c009790 tx=0x7f002c009aa0 comp rx=0 tx=0).stop 2022-09-07T19:34:57.383 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 -- 172.21.15.80:0/1262329871 shutdown_connections 2022-09-07T19:34:57.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 --2- 172.21.15.80:0/1262329871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c0fdc50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:57.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 -- 172.21.15.80:0/1262329871 >> 172.21.15.80:0/1262329871 conn(0x7f003c0f8e70 msgr2=0x7f003c0fb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:57.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 -- 172.21.15.80:0/1262329871 shutdown_connections 2022-09-07T19:34:57.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.379+0000 7f0040cc4700 1 -- 172.21.15.80:0/1262329871 wait complete. 2022-09-07T19:34:57.385 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f0040cc4700 1 Processor -- start 2022-09-07T19:34:57.385 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f0040cc4700 1 -- start start 2022-09-07T19:34:57.386 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f0040cc4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:57.386 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f0040cc4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c072fd0 con 0x7f003c0fd840 2022-09-07T19:34:57.387 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f003a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:57.387 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f003a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54896/0 (socket says 172.21.15.80:54896) 2022-09-07T19:34:57.387 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.381+0000 7f003a59c700 1 -- 172.21.15.80:0/199548122 learned_addr learned my addr 172.21.15.80:0/199548122 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:34:57.388 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f003a59c700 1 -- 172.21.15.80:0/199548122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009470 con 0x7f003c0fd840 2022-09-07T19:34:57.388 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f003a59c700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c072a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f002c0059c0 tx=0x7f002c005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:57.389 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f002c01d070 con 0x7f003c0fd840 2022-09-07T19:34:57.389 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f002c00fe80 con 0x7f003c0fd840 2022-09-07T19:34:57.390 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f002c00b460 con 0x7f003c0fd840 2022-09-07T19:34:57.390 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c0710d0 con 0x7f003c0fd840 2022-09-07T19:34:57.390 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.382+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c071580 con 0x7f003c0fd840 2022-09-07T19:34:57.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.384+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f002c028020 con 0x7f003c0fd840 2022-09-07T19:34:57.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.384+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c060310 con 0x7f003c0fd840 2022-09-07T19:34:57.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.384+0000 7f002b7fe700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0024035910 0x7f0024037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:34:57.394 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.384+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f002c048c50 con 0x7f003c0fd840 2022-09-07T19:34:57.394 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.384+0000 7f0039d9b700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0024035910 0x7f0024037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:34:57.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.385+0000 7f0039d9b700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0024035910 0x7f0024037dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0030009750 tx=0x7f0030006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:34:57.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.389+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f002c017440 con 0x7f003c0fd840 2022-09-07T19:34:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.593+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f003c0717c0 con 0x7f0024035910 2022-09-07T19:34:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.597+0000 7f002b7fe700 1 -- 172.21.15.80:0/199548122 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f003c0717c0 con 0x7f0024035910 2022-09-07T19:34:57.600 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0024035910 msgr2=0x7f0024037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:57.600 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0024035910 0x7f0024037dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0030009750 tx=0x7f0030006cc0 comp rx=0 tx=0).stop 2022-09-07T19:34:57.601 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 msgr2=0x7f003c072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:34:57.601 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c072a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f002c0059c0 tx=0x7f002c005420 comp rx=0 tx=0).stop 2022-09-07T19:34:57.601 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 shutdown_connections 2022-09-07T19:34:57.602 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0024035910 0x7f0024037dc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:57.602 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 --2- 172.21.15.80:0/199548122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f003c0fd840 0x7f003c072a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:34:57.603 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 >> 172.21.15.80:0/199548122 conn(0x7f003c0f8e70 msgr2=0x7f003c0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:34:57.603 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 shutdown_connections 2022-09-07T19:34:57.604 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:34:57.600+0000 7f0040cc4700 1 -- 172.21.15.80:0/199548122 wait complete. 2022-09-07T19:34:58.112 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2022-09-07T19:34:58.113 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:34:58.113 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2022-09-07T19:34:58.135 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:34:58.136 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:34:58.195 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2022-09-07T19:34:58.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch host add smithi154 2022-09-07T19:34:58.855 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:34:58.855 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:34:58.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:34:58.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:34:58.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:34:58.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: Updating smithi080:/etc/ceph/ceph.conf 2022-09-07T19:34:58.857 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:34:58 smithi080 ceph-mon[90124]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:34:59.090 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:00.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:00 smithi080 ceph-mon[90124]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.689+0000 7f1a24fe2700 1 -- 172.21.15.80:0/2843326493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 msgr2=0x7f1a20103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.689+0000 7f1a24fe2700 1 --2- 172.21.15.80:0/2843326493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a20103a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009790 tx=0x7f1a10009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.689+0000 7f1a24fe2700 1 -- 172.21.15.80:0/2843326493 shutdown_connections 2022-09-07T19:35:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.689+0000 7f1a24fe2700 1 --2- 172.21.15.80:0/2843326493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a20103a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.689+0000 7f1a24fe2700 1 -- 172.21.15.80:0/2843326493 >> 172.21.15.80:0/2843326493 conn(0x7f1a200f9260 msgr2=0x7f1a200fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.690+0000 7f1a24fe2700 1 -- 172.21.15.80:0/2843326493 shutdown_connections 2022-09-07T19:35:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.690+0000 7f1a24fe2700 1 -- 172.21.15.80:0/2843326493 wait complete. 2022-09-07T19:35:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.691+0000 7f1a24fe2700 1 Processor -- start 2022-09-07T19:35:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.691+0000 7f1a24fe2700 1 -- start start 2022-09-07T19:35:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.691+0000 7f1a24fe2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a2019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.691+0000 7f1a24fe2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2019add0 con 0x7f1a201036a0 2022-09-07T19:35:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.692+0000 7f1a1f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a2019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.692+0000 7f1a1f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a2019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54914/0 (socket says 172.21.15.80:54914) 2022-09-07T19:35:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.692+0000 7f1a1f7fe700 1 -- 172.21.15.80:0/3349433764 learned_addr learned my addr 172.21.15.80:0/3349433764 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.692+0000 7f1a1f7fe700 1 -- 172.21.15.80:0/3349433764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009470 con 0x7f1a201036a0 2022-09-07T19:35:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.692+0000 7f1a1f7fe700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a2019a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a100059c0 tx=0x7f1a10005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.693+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a1001d070 con 0x7f1a201036a0 2022-09-07T19:35:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.693+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f1a1000fd80 con 0x7f1a201036a0 2022-09-07T19:35:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.693+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2019afd0 con 0x7f1a201036a0 2022-09-07T19:35:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.693+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a10017df0 con 0x7f1a201036a0 2022-09-07T19:35:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.693+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2019b400 con 0x7f1a201036a0 2022-09-07T19:35:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.694+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a20060310 con 0x7f1a201036a0 2022-09-07T19:35:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.695+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f1a10028020 con 0x7f1a201036a0 2022-09-07T19:35:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.695+0000 7f1a1cff9700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a08035910 0x7f1a08037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.695+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1a10048a70 con 0x7f1a201036a0 2022-09-07T19:35:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.695+0000 7f1a1effd700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a08035910 0x7f1a08037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.696+0000 7f1a1effd700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a08035910 0x7f1a08037dc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009750 tx=0x7f1a14006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.701+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f1a1000f8e0 con 0x7f1a201036a0 2022-09-07T19:35:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:00.954+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a20071620 con 0x7f1a08035910 2022-09-07T19:35:01.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:01 smithi080 ceph-mon[90124]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:01.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:01 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:01.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:01 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:01.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:01 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:02.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:02 smithi080 ceph-mon[90124]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:02.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:02 smithi080 ceph-mon[90124]: Deploying cephadm binary to smithi154 2022-09-07T19:35:02.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.903+0000 7f1a1cff9700 1 -- 172.21.15.80:0/3349433764 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1a20071620 con 0x7f1a08035910 2022-09-07T19:35:02.904 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi154' with addr '172.21.15.154' 2022-09-07T19:35:02.906 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.906+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a08035910 msgr2=0x7f1a08037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:02.906 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.906+0000 7f1a24fe2700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a08035910 0x7f1a08037dc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009750 tx=0x7f1a14006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:02.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.906+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 msgr2=0x7f1a2019a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:02.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.906+0000 7f1a24fe2700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a2019a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a100059c0 tx=0x7f1a10005390 comp rx=0 tx=0).stop 2022-09-07T19:35:02.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.907+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 shutdown_connections 2022-09-07T19:35:02.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.907+0000 7f1a24fe2700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a08035910 0x7f1a08037dc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:02.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.907+0000 7f1a24fe2700 1 --2- 172.21.15.80:0/3349433764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a201036a0 0x7f1a2019a890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:02.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.907+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 >> 172.21.15.80:0/3349433764 conn(0x7f1a200f9260 msgr2=0x7f1a20070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:02.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.907+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 shutdown_connections 2022-09-07T19:35:02.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:02.907+0000 7f1a24fe2700 1 -- 172.21.15.80:0/3349433764 wait complete. 2022-09-07T19:35:03.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch host ls --format=json 2022-09-07T19:35:03.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:03 smithi080 ceph-mon[90124]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:03.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:03.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:03.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:03.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:04.235 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:04.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:04 smithi080 ceph-mon[90124]: Added host smithi154 2022-09-07T19:35:04.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:04.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:05.487 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:05 smithi080 ceph-mon[90124]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:05.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:05.766 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 -- 172.21.15.80:0/1506290067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 msgr2=0x7ff70c102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 --2- 172.21.15.80:0/1506290067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c102d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009790 tx=0x7ff6fc009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 -- 172.21.15.80:0/1506290067 shutdown_connections 2022-09-07T19:35:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 --2- 172.21.15.80:0/1506290067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c102d20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 -- 172.21.15.80:0/1506290067 >> 172.21.15.80:0/1506290067 conn(0x7ff70c0727f0 msgr2=0x7ff70c072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 -- 172.21.15.80:0/1506290067 shutdown_connections 2022-09-07T19:35:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.765+0000 7ff711a41700 1 -- 172.21.15.80:0/1506290067 wait complete. 2022-09-07T19:35:05.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.767+0000 7ff711a41700 1 Processor -- start 2022-09-07T19:35:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.767+0000 7ff711a41700 1 -- start start 2022-09-07T19:35:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.767+0000 7ff711a41700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:05.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.767+0000 7ff711a41700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c1953d0 con 0x7ff70c102950 2022-09-07T19:35:05.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.768+0000 7ff70affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.768+0000 7ff70affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c194e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58952/0 (socket says 172.21.15.80:58952) 2022-09-07T19:35:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.768+0000 7ff70affd700 1 -- 172.21.15.80:0/2445295763 learned_addr learned my addr 172.21.15.80:0/2445295763 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:05.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.768+0000 7ff70affd700 1 -- 172.21.15.80:0/2445295763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc009470 con 0x7ff70c102950 2022-09-07T19:35:05.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.768+0000 7ff70affd700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c194e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc005dd0 tx=0x7ff6fc005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:05.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.769+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6fc01d070 con 0x7ff70c102950 2022-09-07T19:35:05.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.769+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff6fc00fcc0 con 0x7ff70c102950 2022-09-07T19:35:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.769+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c1955d0 con 0x7ff70c102950 2022-09-07T19:35:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.769+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6fc017e20 con 0x7ff70c102950 2022-09-07T19:35:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.769+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c195a00 con 0x7ff70c102950 2022-09-07T19:35:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.770+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7ff6fc028020 con 0x7ff70c102950 2022-09-07T19:35:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.770+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c060310 con 0x7ff70c102950 2022-09-07T19:35:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.770+0000 7ff710a3f700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff6f40358d0 0x7ff6f4037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.770+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff6fc048ae0 con 0x7ff70c102950 2022-09-07T19:35:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.771+0000 7ff70a7fc700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff6f40358d0 0x7ff6f4037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.771+0000 7ff70a7fc700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff6f40358d0 0x7ff6f4037d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff700009750 tx=0x7ff700006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.775+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff6fc021830 con 0x7ff70c102950 2022-09-07T19:35:05.991 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.992+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff70c1962f0 con 0x7ff6f40358d0 2022-09-07T19:35:05.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.993+0000 7ff710a3f700 1 -- 172.21.15.80:0/2445295763 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7ff70c1962f0 con 0x7ff6f40358d0 2022-09-07T19:35:05.994 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:35:05.995 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2022-09-07T19:35:05.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.995+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff6f40358d0 msgr2=0x7ff6f4037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:05.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.995+0000 7ff711a41700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff6f40358d0 0x7ff6f4037d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff700009750 tx=0x7ff700006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:05.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.995+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 msgr2=0x7ff70c194e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:05.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.995+0000 7ff711a41700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c194e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc005dd0 tx=0x7ff6fc005390 comp rx=0 tx=0).stop 2022-09-07T19:35:05.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.996+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 shutdown_connections 2022-09-07T19:35:05.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.996+0000 7ff711a41700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff6f40358d0 0x7ff6f4037d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:05.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.996+0000 7ff711a41700 1 --2- 172.21.15.80:0/2445295763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c102950 0x7ff70c194e90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:05.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.996+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 >> 172.21.15.80:0/2445295763 conn(0x7ff70c0727f0 msgr2=0x7ff70c0fb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:05.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.996+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 shutdown_connections 2022-09-07T19:35:05.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:05.996+0000 7ff711a41700 1 -- 172.21.15.80:0/2445295763 wait complete. 2022-09-07T19:35:06.497 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi155 2022-09-07T19:35:06.498 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:35:06.499 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.conf 2022-09-07T19:35:06.520 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:35:06.520 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:06.580 INFO:tasks.cephadm:Adding host smithi155 to orchestrator... 2022-09-07T19:35:06.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch host add smithi155 2022-09-07T19:35:07.448 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:07.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:07 smithi080 ceph-mon[90124]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:07.709 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:07 smithi080 ceph-mon[90124]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:35:08.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 -- 172.21.15.80:0/4093038702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 msgr2=0x7f7374102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:08.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 --2- 172.21.15.80:0/4093038702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374102d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7370009790 tx=0x7f7370009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:08.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 -- 172.21.15.80:0/4093038702 shutdown_connections 2022-09-07T19:35:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 --2- 172.21.15.80:0/4093038702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374102d20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 -- 172.21.15.80:0/4093038702 >> 172.21.15.80:0/4093038702 conn(0x7f73740727f0 msgr2=0x7f7374072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 -- 172.21.15.80:0/4093038702 shutdown_connections 2022-09-07T19:35:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.866+0000 7f737bec1700 1 -- 172.21.15.80:0/4093038702 wait complete. 2022-09-07T19:35:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.868+0000 7f737bec1700 1 Processor -- start 2022-09-07T19:35:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.868+0000 7f737bec1700 1 -- start start 2022-09-07T19:35:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.868+0000 7f737bec1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.868+0000 7f737bec1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73741953b0 con 0x7f7374102950 2022-09-07T19:35:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.869+0000 7f7379c5d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.869+0000 7f7379c5d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374194e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58960/0 (socket says 172.21.15.80:58960) 2022-09-07T19:35:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.869+0000 7f7379c5d700 1 -- 172.21.15.80:0/197064786 learned_addr learned my addr 172.21.15.80:0/197064786 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.869+0000 7f7379c5d700 1 -- 172.21.15.80:0/197064786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7370009470 con 0x7f7374102950 2022-09-07T19:35:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.869+0000 7f7379c5d700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374194e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7370005dd0 tx=0x7f7370005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.870+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f737001d070 con 0x7f7374102950 2022-09-07T19:35:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.870+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73741955b0 con 0x7f7374102950 2022-09-07T19:35:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.870+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f737000fcc0 con 0x7f7374102950 2022-09-07T19:35:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.870+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7370017e20 con 0x7f7374102950 2022-09-07T19:35:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.870+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73741959e0 con 0x7f7374102950 2022-09-07T19:35:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.871+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f7370028020 con 0x7f7374102950 2022-09-07T19:35:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.871+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374060310 con 0x7f7374102950 2022-09-07T19:35:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.871+0000 7f736affd700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f73600358d0 0x7f7360037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.872+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7370048ae0 con 0x7f7374102950 2022-09-07T19:35:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.872+0000 7f737945c700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f73600358d0 0x7f7360037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.872+0000 7f737945c700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f73600358d0 0x7f7360037d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7364009750 tx=0x7f7364006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:08.876+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f7370021830 con 0x7f7374102950 2022-09-07T19:35:09.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:09.093+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}) v1 -- 0x7f73741962d0 con 0x7f73600358d0 2022-09-07T19:35:09.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:09.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:09.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:09.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:09.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:09.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:35:09.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:10.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:10 smithi080 ceph-mon[90124]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:10.934 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.934+0000 7f736affd700 1 -- 172.21.15.80:0/197064786 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f73741962d0 con 0x7f73600358d0 2022-09-07T19:35:10.936 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi155' with addr '172.21.15.155' 2022-09-07T19:35:10.938 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f73600358d0 msgr2=0x7f7360037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:10.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f73600358d0 0x7f7360037d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7364009750 tx=0x7f7364006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:10.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 msgr2=0x7f7374194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:10.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374194e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7370005dd0 tx=0x7f7370005390 comp rx=0 tx=0).stop 2022-09-07T19:35:10.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 shutdown_connections 2022-09-07T19:35:10.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f73600358d0 0x7f7360037d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:10.942 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 --2- 172.21.15.80:0/197064786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7374102950 0x7f7374194e70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:10.942 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 >> 172.21.15.80:0/197064786 conn(0x7f73740727f0 msgr2=0x7f73740fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:10.943 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 shutdown_connections 2022-09-07T19:35:10.943 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:10.937+0000 7f737bec1700 1 -- 172.21.15.80:0/197064786 wait complete. 2022-09-07T19:35:11.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:11 smithi080 ceph-mon[90124]: Deploying cephadm binary to smithi155 2022-09-07T19:35:11.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:11 smithi080 ceph-mon[90124]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:11.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:11.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:11.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:11.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:11.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch host ls --format=json 2022-09-07T19:35:12.434 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:12.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: Added host smithi155 2022-09-07T19:35:12.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:35:12.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:12.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:12.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:12.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:12.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:12.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:13.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:13 smithi080 ceph-mon[90124]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:13.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:13 smithi080 ceph-mon[90124]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:13.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:13.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.956+0000 7fcf3c338700 1 -- 172.21.15.80:0/3558150263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 msgr2=0x7fcf34102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:13.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.956+0000 7fcf3c338700 1 --2- 172.21.15.80:0/3558150263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34102d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009790 tx=0x7fcf30009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:13.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.957+0000 7fcf3c338700 1 -- 172.21.15.80:0/3558150263 shutdown_connections 2022-09-07T19:35:13.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.957+0000 7fcf3c338700 1 --2- 172.21.15.80:0/3558150263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34102d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:13.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.957+0000 7fcf3c338700 1 -- 172.21.15.80:0/3558150263 >> 172.21.15.80:0/3558150263 conn(0x7fcf340727f0 msgr2=0x7fcf34072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:13.959 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.957+0000 7fcf3c338700 1 -- 172.21.15.80:0/3558150263 shutdown_connections 2022-09-07T19:35:13.959 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.957+0000 7fcf3c338700 1 -- 172.21.15.80:0/3558150263 wait complete. 2022-09-07T19:35:13.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.958+0000 7fcf3c338700 1 Processor -- start 2022-09-07T19:35:13.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.958+0000 7fcf3c338700 1 -- start start 2022-09-07T19:35:13.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.959+0000 7fcf3c338700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:13.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.959+0000 7fcf3c338700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34199000 con 0x7fcf34102950 2022-09-07T19:35:13.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.959+0000 7fcf3a0d4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:13.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.959+0000 7fcf3a0d4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44710/0 (socket says 172.21.15.80:44710) 2022-09-07T19:35:13.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.959+0000 7fcf3a0d4700 1 -- 172.21.15.80:0/3129210154 learned_addr learned my addr 172.21.15.80:0/3129210154 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:13.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.959+0000 7fcf3a0d4700 1 -- 172.21.15.80:0/3129210154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009470 con 0x7fcf34102950 2022-09-07T19:35:13.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.960+0000 7fcf3a0d4700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34198ac0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf30005dd0 tx=0x7fcf30005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:13.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.960+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf3001d070 con 0x7fcf34102950 2022-09-07T19:35:13.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.960+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcf3000fcc0 con 0x7fcf34102950 2022-09-07T19:35:13.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.960+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf30017e20 con 0x7fcf34102950 2022-09-07T19:35:13.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.960+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf34199200 con 0x7fcf34102950 2022-09-07T19:35:13.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.960+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34192aa0 con 0x7fcf34102950 2022-09-07T19:35:13.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.961+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7fcf30028020 con 0x7fcf34102950 2022-09-07T19:35:13.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.961+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf34060310 con 0x7fcf34102950 2022-09-07T19:35:13.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.962+0000 7fcf2b7fe700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcf200358d0 0x7fcf20037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:13.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.962+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcf30048b30 con 0x7fcf34102950 2022-09-07T19:35:13.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.962+0000 7fcf398d3700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcf200358d0 0x7fcf20037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:13.967 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.963+0000 7fcf398d3700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcf200358d0 0x7fcf20037d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009750 tx=0x7fcf24006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:13.968 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:13.967+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fcf30021830 con 0x7fcf34102950 2022-09-07T19:35:14.183 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.184+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf34199630 con 0x7fcf200358d0 2022-09-07T19:35:14.184 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.185+0000 7fcf2b7fe700 1 -- 172.21.15.80:0/3129210154 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7fcf34199630 con 0x7fcf200358d0 2022-09-07T19:35:14.184 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:35:14.185 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}] 2022-09-07T19:35:14.189 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcf200358d0 msgr2=0x7fcf20037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:14.189 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcf200358d0 0x7fcf20037d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009750 tx=0x7fcf24006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:14.189 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 msgr2=0x7fcf34198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:14.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34198ac0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf30005dd0 tx=0x7fcf30005390 comp rx=0 tx=0).stop 2022-09-07T19:35:14.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 shutdown_connections 2022-09-07T19:35:14.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcf200358d0 0x7fcf20037d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:14.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 --2- 172.21.15.80:0/3129210154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf34102950 0x7fcf34198ac0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:14.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 >> 172.21.15.80:0/3129210154 conn(0x7fcf340727f0 msgr2=0x7fcf340fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 shutdown_connections 2022-09-07T19:35:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:14.188+0000 7fcf3c338700 1 -- 172.21.15.80:0/3129210154 wait complete. 2022-09-07T19:35:14.694 INFO:tasks.cephadm:Setting crush tunables to default 2022-09-07T19:35:14.695 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd crush tunables default 2022-09-07T19:35:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:15.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:15 smithi080 ceph-mon[90124]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:15.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:15 smithi080 ceph-mon[90124]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:35:17.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.089+0000 7f62054b2700 1 -- 172.21.15.80:0/1597964507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 msgr2=0x7f6200103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:17.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.089+0000 7f62054b2700 1 --2- 172.21.15.80:0/1597964507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f6200103a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009790 tx=0x7f61f0009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.090+0000 7f62054b2700 1 -- 172.21.15.80:0/1597964507 shutdown_connections 2022-09-07T19:35:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.090+0000 7f62054b2700 1 --2- 172.21.15.80:0/1597964507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f6200103a70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.090+0000 7f62054b2700 1 -- 172.21.15.80:0/1597964507 >> 172.21.15.80:0/1597964507 conn(0x7f62000f9260 msgr2=0x7f62000fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:17.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.090+0000 7f62054b2700 1 -- 172.21.15.80:0/1597964507 shutdown_connections 2022-09-07T19:35:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.090+0000 7f62054b2700 1 -- 172.21.15.80:0/1597964507 wait complete. 2022-09-07T19:35:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.091+0000 7f62054b2700 1 Processor -- start 2022-09-07T19:35:17.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.091+0000 7f62054b2700 1 -- start start 2022-09-07T19:35:17.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.091+0000 7f62054b2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f620019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:17.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.091+0000 7f62054b2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620019add0 con 0x7f62001036a0 2022-09-07T19:35:17.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f620019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:17.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f620019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44720/0 (socket says 172.21.15.80:44720) 2022-09-07T19:35:17.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fffff700 1 -- 172.21.15.80:0/1838898596 learned_addr learned my addr 172.21.15.80:0/1838898596 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:17.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fffff700 1 -- 172.21.15.80:0/1838898596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009470 con 0x7f62001036a0 2022-09-07T19:35:17.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fffff700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f620019a890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61f00059c0 tx=0x7f61f0005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:17.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61f001d070 con 0x7f62001036a0 2022-09-07T19:35:17.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f61f000fd80 con 0x7f62001036a0 2022-09-07T19:35:17.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61f0017df0 con 0x7f62001036a0 2022-09-07T19:35:17.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.092+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620019afd0 con 0x7f62001036a0 2022-09-07T19:35:17.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.093+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620019b400 con 0x7f62001036a0 2022-09-07T19:35:17.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.094+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f61f0028020 con 0x7f62001036a0 2022-09-07T19:35:17.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.094+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6200060310 con 0x7f62001036a0 2022-09-07T19:35:17.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.094+0000 7f61fd7fa700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f61e8035910 0x7f61e8037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:17.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.094+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f61f00489d0 con 0x7f62001036a0 2022-09-07T19:35:17.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.095+0000 7f61ff7fe700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f61e8035910 0x7f61e8037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:17.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.095+0000 7f61ff7fe700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f61e8035910 0x7f61e8037dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009750 tx=0x7f61f4006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:17.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.100+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f61f000f8e0 con 0x7f62001036a0 2022-09-07T19:35:17.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:17.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:17.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:17.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:17.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:17.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:35:17.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:17.321+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6200195e10 con 0x7f62001036a0 2022-09-07T19:35:18.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.006+0000 7f61fd7fa700 1 -- 172.21.15.80:0/1838898596 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f61f00213c0 con 0x7f62001036a0 2022-09-07T19:35:18.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f61e8035910 msgr2=0x7f61e8037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:18.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f61e8035910 0x7f61e8037dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009750 tx=0x7f61f4006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:18.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 msgr2=0x7f620019a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:18.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f620019a890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61f00059c0 tx=0x7f61f0005390 comp rx=0 tx=0).stop 2022-09-07T19:35:18.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 shutdown_connections 2022-09-07T19:35:18.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f61e8035910 0x7f61e8037dc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:18.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 --2- 172.21.15.80:0/1838898596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62001036a0 0x7f620019a890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:18.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.009+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 >> 172.21.15.80:0/1838898596 conn(0x7f62000f9260 msgr2=0x7f6200070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:18.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.010+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 shutdown_connections 2022-09-07T19:35:18.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:18.010+0000 7f62054b2700 1 -- 172.21.15.80:0/1838898596 wait complete. 2022-09-07T19:35:18.011 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2022-09-07T19:35:18.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:17 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1838898596' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-09-07T19:35:18.528 INFO:tasks.cephadm:Adding mon.a on smithi080 2022-09-07T19:35:18.528 INFO:tasks.cephadm:Adding mon.b on smithi154 2022-09-07T19:35:18.529 INFO:tasks.cephadm:Adding mon.c on smithi155 2022-09-07T19:35:18.529 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch apply mon '3;smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c' 2022-09-07T19:35:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2022-09-07T19:35:19.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:19 smithi080 ceph-mon[90124]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:19.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:19 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1838898596' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-09-07T19:35:19.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:19 smithi080 ceph-mon[90124]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:19.443 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2022-09-07T19:35:20.503 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.499+0000 7fd310511700 1 -- 172.21.15.155:0/3136172131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 msgr2=0x7fd3080fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:20.504 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.499+0000 7fd310511700 1 --2- 172.21.15.155:0/3136172131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3080fdc50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009790 tx=0x7fd2f8009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:20.504 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 -- 172.21.15.155:0/3136172131 shutdown_connections 2022-09-07T19:35:20.505 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 --2- 172.21.15.155:0/3136172131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3080fdc50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:20.505 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 -- 172.21.15.155:0/3136172131 >> 172.21.15.155:0/3136172131 conn(0x7fd3080f8e70 msgr2=0x7fd3080fb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:20.506 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 -- 172.21.15.155:0/3136172131 shutdown_connections 2022-09-07T19:35:20.506 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 -- 172.21.15.155:0/3136172131 wait complete. 2022-09-07T19:35:20.507 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 Processor -- start 2022-09-07T19:35:20.507 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 -- start start 2022-09-07T19:35:20.508 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3081927e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:20.509 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.500+0000 7fd310511700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308192d20 con 0x7fd3080fd840 2022-09-07T19:35:20.509 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.501+0000 7fd30e2ad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3081927e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:20.510 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.501+0000 7fd30e2ad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3081927e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.155:53604/0 (socket says 172.21.15.155:53604) 2022-09-07T19:35:20.511 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.501+0000 7fd30e2ad700 1 -- 172.21.15.155:0/411630551 learned_addr learned my addr 172.21.15.155:0/411630551 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:35:20.511 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.501+0000 7fd30e2ad700 1 -- 172.21.15.155:0/411630551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8009470 con 0x7fd3080fd840 2022-09-07T19:35:20.512 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.501+0000 7fd30e2ad700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3081927e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80059c0 tx=0x7fd2f8005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:20.512 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.502+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f801d070 con 0x7fd3080fd840 2022-09-07T19:35:20.513 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.502+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308192f20 con 0x7fd3080fd840 2022-09-07T19:35:20.513 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.502+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd2f800fe80 con 0x7fd3080fd840 2022-09-07T19:35:20.514 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.502+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f800b460 con 0x7fd3080fd840 2022-09-07T19:35:20.514 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.502+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3081933d0 con 0x7fd3080fd840 2022-09-07T19:35:20.515 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.503+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd308103510 con 0x7fd3080fd840 2022-09-07T19:35:20.515 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.503+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7fd2f8028020 con 0x7fd3080fd840 2022-09-07T19:35:20.515 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.503+0000 7fd2ff7fe700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd2f40358d0 0x7fd2f4037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:20.516 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.503+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd2f8048c60 con 0x7fd3080fd840 2022-09-07T19:35:20.516 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.503+0000 7fd30daac700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd2f40358d0 0x7fd2f4037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.504+0000 7fd30daac700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd2f40358d0 0x7fd2f4037d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd304009750 tx=0x7fd304006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:20.518 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.508+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fd2f8017440 con 0x7fd3080fd840 2022-09-07T19:35:20.700 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.701+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fd30805fba0 con 0x7fd2f40358d0 2022-09-07T19:35:20.709 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.710+0000 7fd2ff7fe700 1 -- 172.21.15.155:0/411630551 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd30805fba0 con 0x7fd2f40358d0 2022-09-07T19:35:20.710 INFO:teuthology.orchestra.run.smithi155.stdout:Scheduled mon update... 2022-09-07T19:35:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd2f40358d0 msgr2=0x7fd2f4037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd2f40358d0 0x7fd2f4037d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd304009750 tx=0x7fd304006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 msgr2=0x7fd3081927e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3081927e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80059c0 tx=0x7fd2f8005420 comp rx=0 tx=0).stop 2022-09-07T19:35:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 shutdown_connections 2022-09-07T19:35:20.713 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd2f40358d0 0x7fd2f4037d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:20.713 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 --2- 172.21.15.155:0/411630551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3080fd840 0x7fd3081927e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:20.713 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 >> 172.21.15.155:0/411630551 conn(0x7fd3080f8e70 msgr2=0x7fd3080f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:20.713 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.712+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 shutdown_connections 2022-09-07T19:35:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:20.713+0000 7fd310511700 1 -- 172.21.15.155:0/411630551 wait complete. 2022-09-07T19:35:21.186 DEBUG:teuthology.orchestra.run.smithi154:mon.b> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.b.service 2022-09-07T19:35:21.189 DEBUG:teuthology.orchestra.run.smithi155:mon.c> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mon.c.service 2022-09-07T19:35:21.192 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2022-09-07T19:35:21.192 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph mon dump -f json 2022-09-07T19:35:21.219 INFO:journalctl@ceph.mon.c.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:35:21.221 INFO:journalctl@ceph.mon.b.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:35:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:21 smithi080 ceph-mon[90124]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:21.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:21.846 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:22.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:22.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: Saving service mon spec with placement smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c;count:3 2022-09-07T19:35:22.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:35:22.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:22.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:22.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:22.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:22.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:22.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:22.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:23.198 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 -- 172.21.15.155:0/3923606170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 msgr2=0x7f190c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:23.198 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 --2- 172.21.15.155:0/3923606170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c102d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1908009790 tx=0x7f1908009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:23.198 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 -- 172.21.15.155:0/3923606170 shutdown_connections 2022-09-07T19:35:23.199 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 --2- 172.21.15.155:0/3923606170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c102d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:23.199 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 -- 172.21.15.155:0/3923606170 >> 172.21.15.155:0/3923606170 conn(0x7f190c0727f0 msgr2=0x7f190c072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:23.199 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 -- 172.21.15.155:0/3923606170 shutdown_connections 2022-09-07T19:35:23.199 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.193+0000 7f1914168700 1 -- 172.21.15.155:0/3923606170 wait complete. 2022-09-07T19:35:23.200 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1914168700 1 Processor -- start 2022-09-07T19:35:23.200 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1914168700 1 -- start start 2022-09-07T19:35:23.201 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1914168700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c193ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:23.201 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1914168700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c193ff0 con 0x7f190c1029c0 2022-09-07T19:35:23.202 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1911f04700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c193ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:23.202 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1911f04700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c193ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.155:53610/0 (socket says 172.21.15.155:53610) 2022-09-07T19:35:23.202 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.194+0000 7f1911f04700 1 -- 172.21.15.155:0/2109804647 learned_addr learned my addr 172.21.15.155:0/2109804647 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:35:23.203 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1911f04700 1 -- 172.21.15.155:0/2109804647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1908009470 con 0x7f190c1029c0 2022-09-07T19:35:23.203 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1911f04700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c193ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1908006010 tx=0x7f1908005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:23.204 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190801d070 con 0x7f190c1029c0 2022-09-07T19:35:23.204 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190c1941f0 con 0x7f190c1029c0 2022-09-07T19:35:23.205 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f190800fcc0 con 0x7f190c1029c0 2022-09-07T19:35:23.205 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1908017e40 con 0x7f190c1029c0 2022-09-07T19:35:23.206 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.195+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190c194620 con 0x7f190c1029c0 2022-09-07T19:35:23.206 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.196+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f1908028030 con 0x7f190c1029c0 2022-09-07T19:35:23.206 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.196+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190c066d60 con 0x7f190c1029c0 2022-09-07T19:35:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.196+0000 7f1902ffd700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f18f80358a0 0x7f18f8037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.196+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1908048890 con 0x7f190c1029c0 2022-09-07T19:35:23.208 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.197+0000 7f1911703700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f18f80358a0 0x7f18f8037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:23.208 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.197+0000 7f1911703700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f18f80358a0 0x7f18f8037d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009750 tx=0x7f18fc006cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:23.209 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.202+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f190c066d60 con 0x7f190c1029c0 2022-09-07T19:35:23.476 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.476+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f190c060310 con 0x7f190c1029c0 2022-09-07T19:35:23.478 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.477+0000 7f1902ffd700 1 -- 172.21.15.155:0/2109804647 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+710 (secure 0 0 0) 0x7f1908026030 con 0x7f190c1029c0 2022-09-07T19:35:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:35:23.480 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","modified":"2022-09-07T19:33:35.255958Z","created":"2022-09-07T19:33:35.255958Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-09-07T19:35:23.481 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f18f80358a0 msgr2=0x7f18f8037d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:23.482 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f18f80358a0 0x7f18f8037d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009750 tx=0x7f18fc006cc0 comp rx=0 tx=0).stop 2022-09-07T19:35:23.482 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 msgr2=0x7f190c193ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:23.482 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c193ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1908006010 tx=0x7f1908005390 comp rx=0 tx=0).stop 2022-09-07T19:35:23.483 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 shutdown_connections 2022-09-07T19:35:23.483 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f18f80358a0 0x7f18f8037d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:23.484 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 --2- 172.21.15.155:0/2109804647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f190c1029c0 0x7f190c193ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:23.484 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 >> 172.21.15.155:0/2109804647 conn(0x7f190c0727f0 msgr2=0x7f190c104020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:23.485 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 shutdown_connections 2022-09-07T19:35:23.485 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:23.479+0000 7f1914168700 1 -- 172.21.15.155:0/2109804647 wait complete. 2022-09-07T19:35:23.485 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2022-09-07T19:35:23.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:23 smithi080 ceph-mon[90124]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:23.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:23 smithi080 ceph-mon[90124]: Deploying daemon mon.c on smithi155 2022-09-07T19:35:23.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:23 smithi080 ceph-mon[90124]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:24.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:24 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/2109804647' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:24.814 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2022-09-07T19:35:24.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph mon dump -f json 2022-09-07T19:35:24.847 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:24 smithi155 systemd[1]: Starting Ceph mon.c for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:35:25.140 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:24 smithi155 podman[97549]: 2022-09-07T19:35:25.425 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:35:25.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 bash[97549]: 1d5daf74a68d8b27c38708f009e8850761bf1440ed6ab419cfa036dcaf62a103 2022-09-07T19:35:25.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: set uid:gid to 167:167 (ceph:ceph) 2022-09-07T19:35:25.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev), process ceph-mon, pid 7 2022-09-07T19:35:25.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pidfile_write: ignore empty --pid-file 2022-09-07T19:35:25.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: load: jerasure load: lrc 2022-09-07T19:35:25.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: RocksDB version: 6.15.5 2022-09-07T19:35:25.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-09-07T19:35:25.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Compile date Sep 7 2022 2022-09-07T19:35:25.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: DB SUMMARY 2022-09-07T19:35:25.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: DB Session ID: 7CLZ3UBPVAYHC2RNXNU0 2022-09-07T19:35:25.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: CURRENT file: CURRENT 2022-09-07T19:35:25.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: IDENTITY file: IDENTITY 2022-09-07T19:35:25.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2022-09-07T19:35:25.453 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2022-09-07T19:35:25.453 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2022-09-07T19:35:25.454 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.error_if_exists: 0 2022-09-07T19:35:25.455 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.create_if_missing: 0 2022-09-07T19:35:25.455 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.paranoid_checks: 1 2022-09-07T19:35:25.455 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-09-07T19:35:25.455 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.env: 0x55625dc10100 2022-09-07T19:35:25.455 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.fs: Posix File System 2022-09-07T19:35:25.456 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.info_log: 0x55625ec4fc20 2022-09-07T19:35:25.456 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_file_opening_threads: 16 2022-09-07T19:35:25.456 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.statistics: (nil) 2022-09-07T19:35:25.457 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.use_fsync: 0 2022-09-07T19:35:25.457 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_log_file_size: 0 2022-09-07T19:35:25.457 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-09-07T19:35:25.457 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.log_file_time_to_roll: 0 2022-09-07T19:35:25.457 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.keep_log_file_num: 1000 2022-09-07T19:35:25.458 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.recycle_log_file_num: 0 2022-09-07T19:35:25.458 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.allow_fallocate: 1 2022-09-07T19:35:25.458 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.allow_mmap_reads: 0 2022-09-07T19:35:25.459 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.allow_mmap_writes: 0 2022-09-07T19:35:25.459 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.use_direct_reads: 0 2022-09-07T19:35:25.459 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-09-07T19:35:25.459 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.create_missing_column_families: 0 2022-09-07T19:35:25.459 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.db_log_dir: 2022-09-07T19:35:25.460 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2022-09-07T19:35:25.460 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.table_cache_numshardbits: 6 2022-09-07T19:35:25.463 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.WAL_ttl_seconds: 0 2022-09-07T19:35:25.464 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.WAL_size_limit_MB: 0 2022-09-07T19:35:25.464 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-09-07T19:35:25.464 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-09-07T19:35:25.464 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.is_fd_close_on_exec: 1 2022-09-07T19:35:25.465 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.advise_random_on_open: 1 2022-09-07T19:35:25.465 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.db_write_buffer_size: 0 2022-09-07T19:35:25.466 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.write_buffer_manager: 0x55625ed44b70 2022-09-07T19:35:25.466 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-09-07T19:35:25.466 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-09-07T19:35:25.467 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-09-07T19:35:25.467 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.use_adaptive_mutex: 0 2022-09-07T19:35:25.467 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.rate_limiter: (nil) 2022-09-07T19:35:25.468 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-09-07T19:35:25.468 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.wal_recovery_mode: 2 2022-09-07T19:35:25.468 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.enable_thread_tracking: 0 2022-09-07T19:35:25.469 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.enable_pipelined_write: 0 2022-09-07T19:35:25.469 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.unordered_write: 0 2022-09-07T19:35:25.470 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-09-07T19:35:25.470 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-09-07T19:35:25.471 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-09-07T19:35:25.471 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-09-07T19:35:25.472 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.row_cache: None 2022-09-07T19:35:25.472 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.wal_filter: None 2022-09-07T19:35:25.473 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-09-07T19:35:25.473 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.allow_ingest_behind: 0 2022-09-07T19:35:25.473 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.preserve_deletes: 0 2022-09-07T19:35:25.474 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.two_write_queues: 0 2022-09-07T19:35:25.474 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.manual_wal_flush: 0 2022-09-07T19:35:25.474 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.atomic_flush: 0 2022-09-07T19:35:25.475 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-09-07T19:35:25.475 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.persist_stats_to_disk: 0 2022-09-07T19:35:25.476 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.write_dbid_to_manifest: 0 2022-09-07T19:35:25.476 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.log_readahead_size: 0 2022-09-07T19:35:25.476 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-09-07T19:35:25.476 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.best_efforts_recovery: 0 2022-09-07T19:35:25.477 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-09-07T19:35:25.477 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-09-07T19:35:25.477 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.allow_data_in_errors: 0 2022-09-07T19:35:25.477 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.db_host_id: __hostname__ 2022-09-07T19:35:25.478 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_background_jobs: 2 2022-09-07T19:35:25.478 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_background_compactions: -1 2022-09-07T19:35:25.478 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_subcompactions: 1 2022-09-07T19:35:25.478 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-09-07T19:35:25.479 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-09-07T19:35:25.479 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.delayed_write_rate : 16777216 2022-09-07T19:35:25.479 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_total_wal_size: 0 2022-09-07T19:35:25.479 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-09-07T19:35:25.479 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.stats_dump_period_sec: 600 2022-09-07T19:35:25.480 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.stats_persist_period_sec: 600 2022-09-07T19:35:25.480 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-09-07T19:35:25.480 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_open_files: -1 2022-09-07T19:35:25.480 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bytes_per_sync: 0 2022-09-07T19:35:25.481 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.wal_bytes_per_sync: 0 2022-09-07T19:35:25.481 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.strict_bytes_per_sync: 0 2022-09-07T19:35:25.481 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_readahead_size: 0 2022-09-07T19:35:25.481 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_background_flushes: -1 2022-09-07T19:35:25.482 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Compression algorithms supported: 2022-09-07T19:35:25.482 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-09-07T19:35:25.482 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kZSTD supported: 0 2022-09-07T19:35:25.482 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kXpressCompression supported: 0 2022-09-07T19:35:25.483 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kLZ4HCCompression supported: 1 2022-09-07T19:35:25.483 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kZlibCompression supported: 1 2022-09-07T19:35:25.483 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kSnappyCompression supported: 1 2022-09-07T19:35:25.483 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kLZ4Compression supported: 1 2022-09-07T19:35:25.484 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: kBZip2Compression supported: 0 2022-09-07T19:35:25.484 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Fast CRC32 supported: Supported on x86 2022-09-07T19:35:25.484 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2022-09-07T19:35:25.484 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2022-09-07T19:35:25.485 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-09-07T19:35:25.485 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.merge_operator: 2022-09-07T19:35:25.485 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_filter: None 2022-09-07T19:35:25.486 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_filter_factory: None 2022-09-07T19:35:25.486 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.sst_partitioner_factory: None 2022-09-07T19:35:25.486 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.memtable_factory: SkipListFactory 2022-09-07T19:35:25.486 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.table_factory: BlockBasedTable 2022-09-07T19:35:25.487 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55625ec4cd48) 2022-09-07T19:35:25.487 INFO:journalctl@ceph.mon.c.smithi155.stdout: cache_index_and_filter_blocks: 1 2022-09-07T19:35:25.487 INFO:journalctl@ceph.mon.c.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-09-07T19:35:25.487 INFO:journalctl@ceph.mon.c.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-09-07T19:35:25.488 INFO:journalctl@ceph.mon.c.smithi155.stdout: pin_top_level_index_and_filter: 1 2022-09-07T19:35:25.488 INFO:journalctl@ceph.mon.c.smithi155.stdout: index_type: 0 2022-09-07T19:35:25.488 INFO:journalctl@ceph.mon.c.smithi155.stdout: data_block_index_type: 0 2022-09-07T19:35:25.488 INFO:journalctl@ceph.mon.c.smithi155.stdout: index_shortening: 1 2022-09-07T19:35:25.489 INFO:journalctl@ceph.mon.c.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2022-09-07T19:35:25.489 INFO:journalctl@ceph.mon.c.smithi155.stdout: hash_index_allow_collision: 1 2022-09-07T19:35:25.489 INFO:journalctl@ceph.mon.c.smithi155.stdout: checksum: 1 2022-09-07T19:35:25.489 INFO:journalctl@ceph.mon.c.smithi155.stdout: no_block_cache: 0 2022-09-07T19:35:25.489 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_cache: 0x55625ecb89b0 2022-09-07T19:35:25.490 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_cache_name: BinnedLRUCache 2022-09-07T19:35:25.490 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_cache_options: 2022-09-07T19:35:25.490 INFO:journalctl@ceph.mon.c.smithi155.stdout: capacity : 536870912 2022-09-07T19:35:25.490 INFO:journalctl@ceph.mon.c.smithi155.stdout: num_shard_bits : 4 2022-09-07T19:35:25.491 INFO:journalctl@ceph.mon.c.smithi155.stdout: strict_capacity_limit : 0 2022-09-07T19:35:25.491 INFO:journalctl@ceph.mon.c.smithi155.stdout: high_pri_pool_ratio: 0.000 2022-09-07T19:35:25.492 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_cache_compressed: (nil) 2022-09-07T19:35:25.492 INFO:journalctl@ceph.mon.c.smithi155.stdout: persistent_cache: (nil) 2022-09-07T19:35:25.493 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_size: 4096 2022-09-07T19:35:25.493 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_size_deviation: 10 2022-09-07T19:35:25.493 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_restart_interval: 16 2022-09-07T19:35:25.494 INFO:journalctl@ceph.mon.c.smithi155.stdout: index_block_restart_interval: 1 2022-09-07T19:35:25.494 INFO:journalctl@ceph.mon.c.smithi155.stdout: metadata_block_size: 4096 2022-09-07T19:35:25.495 INFO:journalctl@ceph.mon.c.smithi155.stdout: partition_filters: 0 2022-09-07T19:35:25.495 INFO:journalctl@ceph.mon.c.smithi155.stdout: use_delta_encoding: 1 2022-09-07T19:35:25.496 INFO:journalctl@ceph.mon.c.smithi155.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-09-07T19:35:25.496 INFO:journalctl@ceph.mon.c.smithi155.stdout: whole_key_filtering: 1 2022-09-07T19:35:25.497 INFO:journalctl@ceph.mon.c.smithi155.stdout: verify_compression: 0 2022-09-07T19:35:25.497 INFO:journalctl@ceph.mon.c.smithi155.stdout: read_amp_bytes_per_bit: 0 2022-09-07T19:35:25.497 INFO:journalctl@ceph.mon.c.smithi155.stdout: format_version: 4 2022-09-07T19:35:25.498 INFO:journalctl@ceph.mon.c.smithi155.stdout: enable_index_compression: 1 2022-09-07T19:35:25.498 INFO:journalctl@ceph.mon.c.smithi155.stdout: block_align: 0 2022-09-07T19:35:25.499 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.write_buffer_size: 33554432 2022-09-07T19:35:25.499 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_write_buffer_number: 2 2022-09-07T19:35:25.500 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression: NoCompression 2022-09-07T19:35:25.500 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression: Disabled 2022-09-07T19:35:25.500 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.prefix_extractor: nullptr 2022-09-07T19:35:25.501 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-09-07T19:35:25.501 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.num_levels: 7 2022-09-07T19:35:25.502 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-09-07T19:35:25.502 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-09-07T19:35:25.502 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-09-07T19:35:25.503 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-09-07T19:35:25.503 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-09-07T19:35:25.504 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-09-07T19:35:25.504 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-09-07T19:35:25.504 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-09-07T19:35:25.505 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-09-07T19:35:25.505 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-09-07T19:35:25.505 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.window_bits: -14 2022-09-07T19:35:25.505 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.level: 32767 2022-09-07T19:35:25.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.strategy: 0 2022-09-07T19:35:25.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-09-07T19:35:25.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-09-07T19:35:25.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-09-07T19:35:25.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compression_opts.enabled: false 2022-09-07T19:35:25.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-09-07T19:35:25.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-09-07T19:35:25.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-09-07T19:35:25.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.target_file_size_base: 67108864 2022-09-07T19:35:25.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.target_file_size_multiplier: 1 2022-09-07T19:35:25.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-09-07T19:35:25.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-09-07T19:35:25.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-09-07T19:35:25.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-09-07T19:35:25.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-09-07T19:35:25.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-09-07T19:35:25.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-09-07T19:35:25.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-09-07T19:35:25.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-09-07T19:35:25.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-09-07T19:35:25.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-09-07T19:35:25.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-09-07T19:35:25.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.arena_block_size: 4194304 2022-09-07T19:35:25.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-09-07T19:35:25.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-09-07T19:35:25.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-09-07T19:35:25.512 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.disable_auto_compactions: 0 2022-09-07T19:35:25.512 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-09-07T19:35:25.512 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-09-07T19:35:25.512 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-09-07T19:35:25.512 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-09-07T19:35:25.513 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-09-07T19:35:25.513 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-09-07T19:35:25.513 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-09-07T19:35:25.513 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-09-07T19:35:25.514 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-09-07T19:35:25.514 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-09-07T19:35:25.514 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.table_properties_collectors: 2022-09-07T19:35:25.514 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.inplace_update_support: 0 2022-09-07T19:35:25.515 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.inplace_update_num_locks: 10000 2022-09-07T19:35:25.515 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-09-07T19:35:25.515 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-09-07T19:35:25.515 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.memtable_huge_page_size: 0 2022-09-07T19:35:25.515 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.bloom_locality: 0 2022-09-07T19:35:25.516 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.max_successive_merges: 0 2022-09-07T19:35:25.516 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.optimize_filters_for_hits: 0 2022-09-07T19:35:25.516 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.paranoid_file_checks: 0 2022-09-07T19:35:25.516 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.force_consistency_checks: 1 2022-09-07T19:35:25.517 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.report_bg_io_stats: 0 2022-09-07T19:35:25.517 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.ttl: 2592000 2022-09-07T19:35:25.517 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.periodic_compaction_seconds: 0 2022-09-07T19:35:25.517 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.enable_blob_files: false 2022-09-07T19:35:25.517 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.min_blob_size: 0 2022-09-07T19:35:25.518 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.blob_file_size: 268435456 2022-09-07T19:35:25.518 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.blob_compression_type: NoCompression 2022-09-07T19:35:25.518 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.enable_blob_garbage_collection: false 2022-09-07T19:35:25.518 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-09-07T19:35:25.519 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-09-07T19:35:25.519 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2022-09-07T19:35:25.519 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2022-09-07T19:35:25.519 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579325157477, "job": 1, "event": "recovery_started", "wal_files": [4]} 2022-09-07T19:35:25.520 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2022-09-07T19:35:25.520 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-09-07T19:35:25.520 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579325157773, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1662579325, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "a3e83833-3dff-46b4-9364-641ca739e712", "db_session_id": "7CLZ3UBPVAYHC2RNXNU0"}} 2022-09-07T19:35:25.520 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2022-09-07T19:35:25.521 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579325158089, "job": 1, "event": "recovery_finished"} 2022-09-07T19:35:25.521 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-09-07T19:35:25.521 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55625ec9f880 2022-09-07T19:35:25.522 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: DB pointer 0x55625ed12000 2022-09-07T19:35:25.522 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2022-09-07T19:35:25.522 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-09-07T19:35:25.522 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** DB Stats ** 2022-09-07T19:35:25.523 INFO:journalctl@ceph.mon.c.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:35:25.523 INFO:journalctl@ceph.mon.c.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-09-07T19:35:25.523 INFO:journalctl@ceph.mon.c.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-09-07T19:35:25.524 INFO:journalctl@ceph.mon.c.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-09-07T19:35:25.524 INFO:journalctl@ceph.mon.c.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-09-07T19:35:25.524 INFO:journalctl@ceph.mon.c.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-09-07T19:35:25.524 INFO:journalctl@ceph.mon.c.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-09-07T19:35:25.524 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.525 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:25.525 INFO:journalctl@ceph.mon.c.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:25.525 INFO:journalctl@ceph.mon.c.smithi155.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:25.525 INFO:journalctl@ceph.mon.c.smithi155.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.526 INFO:journalctl@ceph.mon.c.smithi155.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.526 INFO:journalctl@ceph.mon.c.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.526 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.526 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:25.526 INFO:journalctl@ceph.mon.c.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:25.527 INFO:journalctl@ceph.mon.c.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:25.527 INFO:journalctl@ceph.mon.c.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.527 INFO:journalctl@ceph.mon.c.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:35:25.527 INFO:journalctl@ceph.mon.c.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:25.528 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:25.528 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-09-07T19:35:25.528 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-09-07T19:35:25.528 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2022-09-07T19:35:25.529 INFO:journalctl@ceph.mon.c.smithi155.stdout: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:25.529 INFO:journalctl@ceph.mon.c.smithi155.stdout: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:25.529 INFO:journalctl@ceph.mon.c.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-09-07T19:35:25.529 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.529 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2022-09-07T19:35:25.530 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.530 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:25.530 INFO:journalctl@ceph.mon.c.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:25.531 INFO:journalctl@ceph.mon.c.smithi155.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:25.531 INFO:journalctl@ceph.mon.c.smithi155.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.531 INFO:journalctl@ceph.mon.c.smithi155.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.531 INFO:journalctl@ceph.mon.c.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-09-07T19:35:25.531 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.532 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:25.532 INFO:journalctl@ceph.mon.c.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:25.532 INFO:journalctl@ceph.mon.c.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:25.532 INFO:journalctl@ceph.mon.c.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:25.532 INFO:journalctl@ceph.mon.c.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:35:25.533 INFO:journalctl@ceph.mon.c.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:25.533 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:25.533 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-09-07T19:35:25.533 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-09-07T19:35:25.534 INFO:journalctl@ceph.mon.c.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2022-09-07T19:35:25.534 INFO:journalctl@ceph.mon.c.smithi155.stdout: Cumulative compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:25.534 INFO:journalctl@ceph.mon.c.smithi155.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:25.534 INFO:journalctl@ceph.mon.c.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-09-07T19:35:25.535 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.535 INFO:journalctl@ceph.mon.c.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2022-09-07T19:35:25.535 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c does not exist in monmap, will attempt to join an existing cluster 2022-09-07T19:35:25.535 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: using public_addr v2:172.21.15.155:0/0 -> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] 2022-09-07T19:35:25.535 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: starting mon.c rank -1 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:35:25.536 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(???) e0 preinit fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:35:25.536 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 systemd[1]: Started Ceph mon.c for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:35:25.536 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).mds e1 new map 2022-09-07T19:35:25.536 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).mds e1 print_map 2022-09-07T19:35:25.536 INFO:journalctl@ceph.mon.c.smithi155.stdout: e1 2022-09-07T19:35:25.537 INFO:journalctl@ceph.mon.c.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-09-07T19:35:25.537 INFO:journalctl@ceph.mon.c.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-09-07T19:35:25.537 INFO:journalctl@ceph.mon.c.smithi155.stdout: legacy client fscid: -1 2022-09-07T19:35:25.538 INFO:journalctl@ceph.mon.c.smithi155.stdout: 2022-09-07T19:35:25.538 INFO:journalctl@ceph.mon.c.smithi155.stdout: No filesystems configured 2022-09-07T19:35:25.539 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2022-09-07T19:35:25.539 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2022-09-07T19:35:25.540 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2022-09-07T19:35:25.540 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2022-09-07T19:35:25.541 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2022-09-07T19:35:25.541 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2022-09-07T19:35:25.541 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2022-09-07T19:35:25.542 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:35:25.542 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:35:25.543 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:35:25.543 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.543 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.544 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:25.544 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:25.544 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:25.545 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Added host smithi154 2022-09-07T19:35:25.545 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.546 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.546 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.547 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.547 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.547 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:35:25.547 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.547 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.548 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.548 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.548 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.549 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:35:25.549 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.549 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:25.550 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Deploying cephadm binary to smithi155 2022-09-07T19:35:25.550 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.550 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.551 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:25.551 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:25.551 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:25.551 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Added host smithi155 2022-09-07T19:35:25.552 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:35:25.552 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:25.552 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.552 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:25.552 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.553 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.553 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.553 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:25.553 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.554 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.554 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.554 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:35:25.554 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.555 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.555 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.555 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.555 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.556 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:35:25.556 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.556 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1838898596' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-09-07T19:35:25.556 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.557 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1838898596' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-09-07T19:35:25.557 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:25.557 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.557 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.558 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:25.558 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:25.558 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:25.558 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:25.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Saving service mon spec with placement smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c;count:3 2022-09-07T19:35:25.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:35:25.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:25.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:25.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:25.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:25.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:25.561 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:25.561 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: Deploying daemon mon.c on smithi155 2022-09-07T19:35:25.561 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:25.561 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/2109804647' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:25.562 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2022-09-07T19:35:25.562 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:25 smithi155 ceph-mon[97606]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2022-09-07T19:35:30.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:35:30.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: mon.a calling monitor election 2022-09-07T19:35:30.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:30.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: mon.c calling monitor election 2022-09-07T19:35:30.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:30.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2022-09-07T19:35:30.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:30.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: fsmap 2022-09-07T19:35:30.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:30.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: mgrmap e13: x(active, since 48s) 2022-09-07T19:35:30.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: overall HEALTH_OK 2022-09-07T19:35:30.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:30.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:30.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:30.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:30.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:35:30.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: mon.a calling monitor election 2022-09-07T19:35:30.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:30.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: mon.c calling monitor election 2022-09-07T19:35:30.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:30.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:30.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2022-09-07T19:35:30.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:30.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: fsmap 2022-09-07T19:35:30.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:30.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: mgrmap e13: x(active, since 48s) 2022-09-07T19:35:30.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: overall HEALTH_OK 2022-09-07T19:35:30.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:30.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:30.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:30.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:30.982 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 -- 172.21.15.155:0/1593412899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae24003440 msgr2=0x7fae240058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:30.983 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/1593412899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae24003440 0x7fae240058c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae380fed40 tx=0x7fae20012d10 comp rx=0 tx=0).stop 2022-09-07T19:35:30.983 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 -- 172.21.15.155:0/1593412899 shutdown_connections 2022-09-07T19:35:30.984 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/1593412899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae24003440 0x7fae240058c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:30.984 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 -- 172.21.15.155:0/1593412899 >> 172.21.15.155:0/1593412899 conn(0x7fae380f9550 msgr2=0x7fae380fb960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:30.984 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 -- 172.21.15.155:0/1593412899 shutdown_connections 2022-09-07T19:35:30.984 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.981+0000 7fae3c8bd700 1 -- 172.21.15.155:0/1593412899 wait complete. 2022-09-07T19:35:30.987 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3c8bd700 1 Processor -- start 2022-09-07T19:35:30.987 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3c8bd700 1 -- start start 2022-09-07T19:35:30.988 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3c8bd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:30.988 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3c8bd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae38071520 0x7fae38071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:30.988 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3c8bd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3819ef00 con 0x7fae38071520 2022-09-07T19:35:30.988 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3c8bd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3819f040 con 0x7fae24003440 2022-09-07T19:35:30.989 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:30.989 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58772/0 (socket says 172.21.15.155:58772) 2022-09-07T19:35:30.989 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 -- 172.21.15.155:0/393014454 learned_addr learned my addr 172.21.15.155:0/393014454 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:35:30.989 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 -- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 msgr2=0x7fae38070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2022-09-07T19:35:30.990 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 -- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 msgr2=0x7fae38070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-07T19:35:30.990 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-07T19:35:30.990 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.983+0000 7fae3659c700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:35:30.991 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.984+0000 7fae35d9b700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae38071520 0x7fae38071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:30.991 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.984+0000 7fae35d9b700 1 -- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 msgr2=0x7fae38070fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:35:30.992 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.984+0000 7fae35d9b700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:30.992 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.984+0000 7fae35d9b700 1 -- 172.21.15.155:0/393014454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20012760 con 0x7fae38071520 2022-09-07T19:35:30.992 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.984+0000 7fae35d9b700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae38071520 0x7fae38071990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b390 tx=0x7fae2800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:30.993 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.985+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fae2800be50 con 0x7fae38071520 2022-09-07T19:35:30.993 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.985+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fae28011ad0 con 0x7fae38071520 2022-09-07T19:35:30.994 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.985+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3819f180 con 0x7fae38071520 2022-09-07T19:35:30.994 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.985+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fae28010b30 con 0x7fae38071520 2022-09-07T19:35:30.994 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.985+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3819f730 con 0x7fae38071520 2022-09-07T19:35:30.994 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.986+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae38060310 con 0x7fae38071520 2022-09-07T19:35:30.995 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.986+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7fae28021070 con 0x7fae38071520 2022-09-07T19:35:30.995 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.986+0000 7fae2f7fe700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fae18035700 0x7fae18037bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:30.995 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.986+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fae28046f70 con 0x7fae38071520 2022-09-07T19:35:30.996 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.987+0000 7fae3659c700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fae18035700 0x7fae18037bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:30.996 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.987+0000 7fae3659c700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fae18035700 0x7fae18037bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae20001eb0 tx=0x7fae20014040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:30.997 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:30.992+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fae280174a0 con 0x7fae38071520 2022-09-07T19:35:31.250 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.250+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fae381055f0 con 0x7fae38071520 2022-09-07T19:35:31.251 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.251+0000 7fae2f7fe700 1 -- 172.21.15.155:0/393014454 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+980 (secure 0 0 0) 0x7fae28043090 con 0x7fae38071520 2022-09-07T19:35:31.251 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:35:31.252 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":2,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","modified":"2022-09-07T19:35:25.187461Z","created":"2022-09-07T19:33:35.255958Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2022-09-07T19:35:31.253 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fae18035700 msgr2=0x7fae18037bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:31.253 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fae18035700 0x7fae18037bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae20001eb0 tx=0x7fae20014040 comp rx=0 tx=0).stop 2022-09-07T19:35:31.253 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae38071520 msgr2=0x7fae38071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:31.253 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae38071520 0x7fae38071990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b390 tx=0x7fae2800b6a0 comp rx=0 tx=0).stop 2022-09-07T19:35:31.254 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 shutdown_connections 2022-09-07T19:35:31.254 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fae18035700 0x7fae18037bb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:31.254 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae24003440 0x7fae38070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:31.254 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 --2- 172.21.15.155:0/393014454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae38071520 0x7fae38071990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:31.255 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 >> 172.21.15.155:0/393014454 conn(0x7fae380f9550 msgr2=0x7fae380ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:31.255 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 shutdown_connections 2022-09-07T19:35:31.256 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:31.253+0000 7fae3c8bd700 1 -- 172.21.15.155:0/393014454 wait complete. 2022-09-07T19:35:31.256 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 2 2022-09-07T19:35:31.604 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:31 smithi155 ceph-mon[97606]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:31.625 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:31 smithi155 ceph-mon[97606]: Deploying daemon mon.b on smithi154 2022-09-07T19:35:31.626 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:31.626 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:31 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/393014454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:31.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:31 smithi080 ceph-mon[90124]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:31.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:31 smithi080 ceph-mon[90124]: Deploying daemon mon.b on smithi154 2022-09-07T19:35:31.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:31.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:31 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/393014454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:32.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:35:32 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:35:32.187+0000 7f6c21fb3700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-09-07T19:35:32.663 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2022-09-07T19:35:32.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph mon dump -f json 2022-09-07T19:35:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:32 smithi154 systemd[1]: Starting Ceph mon.b for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:35:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:35:33.333 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 podman[96927]: 2022-09-07T19:35:33.333 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 bash[96927]: a65d4b6d39eadd9b8e6282885c1ec777a71d08ede31ee8f8e9f6ede505b80f50 2022-09-07T19:35:33.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: set uid:gid to 167:167 (ceph:ceph) 2022-09-07T19:35:33.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev), process ceph-mon, pid 7 2022-09-07T19:35:33.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pidfile_write: ignore empty --pid-file 2022-09-07T19:35:33.335 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: load: jerasure load: lrc 2022-09-07T19:35:33.335 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: RocksDB version: 6.15.5 2022-09-07T19:35:33.335 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-09-07T19:35:33.335 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Compile date Sep 7 2022 2022-09-07T19:35:33.335 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: DB SUMMARY 2022-09-07T19:35:33.336 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: DB Session ID: G7RIJZVEP0WRQDHUQ6U0 2022-09-07T19:35:33.336 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: CURRENT file: CURRENT 2022-09-07T19:35:33.337 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: IDENTITY file: IDENTITY 2022-09-07T19:35:33.337 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2022-09-07T19:35:33.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2022-09-07T19:35:33.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2022-09-07T19:35:33.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.error_if_exists: 0 2022-09-07T19:35:33.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.create_if_missing: 0 2022-09-07T19:35:33.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.paranoid_checks: 1 2022-09-07T19:35:33.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-09-07T19:35:33.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.env: 0x55f31be5d100 2022-09-07T19:35:33.341 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.fs: Posix File System 2022-09-07T19:35:33.342 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.info_log: 0x55f31d6f5c20 2022-09-07T19:35:33.342 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_file_opening_threads: 16 2022-09-07T19:35:33.344 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.statistics: (nil) 2022-09-07T19:35:33.344 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.use_fsync: 0 2022-09-07T19:35:33.344 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_log_file_size: 0 2022-09-07T19:35:33.344 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-09-07T19:35:33.345 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.log_file_time_to_roll: 0 2022-09-07T19:35:33.345 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.keep_log_file_num: 1000 2022-09-07T19:35:33.345 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.recycle_log_file_num: 0 2022-09-07T19:35:33.346 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.allow_fallocate: 1 2022-09-07T19:35:33.346 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.allow_mmap_reads: 0 2022-09-07T19:35:33.346 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.allow_mmap_writes: 0 2022-09-07T19:35:33.346 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.use_direct_reads: 0 2022-09-07T19:35:33.347 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-09-07T19:35:33.347 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.create_missing_column_families: 0 2022-09-07T19:35:33.347 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.db_log_dir: 2022-09-07T19:35:33.347 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2022-09-07T19:35:33.348 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.table_cache_numshardbits: 6 2022-09-07T19:35:33.348 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.WAL_ttl_seconds: 0 2022-09-07T19:35:33.348 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.WAL_size_limit_MB: 0 2022-09-07T19:35:33.348 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-09-07T19:35:33.349 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-09-07T19:35:33.349 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.is_fd_close_on_exec: 1 2022-09-07T19:35:33.349 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.advise_random_on_open: 1 2022-09-07T19:35:33.349 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.db_write_buffer_size: 0 2022-09-07T19:35:33.350 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.write_buffer_manager: 0x55f31d7eab10 2022-09-07T19:35:33.350 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-09-07T19:35:33.350 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-09-07T19:35:33.350 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-09-07T19:35:33.351 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.use_adaptive_mutex: 0 2022-09-07T19:35:33.351 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.rate_limiter: (nil) 2022-09-07T19:35:33.351 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-09-07T19:35:33.351 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.wal_recovery_mode: 2 2022-09-07T19:35:33.351 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.enable_thread_tracking: 0 2022-09-07T19:35:33.352 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.enable_pipelined_write: 0 2022-09-07T19:35:33.352 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.unordered_write: 0 2022-09-07T19:35:33.352 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-09-07T19:35:33.352 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-09-07T19:35:33.353 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-09-07T19:35:33.353 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-09-07T19:35:33.353 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.row_cache: None 2022-09-07T19:35:33.353 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.wal_filter: None 2022-09-07T19:35:33.354 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-09-07T19:35:33.354 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.allow_ingest_behind: 0 2022-09-07T19:35:33.354 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.preserve_deletes: 0 2022-09-07T19:35:33.354 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.two_write_queues: 0 2022-09-07T19:35:33.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.manual_wal_flush: 0 2022-09-07T19:35:33.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.atomic_flush: 0 2022-09-07T19:35:33.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-09-07T19:35:33.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.persist_stats_to_disk: 0 2022-09-07T19:35:33.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.write_dbid_to_manifest: 0 2022-09-07T19:35:33.356 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.log_readahead_size: 0 2022-09-07T19:35:33.356 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-09-07T19:35:33.356 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.best_efforts_recovery: 0 2022-09-07T19:35:33.356 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-09-07T19:35:33.357 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-09-07T19:35:33.357 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.allow_data_in_errors: 0 2022-09-07T19:35:33.357 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.db_host_id: __hostname__ 2022-09-07T19:35:33.357 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_background_jobs: 2 2022-09-07T19:35:33.358 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_background_compactions: -1 2022-09-07T19:35:33.358 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_subcompactions: 1 2022-09-07T19:35:33.358 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-09-07T19:35:33.358 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-09-07T19:35:33.359 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.delayed_write_rate : 16777216 2022-09-07T19:35:33.359 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_total_wal_size: 0 2022-09-07T19:35:33.359 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-09-07T19:35:33.359 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.stats_dump_period_sec: 600 2022-09-07T19:35:33.360 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.stats_persist_period_sec: 600 2022-09-07T19:35:33.360 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-09-07T19:35:33.360 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_open_files: -1 2022-09-07T19:35:33.360 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bytes_per_sync: 0 2022-09-07T19:35:33.361 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.wal_bytes_per_sync: 0 2022-09-07T19:35:33.361 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.strict_bytes_per_sync: 0 2022-09-07T19:35:33.361 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_readahead_size: 0 2022-09-07T19:35:33.361 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_background_flushes: -1 2022-09-07T19:35:33.362 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Compression algorithms supported: 2022-09-07T19:35:33.362 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-09-07T19:35:33.362 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kZSTD supported: 0 2022-09-07T19:35:33.362 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kXpressCompression supported: 0 2022-09-07T19:35:33.363 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kLZ4HCCompression supported: 1 2022-09-07T19:35:33.363 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kZlibCompression supported: 1 2022-09-07T19:35:33.363 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kSnappyCompression supported: 1 2022-09-07T19:35:33.363 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kLZ4Compression supported: 1 2022-09-07T19:35:33.364 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: kBZip2Compression supported: 0 2022-09-07T19:35:33.364 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Fast CRC32 supported: Supported on x86 2022-09-07T19:35:33.364 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2022-09-07T19:35:33.364 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2022-09-07T19:35:33.365 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-09-07T19:35:33.365 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.merge_operator: 2022-09-07T19:35:33.365 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_filter: None 2022-09-07T19:35:33.365 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_filter_factory: None 2022-09-07T19:35:33.366 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.sst_partitioner_factory: None 2022-09-07T19:35:33.366 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.memtable_factory: SkipListFactory 2022-09-07T19:35:33.366 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.table_factory: BlockBasedTable 2022-09-07T19:35:33.366 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f31d6f2d48) 2022-09-07T19:35:33.366 INFO:journalctl@ceph.mon.b.smithi154.stdout: cache_index_and_filter_blocks: 1 2022-09-07T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-09-07T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-09-07T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi154.stdout: pin_top_level_index_and_filter: 1 2022-09-07T19:35:33.367 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_type: 0 2022-09-07T19:35:33.368 INFO:journalctl@ceph.mon.b.smithi154.stdout: data_block_index_type: 0 2022-09-07T19:35:33.368 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_shortening: 1 2022-09-07T19:35:33.368 INFO:journalctl@ceph.mon.b.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2022-09-07T19:35:33.368 INFO:journalctl@ceph.mon.b.smithi154.stdout: hash_index_allow_collision: 1 2022-09-07T19:35:33.369 INFO:journalctl@ceph.mon.b.smithi154.stdout: checksum: 1 2022-09-07T19:35:33.369 INFO:journalctl@ceph.mon.b.smithi154.stdout: no_block_cache: 0 2022-09-07T19:35:33.369 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache: 0x55f31d75e9b0 2022-09-07T19:35:33.369 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_name: BinnedLRUCache 2022-09-07T19:35:33.369 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_options: 2022-09-07T19:35:33.370 INFO:journalctl@ceph.mon.b.smithi154.stdout: capacity : 536870912 2022-09-07T19:35:33.370 INFO:journalctl@ceph.mon.b.smithi154.stdout: num_shard_bits : 4 2022-09-07T19:35:33.370 INFO:journalctl@ceph.mon.b.smithi154.stdout: strict_capacity_limit : 0 2022-09-07T19:35:33.370 INFO:journalctl@ceph.mon.b.smithi154.stdout: high_pri_pool_ratio: 0.000 2022-09-07T19:35:33.371 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_compressed: (nil) 2022-09-07T19:35:33.371 INFO:journalctl@ceph.mon.b.smithi154.stdout: persistent_cache: (nil) 2022-09-07T19:35:33.371 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_size: 4096 2022-09-07T19:35:33.371 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_size_deviation: 10 2022-09-07T19:35:33.372 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_restart_interval: 16 2022-09-07T19:35:33.372 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_block_restart_interval: 1 2022-09-07T19:35:33.372 INFO:journalctl@ceph.mon.b.smithi154.stdout: metadata_block_size: 4096 2022-09-07T19:35:33.372 INFO:journalctl@ceph.mon.b.smithi154.stdout: partition_filters: 0 2022-09-07T19:35:33.373 INFO:journalctl@ceph.mon.b.smithi154.stdout: use_delta_encoding: 1 2022-09-07T19:35:33.373 INFO:journalctl@ceph.mon.b.smithi154.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-09-07T19:35:33.373 INFO:journalctl@ceph.mon.b.smithi154.stdout: whole_key_filtering: 1 2022-09-07T19:35:33.373 INFO:journalctl@ceph.mon.b.smithi154.stdout: verify_compression: 0 2022-09-07T19:35:33.374 INFO:journalctl@ceph.mon.b.smithi154.stdout: read_amp_bytes_per_bit: 0 2022-09-07T19:35:33.374 INFO:journalctl@ceph.mon.b.smithi154.stdout: format_version: 4 2022-09-07T19:35:33.374 INFO:journalctl@ceph.mon.b.smithi154.stdout: enable_index_compression: 1 2022-09-07T19:35:33.374 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_align: 0 2022-09-07T19:35:33.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.write_buffer_size: 33554432 2022-09-07T19:35:33.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_write_buffer_number: 2 2022-09-07T19:35:33.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression: NoCompression 2022-09-07T19:35:33.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression: Disabled 2022-09-07T19:35:33.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.prefix_extractor: nullptr 2022-09-07T19:35:33.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-09-07T19:35:33.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.num_levels: 7 2022-09-07T19:35:33.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-09-07T19:35:33.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-09-07T19:35:33.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-09-07T19:35:33.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-09-07T19:35:33.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-09-07T19:35:33.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-09-07T19:35:33.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-09-07T19:35:33.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-09-07T19:35:33.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-09-07T19:35:33.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-09-07T19:35:33.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.window_bits: -14 2022-09-07T19:35:33.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.level: 32767 2022-09-07T19:35:33.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.strategy: 0 2022-09-07T19:35:33.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-09-07T19:35:33.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-09-07T19:35:33.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-09-07T19:35:33.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compression_opts.enabled: false 2022-09-07T19:35:33.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-09-07T19:35:33.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-09-07T19:35:33.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-09-07T19:35:33.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.target_file_size_base: 67108864 2022-09-07T19:35:33.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.target_file_size_multiplier: 1 2022-09-07T19:35:33.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-09-07T19:35:33.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-09-07T19:35:33.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-09-07T19:35:33.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-09-07T19:35:33.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-09-07T19:35:33.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-09-07T19:35:33.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-09-07T19:35:33.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-09-07T19:35:33.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-09-07T19:35:33.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-09-07T19:35:33.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-09-07T19:35:33.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-09-07T19:35:33.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.arena_block_size: 4194304 2022-09-07T19:35:33.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-09-07T19:35:33.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-09-07T19:35:33.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-09-07T19:35:33.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.disable_auto_compactions: 0 2022-09-07T19:35:33.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-09-07T19:35:33.386 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-09-07T19:35:33.386 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-09-07T19:35:33.386 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-09-07T19:35:33.387 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-09-07T19:35:33.387 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-09-07T19:35:33.387 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-09-07T19:35:33.387 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-09-07T19:35:33.387 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-09-07T19:35:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-09-07T19:35:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.table_properties_collectors: 2022-09-07T19:35:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.inplace_update_support: 0 2022-09-07T19:35:33.389 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.inplace_update_num_locks: 10000 2022-09-07T19:35:33.389 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-09-07T19:35:33.389 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-09-07T19:35:33.389 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.memtable_huge_page_size: 0 2022-09-07T19:35:33.390 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.bloom_locality: 0 2022-09-07T19:35:33.390 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.max_successive_merges: 0 2022-09-07T19:35:33.390 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.optimize_filters_for_hits: 0 2022-09-07T19:35:33.390 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.paranoid_file_checks: 0 2022-09-07T19:35:33.391 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.force_consistency_checks: 1 2022-09-07T19:35:33.391 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.report_bg_io_stats: 0 2022-09-07T19:35:33.391 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.ttl: 2592000 2022-09-07T19:35:33.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.periodic_compaction_seconds: 0 2022-09-07T19:35:33.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.enable_blob_files: false 2022-09-07T19:35:33.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.min_blob_size: 0 2022-09-07T19:35:33.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.blob_file_size: 268435456 2022-09-07T19:35:33.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.blob_compression_type: NoCompression 2022-09-07T19:35:33.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.enable_blob_garbage_collection: false 2022-09-07T19:35:33.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-09-07T19:35:33.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-09-07T19:35:33.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2022-09-07T19:35:33.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2022-09-07T19:35:33.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579333272847, "job": 1, "event": "recovery_started", "wal_files": [4]} 2022-09-07T19:35:33.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2022-09-07T19:35:33.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-09-07T19:35:33.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579333273110, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1670, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1662579333, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "95fa2480-a9bc-438c-b1b8-3c107e2e021d", "db_session_id": "G7RIJZVEP0WRQDHUQ6U0"}} 2022-09-07T19:35:33.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2022-09-07T19:35:33.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: EVENT_LOG_v1 {"time_micros": 1662579333273427, "job": 1, "event": "recovery_finished"} 2022-09-07T19:35:33.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-09-07T19:35:33.397 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55f31d745880 2022-09-07T19:35:33.397 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: DB pointer 0x55f31d754000 2022-09-07T19:35:33.397 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2022-09-07T19:35:33.397 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-09-07T19:35:33.397 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** DB Stats ** 2022-09-07T19:35:33.398 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:35:33.398 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-09-07T19:35:33.398 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-09-07T19:35:33.398 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-09-07T19:35:33.399 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-09-07T19:35:33.399 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-09-07T19:35:33.399 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-09-07T19:35:33.399 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.400 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:33.400 INFO:journalctl@ceph.mon.b.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:33.400 INFO:journalctl@ceph.mon.b.smithi154.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:33.400 INFO:journalctl@ceph.mon.b.smithi154.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.400 INFO:journalctl@ceph.mon.b.smithi154.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.401 INFO:journalctl@ceph.mon.b.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.401 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.401 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:33.401 INFO:journalctl@ceph.mon.b.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:33.402 INFO:journalctl@ceph.mon.b.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:33.402 INFO:journalctl@ceph.mon.b.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.402 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:35:33.402 INFO:journalctl@ceph.mon.b.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:33.403 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:33.403 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-09-07T19:35:33.403 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-09-07T19:35:33.403 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2022-09-07T19:35:33.404 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:33.404 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:33.405 INFO:journalctl@ceph.mon.b.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-09-07T19:35:33.405 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.405 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2022-09-07T19:35:33.405 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.405 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:33.406 INFO:journalctl@ceph.mon.b.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:33.406 INFO:journalctl@ceph.mon.b.smithi154.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:33.406 INFO:journalctl@ceph.mon.b.smithi154.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.406 INFO:journalctl@ceph.mon.b.smithi154.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.407 INFO:journalctl@ceph.mon.b.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-09-07T19:35:33.407 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.407 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2022-09-07T19:35:33.407 INFO:journalctl@ceph.mon.b.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-09-07T19:35:33.408 INFO:journalctl@ceph.mon.b.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-09-07T19:35:33.408 INFO:journalctl@ceph.mon.b.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2022-09-07T19:35:33.408 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-09-07T19:35:33.408 INFO:journalctl@ceph.mon.b.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:33.408 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-09-07T19:35:33.409 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-09-07T19:35:33.409 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-09-07T19:35:33.409 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2022-09-07T19:35:33.409 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:33.410 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-09-07T19:35:33.410 INFO:journalctl@ceph.mon.b.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-09-07T19:35:33.410 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.410 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2022-09-07T19:35:33.410 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b does not exist in monmap, will attempt to join an existing cluster 2022-09-07T19:35:33.411 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2022-09-07T19:35:33.411 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: starting mon.b rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:35:33.411 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(???) e0 preinit fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:35:33.412 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).mds e1 new map 2022-09-07T19:35:33.412 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).mds e1 print_map 2022-09-07T19:35:33.412 INFO:journalctl@ceph.mon.b.smithi154.stdout: e1 2022-09-07T19:35:33.412 INFO:journalctl@ceph.mon.b.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-09-07T19:35:33.412 INFO:journalctl@ceph.mon.b.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-09-07T19:35:33.413 INFO:journalctl@ceph.mon.b.smithi154.stdout: legacy client fscid: -1 2022-09-07T19:35:33.413 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2022-09-07T19:35:33.413 INFO:journalctl@ceph.mon.b.smithi154.stdout: No filesystems configured 2022-09-07T19:35:33.413 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2022-09-07T19:35:33.414 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2022-09-07T19:35:33.414 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2022-09-07T19:35:33.414 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2022-09-07T19:35:33.414 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2022-09-07T19:35:33.415 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2022-09-07T19:35:33.415 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2022-09-07T19:35:33.415 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:35:33.415 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:35:33.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-09-07T19:35:33.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.417 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:33.417 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:33.417 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:33.417 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Added host smithi154 2022-09-07T19:35:33.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.419 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:35:33.419 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.419 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.419 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:35:33.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.421 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:33.421 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Deploying cephadm binary to smithi155 2022-09-07T19:35:33.421 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.421 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.421 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:33.422 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:33.422 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:33.422 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Added host smithi155 2022-09-07T19:35:33.423 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:35:33.423 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:33.424 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.424 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:33.424 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.424 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.425 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.425 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:33.426 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.426 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.426 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.426 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:35:33.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.428 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.428 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:35:33.428 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1838898596' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-09-07T19:35:33.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1838898596' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-09-07T19:35:33.430 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:33.430 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.430 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.430 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Saving service mon spec with placement smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c;count:3 2022-09-07T19:35:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:35:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:33.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:33.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:35:33.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Deploying daemon mon.c on smithi155 2022-09-07T19:35:33.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/2109804647' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:33.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:35:33.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.a calling monitor election 2022-09-07T19:35:33.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.436 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.c calling monitor election 2022-09-07T19:35:33.436 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.436 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2022-09-07T19:35:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: fsmap 2022-09-07T19:35:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mgrmap e13: x(active, since 48s) 2022-09-07T19:35:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: overall HEALTH_OK 2022-09-07T19:35:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: Deploying daemon mon.b on smithi154 2022-09-07T19:35:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/393014454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:33.441 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.441 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2022-09-07T19:35:33.441 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 ceph-mon[96967]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2022-09-07T19:35:33.441 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:33 smithi154 systemd[1]: Started Ceph mon.b for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:35:33.530 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:33 smithi155 ceph-mon[97606]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:33.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:33 smithi080 ceph-mon[90124]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:38.618 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:35:38.618 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: mon.c calling monitor election 2022-09-07T19:35:38.619 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: mon.a calling monitor election 2022-09-07T19:35:38.619 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.619 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:38.619 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:38.619 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.620 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.620 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:38.620 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.621 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.621 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.621 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2022-09-07T19:35:38.621 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:38.622 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: fsmap 2022-09-07T19:35:38.622 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:38.622 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: mgrmap e13: x(active, since 56s) 2022-09-07T19:35:38.622 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2022-09-07T19:35:38.623 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2022-09-07T19:35:38.623 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2022-09-07T19:35:38.623 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: mon.b (rank 2) addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] is down (out of quorum) 2022-09-07T19:35:38.623 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:38.623 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:38.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:35:38.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: mon.c calling monitor election 2022-09-07T19:35:38.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: mon.a calling monitor election 2022-09-07T19:35:38.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:38.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:38.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:38.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:38.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2022-09-07T19:35:38.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:38.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: fsmap 2022-09-07T19:35:38.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:38.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: mgrmap e13: x(active, since 56s) 2022-09-07T19:35:38.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2022-09-07T19:35:38.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2022-09-07T19:35:38.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2022-09-07T19:35:38.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: mon.b (rank 2) addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] is down (out of quorum) 2022-09-07T19:35:38.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:38.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 -- 172.21.15.155:0/890443192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 msgr2=0x7f63ec0058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:38.824 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 --2- 172.21.15.155:0/890443192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f63ec0058c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6404065fc0 tx=0x7f63f8012d40 comp rx=0 tx=0).stop 2022-09-07T19:35:38.824 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 -- 172.21.15.155:0/890443192 shutdown_connections 2022-09-07T19:35:38.824 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 --2- 172.21.15.155:0/890443192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f63ec0058c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:38.825 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 -- 172.21.15.155:0/890443192 >> 172.21.15.155:0/890443192 conn(0x7f6404073ef0 msgr2=0x7f64040742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:38.825 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 -- 172.21.15.155:0/890443192 shutdown_connections 2022-09-07T19:35:38.825 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.823+0000 7f6408992700 1 -- 172.21.15.155:0/890443192 wait complete. 2022-09-07T19:35:38.828 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 Processor -- start 2022-09-07T19:35:38.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 -- start start 2022-09-07T19:35:38.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f64041918a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:38.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:38.830 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 0x7f64041a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:38.830 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64041a18c0 con 0x7f63ec003440 2022-09-07T19:35:38.830 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64041a1a00 con 0x7f640419ef10 2022-09-07T19:35:38.830 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6408992700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64041a1bc0 con 0x7f6404191de0 2022-09-07T19:35:38.831 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6401d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:38.831 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6401d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58798/0 (socket says 172.21.15.155:58798) 2022-09-07T19:35:38.831 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.824+0000 7f6401d9b700 1 -- 172.21.15.155:0/1022896262 learned_addr learned my addr 172.21.15.155:0/1022896262 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:35:38.831 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6401d9b700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 msgr2=0x7f6404192250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2022-09-07T19:35:38.832 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f64041918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:38.832 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6401d9b700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 msgr2=0x7f6404192250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-07T19:35:38.832 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6401d9b700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-07T19:35:38.832 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6401d9b700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:35:38.833 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6402d9d700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 0x7f64041a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:38.833 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6402d9d700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 msgr2=0x7f64041a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2022-09-07T19:35:38.833 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6402d9d700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 msgr2=0x7f64041a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-07T19:35:38.833 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6402d9d700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 0x7f64041a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-07T19:35:38.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f6402d9d700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 0x7f64041a12f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:35:38.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 msgr2=0x7f6404192250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:35:38.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:38.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 msgr2=0x7f64041a12f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:35:38.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 0x7f64041a12f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 -- 172.21.15.155:0/1022896262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8012790 con 0x7f63ec003440 2022-09-07T19:35:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f640259c700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f64041918a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63f8015040 tx=0x7f63f8003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011d10 con 0x7f63ec003440 2022-09-07T19:35:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.825+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f63f8011e70 con 0x7f63ec003440 2022-09-07T19:35:38.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.826+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64041a1e40 con 0x7f63ec003440 2022-09-07T19:35:38.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.826+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80277d0 con 0x7f63ec003440 2022-09-07T19:35:38.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.826+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64041a2310 con 0x7f63ec003440 2022-09-07T19:35:38.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.826+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f63f8037070 con 0x7f63ec003440 2022-09-07T19:35:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.826+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404060310 con 0x7f63ec003440 2022-09-07T19:35:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.827+0000 7f63f37fe700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f63ec035f00 0x7f63ec0383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.827+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f63f804a3b0 con 0x7f63ec003440 2022-09-07T19:35:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.827+0000 7f6401d9b700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f63ec035f00 0x7f63ec0383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.827+0000 7f6401d9b700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f63ec035f00 0x7f63ec0383b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63f4006fa0 tx=0x7f63f4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:38.832+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f63f802e770 con 0x7f63ec003440 2022-09-07T19:35:39.099 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.099+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f640418be70 con 0x7f63ec003440 2022-09-07T19:35:39.100 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.100+0000 7f63f37fe700 1 -- 172.21.15.155:0/1022896262 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1248 (secure 0 0 0) 0x7f63f8022030 con 0x7f63ec003440 2022-09-07T19:35:39.101 INFO:teuthology.orchestra.run.smithi155.stdout: 2022-09-07T19:35:39.101 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":3,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","modified":"2022-09-07T19:35:33.294582Z","created":"2022-09-07T19:33:35.255958Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2022-09-07T19:35:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f63ec035f00 msgr2=0x7f63ec0383b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f63ec035f00 0x7f63ec0383b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63f4006fa0 tx=0x7f63f4008040 comp rx=0 tx=0).stop 2022-09-07T19:35:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 msgr2=0x7f64041918a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f64041918a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63f8015040 tx=0x7f63f8003df0 comp rx=0 tx=0).stop 2022-09-07T19:35:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 shutdown_connections 2022-09-07T19:35:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63ec003440 0x7f64041918a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f63ec035f00 0x7f63ec0383b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640419ef10 0x7f64041a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 --2- 172.21.15.155:0/1022896262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6404191de0 0x7f6404192250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 >> 172.21.15.155:0/1022896262 conn(0x7f6404073ef0 msgr2=0x7f64040faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 shutdown_connections 2022-09-07T19:35:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:39.102+0000 7f6408992700 1 -- 172.21.15.155:0/1022896262 wait complete. 2022-09-07T19:35:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 3 2022-09-07T19:35:39.387 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:39 smithi155 ceph-mon[97606]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:39.388 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:39.388 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:39.388 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:39.389 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:39 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/1022896262' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:39.389 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:39.404 INFO:tasks.cephadm:Generating final ceph.conf file... 2022-09-07T19:35:39.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph config generate-minimal-conf 2022-09-07T19:35:39.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:39 smithi080 ceph-mon[90124]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:39.489 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:39.489 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:39.489 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:39.489 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:39 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/1022896262' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:39.490 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.315 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:35:40.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: mon.c calling monitor election 2022-09-07T19:35:40.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: mon.a calling monitor election 2022-09-07T19:35:40.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:35:40.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:40.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:40.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:40.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2022-09-07T19:35:40.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:40.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: fsmap 2022-09-07T19:35:40.630 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:40.630 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: mgrmap e13: x(active, since 56s) 2022-09-07T19:35:40.631 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2022-09-07T19:35:40.631 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2022-09-07T19:35:40.632 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2022-09-07T19:35:40.632 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: mon.b (rank 2) addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] is down (out of quorum) 2022-09-07T19:35:40.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:40.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:40.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:40.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:40.634 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:40.634 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:40.634 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/1022896262' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-09-07T19:35:40.634 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:41.585 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: mon.b calling monitor election 2022-09-07T19:35:41.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:41.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:35:41.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:35:41.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:41.587 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:41.587 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: mon.b calling monitor election 2022-09-07T19:35:41.587 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: mon.c calling monitor election 2022-09-07T19:35:41.588 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: mon.a calling monitor election 2022-09-07T19:35:41.588 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2022-09-07T19:35:41.588 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:41.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: fsmap 2022-09-07T19:35:41.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:41.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: mgrmap e13: x(active, since 58s) 2022-09-07T19:35:41.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2022-09-07T19:35:41.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: Cluster is now healthy 2022-09-07T19:35:41.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: overall HEALTH_OK 2022-09-07T19:35:41.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:41.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:41.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:41.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: mon.b calling monitor election 2022-09-07T19:35:41.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:41.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:35:41.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:35:41.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:41.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:41.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: mon.b calling monitor election 2022-09-07T19:35:41.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: mon.c calling monitor election 2022-09-07T19:35:41.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: mon.a calling monitor election 2022-09-07T19:35:41.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2022-09-07T19:35:41.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:41.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: fsmap 2022-09-07T19:35:41.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:41.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: mgrmap e13: x(active, since 58s) 2022-09-07T19:35:41.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2022-09-07T19:35:41.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: Cluster is now healthy 2022-09-07T19:35:41.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: overall HEALTH_OK 2022-09-07T19:35:41.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:41.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:41.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:41.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: mon.b calling monitor election 2022-09-07T19:35:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:35:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:35:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:41.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:35:41.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: mon.b calling monitor election 2022-09-07T19:35:41.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: mon.c calling monitor election 2022-09-07T19:35:41.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: mon.a calling monitor election 2022-09-07T19:35:41.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2022-09-07T19:35:41.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:35:41.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: fsmap 2022-09-07T19:35:41.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: osdmap e4: 0 total, 0 up, 0 in 2022-09-07T19:35:41.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: mgrmap e13: x(active, since 58s) 2022-09-07T19:35:41.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2022-09-07T19:35:41.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: Cluster is now healthy 2022-09-07T19:35:41.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: overall HEALTH_OK 2022-09-07T19:35:41.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:41.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:41.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:41.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:41.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:35:41.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.912+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/553978167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a18073210 msgr2=0x7f1a180735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.912+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/553978167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a18073210 0x7f1a180735e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009790 tx=0x7f1a08009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.913+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/553978167 shutdown_connections 2022-09-07T19:35:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.913+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/553978167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a18073210 0x7f1a180735e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.913+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/553978167 >> 172.21.15.80:0/553978167 conn(0x7f1a180fb6b0 msgr2=0x7f1a180fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:41.914 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.913+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/553978167 shutdown_connections 2022-09-07T19:35:41.914 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.913+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/553978167 wait complete. 2022-09-07T19:35:41.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.914+0000 7f1a1d2ba700 1 Processor -- start 2022-09-07T19:35:41.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.914+0000 7f1a1d2ba700 1 -- start start 2022-09-07T19:35:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a1d2ba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 0x7f1a18199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a1d2ba700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18199770 0x7f1a1819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a1d2ba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a1819e110 0x7f1a1819e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a1d2ba700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18199ea0 con 0x7f1a1819e110 2022-09-07T19:35:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a1d2ba700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181a5e80 con 0x7f1a18073210 2022-09-07T19:35:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a1d2ba700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181a5ff0 con 0x7f1a18199770 2022-09-07T19:35:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a16ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 0x7f1a18199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a177fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a1819e110 0x7f1a1819e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a16ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 0x7f1a18199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:35460/0 (socket says 172.21.15.80:35460) 2022-09-07T19:35:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a16ffd700 1 -- 172.21.15.80:0/3456253819 learned_addr learned my addr 172.21.15.80:0/3456253819 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.915+0000 7f1a167fc700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18199770 0x7f1a1819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a16ffd700 1 -- 172.21.15.80:0/3456253819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18199770 msgr2=0x7f1a1819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a16ffd700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18199770 0x7f1a1819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a16ffd700 1 -- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a1819e110 msgr2=0x7f1a1819e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a16ffd700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a1819e110 0x7f1a1819e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a16ffd700 1 -- 172.21.15.80:0/3456253819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08009470 con 0x7f1a18073210 2022-09-07T19:35:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a16ffd700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 0x7f1a18199230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009f20 tx=0x7f1a08005410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800f870 con 0x7f1a18073210 2022-09-07T19:35:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f1a0800fe70 con 0x7f1a18073210 2022-09-07T19:35:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.916+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a181a6270 con 0x7f1a18073210 2022-09-07T19:35:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.917+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08017440 con 0x7f1a18073210 2022-09-07T19:35:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.917+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a181a6770 con 0x7f1a18073210 2022-09-07T19:35:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.918+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a18060310 con 0x7f1a18073210 2022-09-07T19:35:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.918+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f1a08020070 con 0x7f1a18073210 2022-09-07T19:35:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.918+0000 7f19fffff700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a00035d90 0x7f1a00038240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.919+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1a08048bd0 con 0x7f1a18073210 2022-09-07T19:35:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.919+0000 7f1a167fc700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a00035d90 0x7f1a00038240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:41.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.920+0000 7f1a167fc700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a00035d90 0x7f1a00038240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009940 tx=0x7f1a0c0090e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:41.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:41.923+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f1a0802b9a0 con 0x7f1a18073210 2022-09-07T19:35:42.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.147+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1a1819a5b0 con 0x7f1a18073210 2022-09-07T19:35:42.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.148+0000 7f19fffff700 1 -- 172.21.15.80:0/3456253819 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f1a0802b7c0 con 0x7f1a18073210 2022-09-07T19:35:42.148 INFO:teuthology.orchestra.run.smithi080.stdout:# minimal ceph.conf for cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:35:42.149 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2022-09-07T19:35:42.149 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:35:42.150 INFO:teuthology.orchestra.run.smithi080.stdout: mon_host = [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] 2022-09-07T19:35:42.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.150+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a00035d90 msgr2=0x7f1a00038240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.150+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a00035d90 0x7f1a00038240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009940 tx=0x7f1a0c0090e0 comp rx=0 tx=0).stop 2022-09-07T19:35:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.150+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 msgr2=0x7f1a18199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 0x7f1a18199230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009f20 tx=0x7f1a08005410 comp rx=0 tx=0).stop 2022-09-07T19:35:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 shutdown_connections 2022-09-07T19:35:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a1819e110 0x7f1a1819e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1a00035d90 0x7f1a00038240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a18073210 0x7f1a18199230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 --2- 172.21.15.80:0/3456253819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18199770 0x7f1a1819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 >> 172.21.15.80:0/3456253819 conn(0x7f1a180fb6b0 msgr2=0x7f1a180fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 shutdown_connections 2022-09-07T19:35:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:42.151+0000 7f1a1d2ba700 1 -- 172.21.15.80:0/3456253819 wait complete. 2022-09-07T19:35:42.569 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:35:42.295+0000 7f6c21fb3700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-09-07T19:35:42.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-mon[90124]: Reconfiguring mon.a (unknown last config time)... 2022-09-07T19:35:42.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-mon[90124]: Reconfiguring daemon mon.a on smithi080 2022-09-07T19:35:42.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:42.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:35:42.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:35:42.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:42 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3456253819' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:42 smithi154 ceph-mon[96967]: Reconfiguring mon.a (unknown last config time)... 2022-09-07T19:35:42.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:42 smithi154 ceph-mon[96967]: Reconfiguring daemon mon.a on smithi080 2022-09-07T19:35:42.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:42.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:35:42.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:35:42.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:42 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3456253819' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:42 smithi155 ceph-mon[97606]: Reconfiguring mon.a (unknown last config time)... 2022-09-07T19:35:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:42 smithi155 ceph-mon[97606]: Reconfiguring daemon mon.a on smithi080 2022-09-07T19:35:42.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:42.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:35:42.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:35:42.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:42 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3456253819' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:42.700 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2022-09-07T19:35:42.700 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:35:42.701 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2022-09-07T19:35:42.792 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:35:42.792 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:42.923 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:35:42.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2022-09-07T19:35:42.957 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:35:42.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:43.029 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:35:43.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2022-09-07T19:35:43.064 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:35:43.065 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:35:43.136 INFO:tasks.cephadm:Adding mgr.x on smithi080 2022-09-07T19:35:43.137 INFO:tasks.cephadm:Adding mgr.y on smithi154 2022-09-07T19:35:43.138 INFO:tasks.cephadm:Adding mgr.z on smithi155 2022-09-07T19:35:43.139 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch apply mgr '3;smithi080=x;smithi154=y;smithi155=z' 2022-09-07T19:35:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:43 smithi080 ceph-mon[90124]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:43 smithi154 ceph-mon[96967]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:43 smithi155 ceph-mon[97606]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:43.769 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:35:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: Reconfiguring mon.b (monmap changed)... 2022-09-07T19:35:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: Reconfiguring daemon mon.b on smithi154 2022-09-07T19:35:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:44.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: Reconfiguring mon.b (monmap changed)... 2022-09-07T19:35:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: Reconfiguring daemon mon.b on smithi154 2022-09-07T19:35:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:44.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: Reconfiguring mon.b (monmap changed)... 2022-09-07T19:35:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: Reconfiguring daemon mon.b on smithi154 2022-09-07T19:35:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:44.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-09-07T19:35:44.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-09-07T19:35:44.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:44.949 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 -- 172.21.15.155:0/1776943387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca00fc850 msgr2=0x7f9ca00fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:44.949 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/1776943387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca00fc850 0x7f9ca00fcc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009790 tx=0x7f9c9c009aa0 comp rx=0 tx=0).stop 2022-09-07T19:35:44.950 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 -- 172.21.15.155:0/1776943387 shutdown_connections 2022-09-07T19:35:44.950 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/1776943387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca00fc850 0x7f9ca00fcc60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:44.950 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 -- 172.21.15.155:0/1776943387 >> 172.21.15.155:0/1776943387 conn(0x7f9ca00f7f40 msgr2=0x7f9ca00fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:44.950 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 -- 172.21.15.155:0/1776943387 shutdown_connections 2022-09-07T19:35:44.951 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 -- 172.21.15.155:0/1776943387 wait complete. 2022-09-07T19:35:44.951 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 Processor -- start 2022-09-07T19:35:44.951 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.949+0000 7f9ca86d6700 1 -- start start 2022-09-07T19:35:44.951 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca86d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 0x7f9ca0067740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca86d6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca0197c10 0x7f9ca0199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca86d6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca019a530 0x7f9ca019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca86d6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca019cff0 con 0x7f9ca0197c10 2022-09-07T19:35:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca86d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca019d160 con 0x7f9ca00fc850 2022-09-07T19:35:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca86d6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca019d320 con 0x7f9ca019a530 2022-09-07T19:35:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 0x7f9ca0067740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 0x7f9ca0067740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.155:36642/0 (socket says 172.21.15.155:36642) 2022-09-07T19:35:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 -- 172.21.15.155:0/2458460914 learned_addr learned my addr 172.21.15.155:0/2458460914 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:35:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca5c71700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca0197c10 0x7f9ca0199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6c73700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca019a530 0x7f9ca019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 -- 172.21.15.155:0/2458460914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca019a530 msgr2=0x7f9ca019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca019a530 0x7f9ca019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 -- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca0197c10 msgr2=0x7f9ca0199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca0197c10 0x7f9ca0199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 -- 172.21.15.155:0/2458460914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c009470 con 0x7f9ca00fc850 2022-09-07T19:35:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.950+0000 7f9ca6472700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 0x7f9ca0067740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0059c0 tx=0x7f9c9c005460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:44.957 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.951+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00f870 con 0x7f9ca00fc850 2022-09-07T19:35:44.957 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.951+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f9c9c00fe70 con 0x7f9ca00fc850 2022-09-07T19:35:44.958 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.951+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca019d5a0 con 0x7f9ca00fc850 2022-09-07T19:35:44.958 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.951+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c017440 con 0x7f9ca00fc850 2022-09-07T19:35:44.958 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.951+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca019dad0 con 0x7f9ca00fc850 2022-09-07T19:35:44.959 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.951+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7f9c9c020070 con 0x7f9ca00fc850 2022-09-07T19:35:44.959 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.952+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca01024a0 con 0x7f9ca00fc850 2022-09-07T19:35:44.959 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.952+0000 7f9c937fe700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9c8c035d90 0x7f9c8c038240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:44.960 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.952+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9c9c048ce0 con 0x7f9ca00fc850 2022-09-07T19:35:44.960 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.952+0000 7f9ca5c71700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9c8c035d90 0x7f9c8c038240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:44.960 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.953+0000 7f9ca5c71700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9c8c035d90 0x7f9c8c038240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009940 tx=0x7f9c940090e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:44.961 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:44.957+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f9c9c0175a0 con 0x7f9ca00fc850 2022-09-07T19:35:45.159 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.161+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi154=y;smithi155=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ca005f1b0 con 0x7f9c8c035d90 2022-09-07T19:35:45.166 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.168+0000 7f9c937fe700 1 -- 172.21.15.155:0/2458460914 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9ca005f1b0 con 0x7f9c8c035d90 2022-09-07T19:35:45.167 INFO:teuthology.orchestra.run.smithi155.stdout:Scheduled mgr update... 2022-09-07T19:35:45.169 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9c8c035d90 msgr2=0x7f9c8c038240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:45.169 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9c8c035d90 0x7f9c8c038240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009940 tx=0x7f9c940090e0 comp rx=0 tx=0).stop 2022-09-07T19:35:45.169 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 msgr2=0x7f9ca0067740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:45.170 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 0x7f9ca0067740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0059c0 tx=0x7f9c9c005460 comp rx=0 tx=0).stop 2022-09-07T19:35:45.170 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 shutdown_connections 2022-09-07T19:35:45.170 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9c8c035d90 0x7f9c8c038240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:45.170 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca019a530 0x7f9ca019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:45.171 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ca00fc850 0x7f9ca0067740 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:45.171 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 --2- 172.21.15.155:0/2458460914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca0197c10 0x7f9ca0199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:45.171 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 >> 172.21.15.155:0/2458460914 conn(0x7f9ca00f7f40 msgr2=0x7f9ca00f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:45.171 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 shutdown_connections 2022-09-07T19:35:45.171 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:35:45.170+0000 7f9ca86d6700 1 -- 172.21.15.155:0/2458460914 wait complete. 2022-09-07T19:35:45.592 DEBUG:teuthology.orchestra.run.smithi154:mgr.y> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.y.service 2022-09-07T19:35:45.596 DEBUG:teuthology.orchestra.run.smithi155:mgr.z> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mgr.z.service 2022-09-07T19:35:45.600 INFO:tasks.cephadm:Deploying OSDs... 2022-09-07T19:35:45.600 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:35:45.601 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2022-09-07T19:35:45.624 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:45 smithi155 ceph-mon[97606]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:45.624 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:45 smithi155 ceph-mon[97606]: Reconfiguring mon.c (monmap changed)... 2022-09-07T19:35:45.625 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:45 smithi155 ceph-mon[97606]: Reconfiguring daemon mon.c on smithi155 2022-09-07T19:35:45.625 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:45 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:45.629 INFO:journalctl@ceph.mgr.z.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:35:45.630 INFO:journalctl@ceph.mgr.y.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:35:45.663 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-07T19:35:45.664 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-07T19:35:45.724 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-07T19:35:45.725 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:45.725 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 452 Links: 1 2022-09-07T19:35:45.725 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:45.725 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:45.726 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2022-09-07 19:34:52.042008240 +0000 2022-09-07T19:35:45.726 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2022-09-07 19:27:44.338259796 +0000 2022-09-07T19:35:45.726 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2022-09-07 19:27:44.338259796 +0000 2022-09-07T19:35:45.726 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2022-09-07 19:27:44.303260610 +0000 2022-09-07T19:35:45.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:45 smithi080 ceph-mon[90124]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:45.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:45 smithi080 ceph-mon[90124]: Reconfiguring mon.c (monmap changed)... 2022-09-07T19:35:45.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:45 smithi080 ceph-mon[90124]: Reconfiguring daemon mon.c on smithi155 2022-09-07T19:35:45.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:45 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2022-09-07T19:35:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2022-09-07T19:35:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000833827 s, 614 kB/s 2022-09-07T19:35:45.765 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-07T19:35:45.823 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-07T19:35:45.824 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:45.824 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 458 Links: 1 2022-09-07T19:35:45.824 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:45.825 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:45.825 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2022-09-07 19:34:52.042008240 +0000 2022-09-07T19:35:45.825 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2022-09-07 19:27:45.340236509 +0000 2022-09-07T19:35:45.825 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2022-09-07 19:27:45.340236509 +0000 2022-09-07T19:35:45.826 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2022-09-07 19:27:45.307237276 +0000 2022-09-07T19:35:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2022-09-07T19:35:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2022-09-07T19:35:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00065076 s, 787 kB/s 2022-09-07T19:35:45.863 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-07T19:35:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:45 smithi154 ceph-mon[96967]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:45 smithi154 ceph-mon[96967]: Reconfiguring mon.c (monmap changed)... 2022-09-07T19:35:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:45 smithi154 ceph-mon[96967]: Reconfiguring daemon mon.c on smithi155 2022-09-07T19:35:45.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:45 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-07T19:35:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:45.923 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 464 Links: 1 2022-09-07T19:35:45.923 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:45.924 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:45.924 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2022-09-07 19:34:52.042008240 +0000 2022-09-07T19:35:45.925 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2022-09-07 19:27:46.368212618 +0000 2022-09-07T19:35:45.925 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2022-09-07 19:27:46.368212618 +0000 2022-09-07T19:35:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2022-09-07 19:27:46.332213454 +0000 2022-09-07T19:35:45.952 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2022-09-07T19:35:45.952 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2022-09-07T19:35:45.952 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000897094 s, 571 kB/s 2022-09-07T19:35:45.962 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-07T19:35:46.021 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-07T19:35:46.021 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.021 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 470 Links: 1 2022-09-07T19:35:46.022 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.022 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.022 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2022-09-07 19:34:52.042008240 +0000 2022-09-07T19:35:46.022 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2022-09-07 19:27:47.389188889 +0000 2022-09-07T19:35:46.023 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2022-09-07 19:27:47.389188889 +0000 2022-09-07T19:35:46.023 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2022-09-07 19:27:47.354189702 +0000 2022-09-07T19:35:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2022-09-07T19:35:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2022-09-07T19:35:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000646054 s, 793 kB/s 2022-09-07T19:35:46.061 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2022-09-07T19:35:46.061 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2022-09-07T19:35:46.083 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-07T19:35:46.084 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-07T19:35:46.144 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-07T19:35:46.144 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.144 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 359498 Links: 1 2022-09-07T19:35:46.145 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.145 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.146 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2022-09-07 19:35:32.702179019 +0000 2022-09-07T19:35:46.146 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2022-09-07 19:24:03.743186564 +0000 2022-09-07T19:35:46.146 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2022-09-07 19:24:03.743186564 +0000 2022-09-07T19:35:46.146 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2022-09-07T19:35:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2022-09-07T19:35:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2022-09-07T19:35:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000230588 s, 2.2 MB/s 2022-09-07T19:35:46.160 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-07T19:35:46.219 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-07T19:35:46.219 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.220 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 357940 Links: 1 2022-09-07T19:35:46.220 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.220 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.220 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2022-09-07 19:35:32.702179019 +0000 2022-09-07T19:35:46.221 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2022-09-07 19:24:04.293171953 +0000 2022-09-07T19:35:46.221 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2022-09-07 19:24:04.293171953 +0000 2022-09-07T19:35:46.221 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2022-09-07T19:35:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2022-09-07T19:35:46.231 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2022-09-07T19:35:46.231 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000219504 s, 2.3 MB/s 2022-09-07T19:35:46.234 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-07T19:35:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-07T19:35:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.292 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 353226 Links: 1 2022-09-07T19:35:46.293 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.293 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.293 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2022-09-07 19:35:32.702179019 +0000 2022-09-07T19:35:46.293 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2022-09-07 19:24:04.833157608 +0000 2022-09-07T19:35:46.294 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2022-09-07 19:24:04.833157608 +0000 2022-09-07T19:35:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2022-09-07T19:35:46.303 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2022-09-07T19:35:46.303 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2022-09-07T19:35:46.303 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000205169 s, 2.5 MB/s 2022-09-07T19:35:46.306 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-07T19:35:46.363 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-07T19:35:46.364 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.364 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 359101 Links: 1 2022-09-07T19:35:46.364 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.365 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.365 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2022-09-07 19:35:32.702179019 +0000 2022-09-07T19:35:46.365 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2022-09-07 19:24:05.399142572 +0000 2022-09-07T19:35:46.365 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2022-09-07 19:24:05.399142572 +0000 2022-09-07T19:35:46.365 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2022-09-07T19:35:46.374 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2022-09-07T19:35:46.374 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2022-09-07T19:35:46.374 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00022072 s, 2.3 MB/s 2022-09-07T19:35:46.377 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2022-09-07T19:35:46.377 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2022-09-07T19:35:46.394 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-07T19:35:46.395 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-07T19:35:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-07T19:35:46.452 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.452 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 357661 Links: 1 2022-09-07T19:35:46.452 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.452 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.453 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2022-09-07 19:35:24.640958158 +0000 2022-09-07T19:35:46.453 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2022-09-07 19:24:02.660093032 +0000 2022-09-07T19:35:46.454 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2022-09-07 19:24:02.660093032 +0000 2022-09-07T19:35:46.454 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2022-09-07T19:35:46.463 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2022-09-07T19:35:46.464 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2022-09-07T19:35:46.465 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000184719 s, 2.8 MB/s 2022-09-07T19:35:46.467 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-07T19:35:46.530 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-07T19:35:46.530 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.531 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 360235 Links: 1 2022-09-07T19:35:46.532 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.532 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.533 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2022-09-07 19:35:24.640958158 +0000 2022-09-07T19:35:46.533 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2022-09-07 19:24:03.206082082 +0000 2022-09-07T19:35:46.533 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2022-09-07 19:24:03.206082082 +0000 2022-09-07T19:35:46.533 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2022-09-07T19:35:46.536 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2022-09-07T19:35:46.537 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2022-09-07T19:35:46.537 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000194391 s, 2.6 MB/s 2022-09-07T19:35:46.539 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-07T19:35:46.602 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-07T19:35:46.603 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.603 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 359088 Links: 1 2022-09-07T19:35:46.603 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.603 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.603 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2022-09-07 19:35:24.641958137 +0000 2022-09-07T19:35:46.604 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2022-09-07 19:24:03.719071794 +0000 2022-09-07T19:35:46.604 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2022-09-07 19:24:03.719071794 +0000 2022-09-07T19:35:46.604 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2022-09-07T19:35:46.606 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2022-09-07T19:35:46.606 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2022-09-07T19:35:46.607 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.00021905 s, 2.3 MB/s 2022-09-07T19:35:46.609 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-07T19:35:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi154=y;smithi155=z", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: Saving service mgr spec with placement smithi080=x;smithi154=y;smithi155=z;count:3 2022-09-07T19:35:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:46.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:46.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:46.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:46.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-09-07T19:35:46.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:46.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:46.666 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-07T19:35:46.666 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-07T19:35:46.667 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 354658 Links: 1 2022-09-07T19:35:46.667 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:35:46.667 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2022-09-07T19:35:46.667 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2022-09-07 19:35:24.641958137 +0000 2022-09-07T19:35:46.668 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2022-09-07 19:24:04.263060884 +0000 2022-09-07T19:35:46.668 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2022-09-07 19:24:04.263060884 +0000 2022-09-07T19:35:46.668 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2022-09-07T19:35:46.674 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi154=y;smithi155=z", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:46.674 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: Saving service mgr spec with placement smithi080=x;smithi154=y;smithi155=z;count:3 2022-09-07T19:35:46.675 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.675 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.675 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:46.675 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:46.675 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:46.676 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.676 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:46.676 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-09-07T19:35:46.676 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:46.677 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:46.678 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2022-09-07T19:35:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2022-09-07T19:35:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000200071 s, 2.6 MB/s 2022-09-07T19:35:46.680 INFO:tasks.cephadm:Deploying osd.0 on smithi080 with /dev/vg_nvme/lv_4... 2022-09-07T19:35:46.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-09-07T19:35:46.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi154=y;smithi155=z", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:46.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: Saving service mgr spec with placement smithi080=x;smithi154=y;smithi155=z;count:3 2022-09-07T19:35:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:46.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:46.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:46.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:46.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-09-07T19:35:46.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:46.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:47.548 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:47.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:47 smithi155 ceph-mon[97606]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:47.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:47 smithi155 ceph-mon[97606]: Deploying daemon mgr.z on smithi155 2022-09-07T19:35:47.698 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:47 smithi155 systemd[1]: Starting Ceph mgr.z for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:35:47.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:47 smithi080 ceph-mon[90124]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:47.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:47 smithi080 ceph-mon[90124]: Deploying daemon mgr.z on smithi155 2022-09-07T19:35:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:47 smithi154 ceph-mon[96967]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:47 smithi154 ceph-mon[96967]: Deploying daemon mgr.z on smithi155 2022-09-07T19:35:48.100 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:47 smithi155 podman[99577]: 2022-09-07T19:35:48.101 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 bash[99577]: d46e54f7efa4bdd0b2460ea73e50beb95c278250c50b6bc8fd86acad0ea85fe8 2022-09-07T19:35:48.101 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-mgr[99616]: -- 172.21.15.155:0/1342087692 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ecc3f04820 con 0x55ecc3ed8800 2022-09-07T19:35:48.410 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 systemd[1]: Started Ceph mgr.z for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:35:48.411 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.157+0000 7fb3cdbdc080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:35:48.411 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.234+0000 7fb3cdbdc080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:35:48.411 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.320+0000 7fb3cdbdc080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:35:48.412 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.411+0000 7fb3cdbdc080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:35:48.696 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.574+0000 7fb3cdbdc080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:35:49.159 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.883+0000 7fb3cdbdc080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:35:49.160 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:48 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:48.968+0000 7fb3cdbdc080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:35:49.160 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:49.094+0000 7fb3cdbdc080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:35:49.446 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:49.186+0000 7fb3cdbdc080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:35:49.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:49.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:49.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:49.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:49.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-09-07T19:35:49.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:49.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:49.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-mon[97606]: Deploying daemon mgr.y on smithi154 2022-09-07T19:35:49.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:49.491 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:49.491 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:49.491 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:49.492 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-09-07T19:35:49.492 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:49.492 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:49.492 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:49 smithi154 ceph-mon[96967]: Deploying daemon mgr.y on smithi154 2022-09-07T19:35:49.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:49.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:49.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:49.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:49.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-09-07T19:35:49.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:49.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:49.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:49 smithi080 ceph-mon[90124]: Deploying daemon mgr.y on smithi154 2022-09-07T19:35:49.691 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-09-07T19:35:49.691 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-09-07T19:35:49.692 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2022-09-07T19:35:49.692 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2022-09-07T19:35:49.692 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0438817 s, 239 MB/s 2022-09-07T19:35:49.692 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2022-09-07T19:35:49.876 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:49 smithi154 systemd[1]: Starting Ceph mgr.y for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:35:49.946 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:49 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:49.609+0000 7fb3cdbdc080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:35:50.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2022-09-07T19:35:50.295 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 podman[98296]: 2022-09-07T19:35:50.295 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 bash[98296]: 8a748da53927686efda3e58c81a0cfe469758a8cdcad6a4e1ad52b41f44334ca 2022-09-07T19:35:50.295 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 ceph-mgr[98337]: -- 172.21.15.154:0/2570001635 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556ce05ec820 con 0x556ce05c1000 2022-09-07T19:35:50.446 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:50 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:50.179+0000 7fb3cdbdc080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:35:50.447 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:50 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:50.348+0000 7fb3cdbdc080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:35:50.623 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 systemd[1]: Started Ceph mgr.y for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:35:50.623 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:50.375+0000 7f3e6107a080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:35:50.624 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:50.450+0000 7f3e6107a080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:35:50.624 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:50.542+0000 7f3e6107a080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:35:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:35:51.123 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:50.639+0000 7f3e6107a080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:35:51.123 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:50 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:50.814+0000 7f3e6107a080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:35:51.393 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:51.128+0000 7fb3cdbdc080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:35:51.394 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:51.223+0000 7fb3cdbdc080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:35:51.394 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-mon[97606]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:51.395 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:51.395 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:51.395 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:51.396 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:51.396 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:51.471 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:51.141+0000 7f3e6107a080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:35:51.471 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:51.233+0000 7f3e6107a080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:35:51.472 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:51.371+0000 7f3e6107a080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:35:51.472 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-mon[96967]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:51.472 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:51.474 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:51.474 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:51.474 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:51.474 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:51.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:51 smithi080 ceph-mon[90124]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:51.697 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:51.394+0000 7fb3cdbdc080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:35:51.697 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:51.584+0000 7fb3cdbdc080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:35:51.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:51.471+0000 7f3e6107a080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:35:52.149 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:51 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:51.739+0000 7fb3cdbdc080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:35:52.373 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:51 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:51.930+0000 7f3e6107a080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:35:52.606 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.605+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/306620885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4100f40 msgr2=0x7fb2e41033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:52.606 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.605+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/306620885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4100f40 0x7fb2e41033a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009810 tx=0x7fb2d8009b20 comp rx=0 tx=0).stop 2022-09-07T19:35:52.606 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/306620885 shutdown_connections 2022-09-07T19:35:52.607 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/306620885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2e4103a30 0x7fb2e4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:52.607 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/306620885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e40673d0 0x7fb2e4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:52.607 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/306620885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4100f40 0x7fb2e41033a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:52.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/306620885 >> 172.21.15.80:0/306620885 conn(0x7fb2e40f8430 msgr2=0x7fb2e40fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:35:52.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/306620885 shutdown_connections 2022-09-07T19:35:52.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.606+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/306620885 wait complete. 2022-09-07T19:35:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 Processor -- start 2022-09-07T19:35:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 -- start start 2022-09-07T19:35:52.611 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2e40673d0 0x7fb2e40fe360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:52.611 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e4100f40 0x7fb2e40fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:52.611 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 0x7fb2e40fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:52.611 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40fd6e0 con 0x7fb2e40673d0 2022-09-07T19:35:52.611 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40fd850 con 0x7fb2e4100f40 2022-09-07T19:35:52.612 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e8ac8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e419db80 con 0x7fb2e4103a30 2022-09-07T19:35:52.612 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e2d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 0x7fb2e40fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:52.612 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 0x7fb2e40fcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:43752/0 (socket says 172.21.15.80:43752) 2022-09-07T19:35:52.612 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 -- 172.21.15.80:0/195293432 learned_addr learned my addr 172.21.15.80:0/195293432 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:35:52.613 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2e40673d0 0x7fb2e40fe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:52.613 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.608+0000 7fb2e1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e4100f40 0x7fb2e40fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:52.613 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 -- 172.21.15.80:0/195293432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e4100f40 msgr2=0x7fb2e40fc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:52.613 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e4100f40 0x7fb2e40fc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:52.614 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 -- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2e40673d0 msgr2=0x7fb2e40fe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:35:52.614 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2e40673d0 0x7fb2e40fe360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:35:52.614 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 -- 172.21.15.80:0/195293432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009470 con 0x7fb2e4103a30 2022-09-07T19:35:52.615 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.609+0000 7fb2e2d9d700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 0x7fb2e40fcf40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00ebf0 tx=0x7fb2dc00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:52.615 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.610+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0099c0 con 0x7fb2e4103a30 2022-09-07T19:35:52.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.610+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb2dc00cc90 con 0x7fb2e4103a30 2022-09-07T19:35:52.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.610+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc010430 con 0x7fb2e4103a30 2022-09-07T19:35:52.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.610+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e419de60 con 0x7fb2e4103a30 2022-09-07T19:35:52.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.610+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e419e280 con 0x7fb2e4103a30 2022-09-07T19:35:52.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.611+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 42746+0+0 (secure 0 0 0) 0x7fb2dc01e020 con 0x7fb2e4103a30 2022-09-07T19:35:52.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.611+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e41096b0 con 0x7fb2e4103a30 2022-09-07T19:35:52.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.611+0000 7fb2d37fe700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb2cc035b00 0x7fb2cc037fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:35:52.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.611+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb2dc014070 con 0x7fb2e4103a30 2022-09-07T19:35:52.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.612+0000 7fb2e259c700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb2cc035b00 0x7fb2cc037fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:35:52.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.612+0000 7fb2e259c700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb2cc035b00 0x7fb2cc037fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40677a0 tx=0x7fb2d4005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:35:52.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.616+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb2dc01f700 con 0x7fb2e4103a30 2022-09-07T19:35:52.684 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:52.515+0000 7f3e6107a080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:35:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:52.856+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e405fbb0 con 0x7fb2cc035b00 2022-09-07T19:35:52.900 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:52.150+0000 7fb3cdbdc080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:35:52.901 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:52.676+0000 7fb3cdbdc080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:35:53.123 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:52.685+0000 7f3e6107a080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:35:53.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:53.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.127 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.127 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: Reconfiguring mgr.x (unknown last config time)... 2022-09-07T19:35:53.127 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:53.128 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:53.128 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:53.129 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: Reconfiguring daemon mgr.x on smithi080 2022-09-07T19:35:53.129 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:35:53.129 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:35:53.130 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:53.162 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:52.981+0000 7fb3cdbdc080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:35:53.163 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:53.163 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.163 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.164 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.164 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.164 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.165 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.165 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: Reconfiguring mgr.x (unknown last config time)... 2022-09-07T19:35:53.166 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:53.166 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:53.166 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:53.166 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: Reconfiguring daemon mgr.x on smithi080 2022-09-07T19:35:53.167 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:35:53.167 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:35:53.167 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:53.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:53.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:53.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: Reconfiguring mgr.x (unknown last config time)... 2022-09-07T19:35:53.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-09-07T19:35:53.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2022-09-07T19:35:53.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:53.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: Reconfiguring daemon mgr.x on smithi080 2022-09-07T19:35:53.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:35:53.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:35:53.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:53.446 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:53 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:53.163+0000 7fb3cdbdc080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:35:53.447 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:53 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:53.274+0000 7fb3cdbdc080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:35:53.681 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:53 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:53.430+0000 7f3e6107a080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:35:53.682 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:53 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:53.518+0000 7f3e6107a080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:35:53.683 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:53 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:53.682+0000 7f3e6107a080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:35:53.905 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:53 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:53.480+0000 7fb3cdbdc080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:35:54.006 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:53 smithi154 ceph-mon[96967]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:54.007 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:53 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:53.862+0000 7f3e6107a080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:35:54.194 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:53 smithi080 ceph-mon[90124]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:54.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:53 smithi155 ceph-mon[97606]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:35:54.196 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:35:54.099+0000 7fb3cdbdc080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:35:54.373 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:54.007+0000 7f3e6107a080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:35:54.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:54.398+0000 7f3e6107a080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:35:54.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:54.916+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 14) v1 ==== 85192+0+0 (secure 0 0 0) 0x7fb2dc00c040 con 0x7fb2e4103a30 2022-09-07T19:35:55.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:55.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: Standby manager daemon z started 2022-09-07T19:35:55.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2022-09-07T19:35:55.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:35:55.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2022-09-07T19:35:55.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:35:55.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:55.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: Standby manager daemon z started 2022-09-07T19:35:55.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2022-09-07T19:35:55.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:35:55.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2022-09-07T19:35:55.200 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:35:55.200 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.201 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.201 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:55.201 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:55.202 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:55.202 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.226 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:54.923+0000 7f3e6107a080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:35:55.227 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:55.227 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: Standby manager daemon z started 2022-09-07T19:35:55.227 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2022-09-07T19:35:55.228 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:35:55.228 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2022-09-07T19:35:55.229 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2372495555' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:35:55.229 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.229 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.229 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:35:55.230 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:35:55.230 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:35:55.230 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:35:55.516 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:55 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:55.227+0000 7f3e6107a080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:35:55.517 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:55 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:55.408+0000 7f3e6107a080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:35:55.517 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:55 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:55.517+0000 7f3e6107a080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:35:55.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:55 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:55.724+0000 7f3e6107a080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:35:56.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:55 smithi155 ceph-mon[97606]: mgrmap e14: x(active, since 73s), standbys: z 2022-09-07T19:35:56.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2022-09-07T19:35:56.341 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:55 smithi154 ceph-mon[96967]: mgrmap e14: x(active, since 73s), standbys: z 2022-09-07T19:35:56.341 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2022-09-07T19:35:56.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:55 smithi080 ceph-mon[90124]: mgrmap e14: x(active, since 73s), standbys: z 2022-09-07T19:35:56.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2022-09-07T19:35:56.623 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:35:56.342+0000 7f3e6107a080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:35:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:35:56.934+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mon.1 v2:172.21.15.155:3300/0 8 ==== mgrmap(e 15) v1 ==== 127638+0+0 (secure 0 0 0) 0x7fb2dc020cc0 con 0x7fb2e4103a30 2022-09-07T19:35:57.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:57.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: Standby manager daemon y started 2022-09-07T19:35:57.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2022-09-07T19:35:57.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:35:57.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2022-09-07T19:35:57.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:35:57.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4143554497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]: dispatch 2022-09-07T19:35:57.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]: dispatch 2022-09-07T19:35:57.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]': finished 2022-09-07T19:35:57.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: osdmap e5: 1 total, 0 up, 1 in 2022-09-07T19:35:57.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:35:57.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:57.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: Standby manager daemon y started 2022-09-07T19:35:57.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2022-09-07T19:35:57.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:35:57.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2022-09-07T19:35:57.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:35:57.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4143554497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]: dispatch 2022-09-07T19:35:57.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]: dispatch 2022-09-07T19:35:57.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]': finished 2022-09-07T19:35:57.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: osdmap e5: 1 total, 0 up, 1 in 2022-09-07T19:35:57.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:35:57.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:57.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: Standby manager daemon y started 2022-09-07T19:35:57.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2022-09-07T19:35:57.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:35:57.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2022-09-07T19:35:57.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1884336745' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:35:57.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4143554497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]: dispatch 2022-09-07T19:35:57.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]: dispatch 2022-09-07T19:35:57.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "022d8b5d-40e6-41d4-88ad-58fdf010d250"}]': finished 2022-09-07T19:35:57.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: osdmap e5: 1 total, 0 up, 1 in 2022-09-07T19:35:57.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:35:58.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:57 smithi155 ceph-mon[97606]: mgrmap e15: x(active, since 75s), standbys: z, y 2022-09-07T19:35:58.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:57 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-09-07T19:35:58.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:57 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2008596905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:35:58.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:57 smithi080 ceph-mon[90124]: mgrmap e15: x(active, since 75s), standbys: z, y 2022-09-07T19:35:58.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:57 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-09-07T19:35:58.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:57 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2008596905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:35:58.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:57 smithi154 ceph-mon[96967]: mgrmap e15: x(active, since 75s), standbys: z, y 2022-09-07T19:35:58.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:57 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-09-07T19:35:58.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:57 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2008596905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:35:59.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:35:58 smithi155 ceph-mon[97606]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:59.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:35:58 smithi080 ceph-mon[90124]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:35:59.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:35:58 smithi154 ceph-mon[96967]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:01.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:01 smithi080 ceph-mon[90124]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:01 smithi154 ceph-mon[96967]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:01 smithi155 ceph-mon[97606]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:03.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:03 smithi080 ceph-mon[90124]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:03 smithi154 ceph-mon[96967]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:03 smithi155 ceph-mon[97606]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:05.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:05 smithi080 ceph-mon[90124]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:05.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-09-07T19:36:05.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:05 smithi154 ceph-mon[96967]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-09-07T19:36:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:05 smithi155 ceph-mon[97606]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-09-07T19:36:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:06.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:06 smithi080 ceph-mon[90124]: Deploying daemon osd.0 on smithi080 2022-09-07T19:36:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:06 smithi154 ceph-mon[96967]: Deploying daemon osd.0 on smithi080 2022-09-07T19:36:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:06 smithi155 ceph-mon[97606]: Deploying daemon osd.0 on smithi080 2022-09-07T19:36:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:07 smithi080 ceph-mon[90124]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:07 smithi154 ceph-mon[96967]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:07 smithi155 ceph-mon[97606]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:09 smithi080 ceph-mon[90124]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:09 smithi154 ceph-mon[96967]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:09 smithi155 ceph-mon[97606]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:11.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:11 smithi080 ceph-mon[90124]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:11 smithi154 ceph-mon[96967]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:11 smithi155 ceph-mon[97606]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:13.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:13 smithi080 ceph-mon[90124]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:13 smithi154 ceph-mon[96967]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:13 smithi155 ceph-mon[97606]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:15.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:15 smithi080 ceph-mon[90124]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:15.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:15.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:15.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:15.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:15.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:15 smithi154 ceph-mon[96967]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:15.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:15.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:15.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:15.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:15 smithi155 ceph-mon[97606]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:15.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:17.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:17 smithi080 ceph-mon[90124]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:17 smithi154 ceph-mon[96967]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:17 smithi155 ceph-mon[97606]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:19.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:18 smithi080 ceph-mon[90124]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:19.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:18 smithi154 ceph-mon[96967]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:19.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:19.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:18 smithi155 ceph-mon[97606]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:20.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:19 smithi080 ceph-mon[90124]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-09-07T19:36:20.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:19 smithi154 ceph-mon[96967]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-09-07T19:36:20.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:19 smithi155 ceph-mon[97606]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-09-07T19:36:21.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:20 smithi080 ceph-mon[90124]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-09-07T19:36:21.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:20 smithi080 ceph-mon[90124]: osdmap e6: 1 total, 0 up, 1 in 2022-09-07T19:36:21.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:20 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:21.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:20 smithi080 ceph-mon[90124]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:36:21.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:20 smithi080 ceph-mon[90124]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:21.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:20 smithi154 ceph-mon[96967]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-09-07T19:36:21.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:20 smithi154 ceph-mon[96967]: osdmap e6: 1 total, 0 up, 1 in 2022-09-07T19:36:21.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:20 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:21.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:20 smithi154 ceph-mon[96967]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:36:21.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:20 smithi154 ceph-mon[96967]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:21.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:20 smithi155 ceph-mon[97606]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-09-07T19:36:21.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:20 smithi155 ceph-mon[97606]: osdmap e6: 1 total, 0 up, 1 in 2022-09-07T19:36:21.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:20 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:21.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:20 smithi155 ceph-mon[97606]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:36:21.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:20 smithi155 ceph-mon[97606]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.516+0000 7fb2d37fe700 1 -- 172.21.15.80:0/195293432 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb2e405fbb0 con 0x7fb2cc035b00 2022-09-07T19:36:21.517 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 0 on host 'smithi080' 2022-09-07T19:36:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb2cc035b00 msgr2=0x7fb2cc037fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb2cc035b00 0x7fb2cc037fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40677a0 tx=0x7fb2d4005ea0 comp rx=0 tx=0).stop 2022-09-07T19:36:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 msgr2=0x7fb2e40fcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 0x7fb2e40fcf40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00ebf0 tx=0x7fb2dc00ef00 comp rx=0 tx=0).stop 2022-09-07T19:36:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 shutdown_connections 2022-09-07T19:36:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2e40673d0 0x7fb2e40fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb2cc035b00 0x7fb2cc037fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2e4103a30 0x7fb2e40fcf40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 --2- 172.21.15.80:0/195293432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e4100f40 0x7fb2e40fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.519+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 >> 172.21.15.80:0/195293432 conn(0x7fb2e40f8430 msgr2=0x7fb2e40ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:36:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.520+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 shutdown_connections 2022-09-07T19:36:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:36:21.520+0000 7fb2e8ac8700 1 -- 172.21.15.80:0/195293432 wait complete. 2022-09-07T19:36:22.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:36:22.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: osdmap e7: 1 total, 0 up, 1 in 2022-09-07T19:36:22.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:22.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:22.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:22.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:22.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:22.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:22.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:22.054 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.0.service 2022-09-07T19:36:22.059 INFO:tasks.cephadm:Deploying osd.1 on smithi154 with /dev/vg_nvme/lv_4... 2022-09-07T19:36:22.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-09-07T19:36:22.089 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:36:22.090 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: osdmap e7: 1 total, 0 up, 1 in 2022-09-07T19:36:22.091 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:22.091 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:22.091 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:22.092 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:22.092 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:22.093 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:22.093 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:22.149 INFO:journalctl@ceph.osd.0.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:36:22.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:36:22.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: osdmap e7: 1 total, 0 up, 1 in 2022-09-07T19:36:22.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:22.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:22.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:22.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:22.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:22.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:22.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:22.655 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:36:23.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:22 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:36:23.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:22 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:36:23.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:22 smithi080 ceph-mon[90124]: osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] boot 2022-09-07T19:36:23.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:22 smithi080 ceph-mon[90124]: osdmap e8: 1 total, 1 up, 1 in 2022-09-07T19:36:23.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:23.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:22 smithi080 ceph-mon[90124]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:23.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:22 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:36:23.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:22 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:36:23.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:22 smithi154 ceph-mon[96967]: osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] boot 2022-09-07T19:36:23.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:22 smithi154 ceph-mon[96967]: osdmap e8: 1 total, 1 up, 1 in 2022-09-07T19:36:23.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:22 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:23.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:22 smithi154 ceph-mon[96967]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:23.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:22 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:36:23.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:22 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:36:23.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:22 smithi155 ceph-mon[97606]: osd.0 [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] boot 2022-09-07T19:36:23.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:22 smithi155 ceph-mon[97606]: osdmap e8: 1 total, 1 up, 1 in 2022-09-07T19:36:23.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:22 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:36:23.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:22 smithi155 ceph-mon[97606]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-09-07T19:36:23.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:23 smithi154 ceph-mon[96967]: osdmap e9: 1 total, 1 up, 1 in 2022-09-07T19:36:24.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:23 smithi080 ceph-mon[90124]: osdmap e9: 1 total, 1 up, 1 in 2022-09-07T19:36:24.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:23 smithi155 ceph-mon[97606]: osdmap e9: 1 total, 1 up, 1 in 2022-09-07T19:36:24.302 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-09-07T19:36:24.303 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-09-07T19:36:24.303 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2022-09-07T19:36:24.303 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2022-09-07T19:36:24.303 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0107766 s, 973 MB/s 2022-09-07T19:36:24.303 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2022-09-07T19:36:24.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2022-09-07T19:36:25.302 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:36:25.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:25 smithi154 ceph-mon[96967]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:25.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:36:25.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:25 smithi080 ceph-mon[90124]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:25.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:36:25.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:25 smithi155 ceph-mon[97606]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:25.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:36:25.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:25.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 -- 172.21.15.154:0/79314776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 msgr2=0x7f38080fd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 --2- 172.21.15.154:0/79314776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38080fd4b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009810 tx=0x7f37f8009b20 comp rx=0 tx=0).stop 2022-09-07T19:36:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 -- 172.21.15.154:0/79314776 shutdown_connections 2022-09-07T19:36:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 --2- 172.21.15.154:0/79314776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38080fe3f0 0x7f38080fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 --2- 172.21.15.154:0/79314776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fd9f0 0x7f38081052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:26.462 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 --2- 172.21.15.154:0/79314776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38080fd4b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 -- 172.21.15.154:0/79314776 >> 172.21.15.154:0/79314776 conn(0x7f38080f7bc0 msgr2=0x7f38080fa010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:36:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 -- 172.21.15.154:0/79314776 shutdown_connections 2022-09-07T19:36:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.460+0000 7f380c982700 1 -- 172.21.15.154:0/79314776 wait complete. 2022-09-07T19:36:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 Processor -- start 2022-09-07T19:36:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 -- start start 2022-09-07T19:36:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38081928c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38080fd9f0 0x7f3808192e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fe3f0 0x7f3808199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380819a440 con 0x7f38080fd9f0 2022-09-07T19:36:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380819a5b0 con 0x7f38080fd040 2022-09-07T19:36:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380c982700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380819a770 con 0x7f38080fe3f0 2022-09-07T19:36:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38081928c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:26.474 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38081928c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41662/0 (socket says 172.21.15.154:41662) 2022-09-07T19:36:26.474 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 -- 172.21.15.154:0/1256427485 learned_addr learned my addr 172.21.15.154:0/1256427485 (peer_addr_for_me v2:172.21.15.154:0/0) 2022-09-07T19:36:26.474 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f3806d9d700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fe3f0 0x7f3808199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 -- 172.21.15.154:0/1256427485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fe3f0 msgr2=0x7f3808199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f3805d9b700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38080fd9f0 0x7f3808192e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fe3f0 0x7f3808199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 -- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38080fd9f0 msgr2=0x7f3808192e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.461+0000 7f380659c700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38080fd9f0 0x7f3808192e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f380659c700 1 -- 172.21.15.154:0/1256427485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8009470 con 0x7f38080fd040 2022-09-07T19:36:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f3806d9d700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fe3f0 0x7f3808199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-07T19:36:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f380659c700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38081928c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c7a0 tx=0x7f37fc00cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:36:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc005220 con 0x7f38080fd040 2022-09-07T19:36:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f37fc005380 con 0x7f38080fd040 2022-09-07T19:36:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc004bb0 con 0x7f38080fd040 2022-09-07T19:36:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380819aa50 con 0x7f38080fd040 2022-09-07T19:36:26.478 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.462+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380819af10 con 0x7f38080fd040 2022-09-07T19:36:26.478 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.463+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38081084d0 con 0x7f38080fd040 2022-09-07T19:36:26.478 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.464+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) v1 ==== 127638+0+0 (secure 0 0 0) 0x7f37fc01f070 con 0x7f38080fd040 2022-09-07T19:36:26.478 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.464+0000 7f37f77fe700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f37f0099040 0x7f37f009b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.465+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1763+0+0 (secure 0 0 0) 0x7f37fc0c0980 con 0x7f38080fd040 2022-09-07T19:36:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.465+0000 7f3805d9b700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f37f0099040 0x7f37f009b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.465+0000 7f3805d9b700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f37f0099040 0x7f37f009b4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37f8006010 tx=0x7f37f8003500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:36:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.468+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f37fc08e9b0 con 0x7f38080fd040 2022-09-07T19:36:26.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:26 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi080 2022-09-07T19:36:26.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:26 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi080 to 17271M 2022-09-07T19:36:26.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:26 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi080 2022-09-07T19:36:26.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:26 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi080 to 17271M 2022-09-07T19:36:26.658 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:26.659+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f380805fb90 con 0x7f37f0099040 2022-09-07T19:36:26.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:26 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi080 2022-09-07T19:36:26.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:26 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi080 to 17271M 2022-09-07T19:36:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:27 smithi080 ceph-mon[90124]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:27.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:36:27.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:36:27.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:27 smithi154 ceph-mon[96967]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:36:27.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:36:27.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:27 smithi155 ceph-mon[97606]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:36:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:36:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:28.341 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:28 smithi154 ceph-mon[96967]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:36:28.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:28 smithi080 ceph-mon[90124]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:36:28.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:28 smithi155 ceph-mon[97606]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:36:29.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:29 smithi080 ceph-mon[90124]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:29.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:29 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/3412277936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]: dispatch 2022-09-07T19:36:29.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:29 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]: dispatch 2022-09-07T19:36:29.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:29 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]': finished 2022-09-07T19:36:29.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:29 smithi080 ceph-mon[90124]: osdmap e10: 2 total, 1 up, 2 in 2022-09-07T19:36:29.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:29 smithi154 ceph-mon[96967]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:29 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/3412277936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]: dispatch 2022-09-07T19:36:29.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:29 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]: dispatch 2022-09-07T19:36:29.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:29 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]': finished 2022-09-07T19:36:29.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:29 smithi154 ceph-mon[96967]: osdmap e10: 2 total, 1 up, 2 in 2022-09-07T19:36:29.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:29 smithi155 ceph-mon[97606]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:29 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/3412277936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]: dispatch 2022-09-07T19:36:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:29 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]: dispatch 2022-09-07T19:36:29.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:29 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5f59885-06fb-4869-81ab-b0cab1580cba"}]': finished 2022-09-07T19:36:29.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:29 smithi155 ceph-mon[97606]: osdmap e10: 2 total, 1 up, 2 in 2022-09-07T19:36:29.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:30.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:30 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/3625935843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:36:30.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:30 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/3625935843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:36:30.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:30 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/3625935843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:36:31.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:31 smithi080 ceph-mon[90124]: pgmap v54: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:31 smithi154 ceph-mon[96967]: pgmap v54: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:31.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:31 smithi155 ceph-mon[97606]: pgmap v54: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:33.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:33 smithi154 ceph-mon[96967]: pgmap v55: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:33.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:33 smithi080 ceph-mon[90124]: pgmap v55: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:33 smithi155 ceph-mon[97606]: pgmap v55: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:35.543 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:35 smithi154 ceph-mon[96967]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:35.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:35 smithi080 ceph-mon[90124]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:35 smithi155 ceph-mon[97606]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:36.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-09-07T19:36:36.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-09-07T19:36:36.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-09-07T19:36:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:37.527 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:37 smithi154 ceph-mon[96967]: Deploying daemon osd.1 on smithi154 2022-09-07T19:36:37.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:37 smithi154 ceph-mon[96967]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:37.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:37 smithi080 ceph-mon[90124]: Deploying daemon osd.1 on smithi154 2022-09-07T19:36:37.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:37 smithi080 ceph-mon[90124]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:37 smithi155 ceph-mon[97606]: Deploying daemon osd.1 on smithi154 2022-09-07T19:36:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:37 smithi155 ceph-mon[97606]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:39.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:39 smithi080 ceph-mon[90124]: pgmap v58: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:39 smithi154 ceph-mon[96967]: pgmap v58: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:39 smithi155 ceph-mon[97606]: pgmap v58: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:41.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:41 smithi080 ceph-mon[90124]: pgmap v59: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:41 smithi154 ceph-mon[96967]: pgmap v59: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:41 smithi155 ceph-mon[97606]: pgmap v59: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:42.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:42.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:42.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:42.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:42.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:36:42.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:36:42.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:42.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:36:42.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:36:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:36:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:36:43.643 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:43 smithi080 ceph-mon[90124]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:43 smithi155 ceph-mon[97606]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:43.724 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:43 smithi154 ceph-mon[96967]: pgmap v60: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:44.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:45.644 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 1 on host 'smithi154' 2022-09-07T19:36:45.644 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.644+0000 7f37f77fe700 1 -- 172.21.15.154:0/1256427485 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f380805fb90 con 0x7f37f0099040 2022-09-07T19:36:45.646 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f37f0099040 msgr2=0x7f37f009b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:45.646 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f37f0099040 0x7f37f009b4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37f8006010 tx=0x7f37f8003500 comp rx=0 tx=0).stop 2022-09-07T19:36:45.647 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 msgr2=0x7f38081928c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:45.647 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38081928c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c7a0 tx=0x7f37fc00cb60 comp rx=0 tx=0).stop 2022-09-07T19:36:45.647 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 shutdown_connections 2022-09-07T19:36:45.647 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f37f0099040 0x7f37f009b4f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:45.648 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38080fe3f0 0x7f3808199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:45.648 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38080fd040 0x7f38081928c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:45.648 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 --2- 172.21.15.154:0/1256427485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38080fd9f0 0x7f3808192e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:45.648 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 >> 172.21.15.154:0/1256427485 conn(0x7f38080f7bc0 msgr2=0x7f38080f9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:36:45.648 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 shutdown_connections 2022-09-07T19:36:45.649 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:36:45.647+0000 7f380c982700 1 -- 172.21.15.154:0/1256427485 wait complete. 2022-09-07T19:36:45.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:45 smithi154 ceph-mon[96967]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:45.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:45 smithi154 ceph-mon[96967]: from='osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-09-07T19:36:45.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:45 smithi154 ceph-mon[96967]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-09-07T19:36:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:45 smithi080 ceph-mon[90124]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:45 smithi080 ceph-mon[90124]: from='osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-09-07T19:36:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:45 smithi080 ceph-mon[90124]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-09-07T19:36:45.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:45 smithi155 ceph-mon[97606]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:45.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:45 smithi155 ceph-mon[97606]: from='osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-09-07T19:36:45.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:45 smithi155 ceph-mon[97606]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-09-07T19:36:46.066 DEBUG:teuthology.orchestra.run.smithi154:osd.1> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.1.service 2022-09-07T19:36:46.070 INFO:tasks.cephadm:Deploying osd.2 on smithi155 with /dev/vg_nvme/lv_4... 2022-09-07T19:36:46.070 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-09-07T19:36:46.095 INFO:journalctl@ceph.osd.1.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:36:46.671 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:36:46.844 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-09-07T19:36:46.845 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: osdmap e11: 2 total, 1 up, 2 in 2022-09-07T19:36:46.845 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:46.845 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:36:46.846 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:36:46.846 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:46.846 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:46.847 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:46.847 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:46.847 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:46.848 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:46 smithi155 ceph-mon[97606]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:46.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-09-07T19:36:46.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: osdmap e11: 2 total, 1 up, 2 in 2022-09-07T19:36:46.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:46.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:36:46.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:36:46.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:46.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:46.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:46.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:46.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:46.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:46 smithi080 ceph-mon[90124]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:46.874 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-1[102140]: 2022-09-07T19:36:46.576+0000 7fbcd228f700 -1 osd.1 0 waiting for initial osdmap 2022-09-07T19:36:46.875 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-1[102140]: 2022-09-07T19:36:46.580+0000 7fbcce885700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:36:46.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-09-07T19:36:46.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: osdmap e11: 2 total, 1 up, 2 in 2022-09-07T19:36:46.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:46.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:36:46.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:36:46.877 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:46.877 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:46.877 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:36:46.877 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:46.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:36:46.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:46 smithi154 ceph-mon[96967]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:47.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:47 smithi080 ceph-mon[90124]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:36:47.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:47 smithi080 ceph-mon[90124]: osdmap e12: 2 total, 1 up, 2 in 2022-09-07T19:36:47.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:47 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:47.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:47 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:47 smithi154 ceph-mon[96967]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:36:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:47 smithi154 ceph-mon[96967]: osdmap e12: 2 total, 1 up, 2 in 2022-09-07T19:36:47.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:47 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:47.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:47 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:47.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:47 smithi155 ceph-mon[97606]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:36:47.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:47 smithi155 ceph-mon[97606]: osdmap e12: 2 total, 1 up, 2 in 2022-09-07T19:36:47.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:47 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:47.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:47 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:48.069 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-09-07T19:36:48.069 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-09-07T19:36:48.070 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2022-09-07T19:36:48.070 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2022-09-07T19:36:48.071 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.01088 s, 964 MB/s 2022-09-07T19:36:48.071 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2022-09-07T19:36:48.395 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2022-09-07T19:36:48.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:36:48.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:36:48.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] boot 2022-09-07T19:36:48.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: osdmap e13: 2 total, 2 up, 2 in 2022-09-07T19:36:48.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:48.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: pgmap v66: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:48.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi154 2022-09-07T19:36:48.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:36:48.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi154 to 17168M 2022-09-07T19:36:48.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.648 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:36:48.648 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:36:48.648 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] boot 2022-09-07T19:36:48.648 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: osdmap e13: 2 total, 2 up, 2 in 2022-09-07T19:36:48.649 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:48.649 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: pgmap v66: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:48.649 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi154 2022-09-07T19:36:48.650 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.650 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.650 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:36:48.650 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi154 to 17168M 2022-09-07T19:36:48.651 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.651 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:36:48.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:36:48.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: osd.1 [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] boot 2022-09-07T19:36:48.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: osdmap e13: 2 total, 2 up, 2 in 2022-09-07T19:36:48.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:36:48.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: pgmap v66: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2022-09-07T19:36:48.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi154 2022-09-07T19:36:48.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:36:48.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi154 to 17168M 2022-09-07T19:36:48.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:36:48.987 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:36:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:49 smithi155 ceph-mon[97606]: osdmap e14: 2 total, 2 up, 2 in 2022-09-07T19:36:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:49 smithi080 ceph-mon[90124]: osdmap e14: 2 total, 2 up, 2 in 2022-09-07T19:36:49.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:49 smithi154 ceph-mon[96967]: osdmap e14: 2 total, 2 up, 2 in 2022-09-07T19:36:50.047 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 -- 172.21.15.155:0/3194104180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fde20 msgr2=0x7f61a80fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:50.048 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 --2- 172.21.15.155:0/3194104180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fde20 0x7f61a80fe230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009840 tx=0x7f61a4009b50 comp rx=0 tx=0).stop 2022-09-07T19:36:50.048 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 -- 172.21.15.155:0/3194104180 shutdown_connections 2022-09-07T19:36:50.049 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 --2- 172.21.15.155:0/3194104180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61a80ffa40 0x7f61a8106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:50.049 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 --2- 172.21.15.155:0/3194104180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fde20 0x7f61a80fe230 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:50.049 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 --2- 172.21.15.155:0/3194104180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61a80ff090 0x7f61a80ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:50.050 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 -- 172.21.15.155:0/3194104180 >> 172.21.15.155:0/3194104180 conn(0x7f61a80f9580 msgr2=0x7f61a80fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:36:50.052 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 -- 172.21.15.155:0/3194104180 shutdown_connections 2022-09-07T19:36:50.052 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 -- 172.21.15.155:0/3194104180 wait complete. 2022-09-07T19:36:50.052 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 Processor -- start 2022-09-07T19:36:50.053 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.043+0000 7f61afa7a700 1 -- start start 2022-09-07T19:36:50.053 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61a80fde20 0x7f61a8193b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:50.054 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 0x7f61a81940a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:50.054 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61a80ffa40 0x7f61a819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:50.055 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a819b6e0 con 0x7f61a80fde20 2022-09-07T19:36:50.055 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a819b850 con 0x7f61a80ffa40 2022-09-07T19:36:50.056 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a819ba10 con 0x7f61a80ff090 2022-09-07T19:36:50.056 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 0x7f61a81940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:50.056 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 0x7f61a81940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58836/0 (socket says 172.21.15.155:58836) 2022-09-07T19:36:50.057 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 -- 172.21.15.155:0/1116198600 learned_addr learned my addr 172.21.15.155:0/1116198600 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:36:50.057 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ae017700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61a80ffa40 0x7f61a819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:50.058 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 -- 172.21.15.155:0/1116198600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61a80ffa40 msgr2=0x7f61a819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:50.058 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61a80ffa40 0x7f61a819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:50.059 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 -- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61a80fde20 msgr2=0x7f61a8193b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:36:50.059 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad816700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61a80fde20 0x7f61a8193b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:50.059 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61a80fde20 0x7f61a8193b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:36:50.060 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 -- 172.21.15.155:0/1116198600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009470 con 0x7f61a80ff090 2022-09-07T19:36:50.060 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61ad015700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 0x7f61a81940a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f619800b410 tx=0x7f619800b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:36:50.060 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198011830 con 0x7f61a80ff090 2022-09-07T19:36:50.060 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a819bcf0 con 0x7f61a80ff090 2022-09-07T19:36:50.061 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6198011e30 con 0x7f61a80ff090 2022-09-07T19:36:50.061 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198010e20 con 0x7f61a80ff090 2022-09-07T19:36:50.061 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.044+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a819c1b0 con 0x7f61a80ff090 2022-09-07T19:36:50.061 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.045+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a8109710 con 0x7f61a80ff090 2022-09-07T19:36:50.062 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.046+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 15) v1 ==== 127638+0+0 (secure 0 0 0) 0x7f6198021070 con 0x7f61a80ff090 2022-09-07T19:36:50.062 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.047+0000 7f619effd700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6194098fc0 0x7f619409b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:36:50.062 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.047+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2305+0+0 (secure 0 0 0) 0x7f61980c0680 con 0x7f61a80ff090 2022-09-07T19:36:50.062 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.047+0000 7f61ad816700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6194098fc0 0x7f619409b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:36:50.063 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.047+0000 7f61ad816700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6194098fc0 0x7f619409b470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61a4006010 tx=0x7f61a4009f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:36:50.063 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.051+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f619808e490 con 0x7f61a80ff090 2022-09-07T19:36:50.244 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:36:50.245+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f61a805fbb0 con 0x7f6194098fc0 2022-09-07T19:36:50.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:50 smithi080 ceph-mon[90124]: pgmap v68: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:50.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:50 smithi080 ceph-mon[90124]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:36:50.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:36:50.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:36:50.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:50.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:50 smithi154 ceph-mon[96967]: pgmap v68: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:50.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:50 smithi154 ceph-mon[96967]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:36:50.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:36:50.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:36:50.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:50.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:50 smithi155 ceph-mon[97606]: pgmap v68: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:50.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:50 smithi155 ceph-mon[97606]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:36:50.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:36:50.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:36:50.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:53.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:52 smithi155 ceph-mon[97606]: pgmap v69: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:53.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:52 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/1361619519' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]: dispatch 2022-09-07T19:36:53.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:52 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]: dispatch 2022-09-07T19:36:53.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:52 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]': finished 2022-09-07T19:36:53.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:52 smithi155 ceph-mon[97606]: osdmap e15: 3 total, 2 up, 3 in 2022-09-07T19:36:53.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:52 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:36:53.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:52 smithi080 ceph-mon[90124]: pgmap v69: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:52 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/1361619519' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]: dispatch 2022-09-07T19:36:53.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:52 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]: dispatch 2022-09-07T19:36:53.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:52 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]': finished 2022-09-07T19:36:53.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:52 smithi080 ceph-mon[90124]: osdmap e15: 3 total, 2 up, 3 in 2022-09-07T19:36:53.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:52 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:36:53.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:52 smithi154 ceph-mon[96967]: pgmap v69: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:53.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:52 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/1361619519' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]: dispatch 2022-09-07T19:36:53.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:52 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]: dispatch 2022-09-07T19:36:53.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:52 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d02a02f-84eb-4310-8c4e-bea1be050f7f"}]': finished 2022-09-07T19:36:53.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:52 smithi154 ceph-mon[96967]: osdmap e15: 3 total, 2 up, 3 in 2022-09-07T19:36:53.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:52 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:36:54.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:53 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/1586574814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:36:54.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:53 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/1586574814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:36:54.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:53 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/1586574814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:36:55.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:55 smithi080 ceph-mon[90124]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:55 smithi154 ceph-mon[96967]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:55 smithi155 ceph-mon[97606]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:57.538 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:57 smithi155 ceph-mon[97606]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:57.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:57 smithi080 ceph-mon[90124]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:57 smithi154 ceph-mon[96967]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:59.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:59 smithi080 ceph-mon[90124]: pgmap v73: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:59.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-09-07T19:36:59.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:36:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:59 smithi154 ceph-mon[96967]: pgmap v73: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:59.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-09-07T19:36:59.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:36:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:36:59.649 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:59 smithi155 ceph-mon[97606]: pgmap v73: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:36:59.650 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-09-07T19:36:59.650 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:36:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:00.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:00 smithi080 ceph-mon[90124]: Deploying daemon osd.2 on smithi155 2022-09-07T19:37:00.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:00 smithi154 ceph-mon[96967]: Deploying daemon osd.2 on smithi155 2022-09-07T19:37:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:00 smithi155 ceph-mon[97606]: Deploying daemon osd.2 on smithi155 2022-09-07T19:37:01.356 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:01 smithi155 ceph-mon[97606]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:01.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:01 smithi080 ceph-mon[90124]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:01.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:01 smithi154 ceph-mon[96967]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:03.585 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:03 smithi155 ceph-mon[97606]: pgmap v75: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:03.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:03 smithi080 ceph-mon[90124]: pgmap v75: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:03 smithi154 ceph-mon[96967]: pgmap v75: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:05.543 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:05 smithi155 ceph-mon[97606]: pgmap v76: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:05.544 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:05.544 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:05.545 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:05.545 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:05.546 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:05.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:05 smithi080 ceph-mon[90124]: pgmap v76: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:05.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:05.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:05.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:05.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:05.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:05 smithi154 ceph-mon[96967]: pgmap v76: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:05.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:05.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:07 smithi155 ceph-mon[97606]: pgmap v77: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:07 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:07 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:07 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:07 smithi080 ceph-mon[90124]: pgmap v77: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:07.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:07 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:07 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:07 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:07 smithi154 ceph-mon[96967]: pgmap v77: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:07 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:07 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:07 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:08.276 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.276+0000 7f619effd700 1 -- 172.21.15.155:0/1116198600 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f61a805fbb0 con 0x7f6194098fc0 2022-09-07T19:37:08.277 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 2 on host 'smithi155' 2022-09-07T19:37:08.278 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6194098fc0 msgr2=0x7f619409b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:08.278 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6194098fc0 0x7f619409b470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61a4006010 tx=0x7f61a4009f50 comp rx=0 tx=0).stop 2022-09-07T19:37:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 msgr2=0x7f61a81940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 0x7f61a81940a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f619800b410 tx=0x7f619800b7d0 comp rx=0 tx=0).stop 2022-09-07T19:37:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 shutdown_connections 2022-09-07T19:37:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61a80fde20 0x7f61a8193b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6194098fc0 0x7f619409b470 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61a80ffa40 0x7f61a819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 --2- 172.21.15.155:0/1116198600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80ff090 0x7f61a81940a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 >> 172.21.15.155:0/1116198600 conn(0x7f61a80f9580 msgr2=0x7f61a80fb850 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:37:08.281 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 shutdown_connections 2022-09-07T19:37:08.281 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:37:08.278+0000 7f61afa7a700 1 -- 172.21.15.155:0/1116198600 wait complete. 2022-09-07T19:37:08.648 DEBUG:teuthology.orchestra.run.smithi155:osd.2> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.2.service 2022-09-07T19:37:08.651 INFO:tasks.cephadm:Deploying osd.3 on smithi080 with /dev/vg_nvme/lv_3... 2022-09-07T19:37:08.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-09-07T19:37:08.678 INFO:journalctl@ceph.osd.2.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:37:09.442 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: pgmap v78: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:09.443 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:09.444 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:09.444 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:09.445 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:09.445 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:09.445 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-09-07T19:37:09.445 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:09 smithi155 ceph-mon[97606]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-09-07T19:37:09.524 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:37:09.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: pgmap v78: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:09.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:09.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-09-07T19:37:09.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:09 smithi080 ceph-mon[90124]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-09-07T19:37:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: pgmap v78: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-09-07T19:37:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:09 smithi154 ceph-mon[96967]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-09-07T19:37:10.559 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-2[103466]: 2022-09-07T19:37:10.291+0000 7fd6faea6700 -1 osd.2 0 waiting for initial osdmap 2022-09-07T19:37:10.559 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-2[103466]: 2022-09-07T19:37:10.297+0000 7fd6f5c99700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:37:10.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-mon[97606]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-09-07T19:37:10.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-mon[97606]: osdmap e16: 3 total, 2 up, 3 in 2022-09-07T19:37:10.560 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:10.561 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-mon[97606]: from='osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:37:10.561 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:10 smithi155 ceph-mon[97606]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:37:10.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:10 smithi080 ceph-mon[90124]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-09-07T19:37:10.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:10 smithi080 ceph-mon[90124]: osdmap e16: 3 total, 2 up, 3 in 2022-09-07T19:37:10.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:10.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:10 smithi080 ceph-mon[90124]: from='osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:37:10.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:10 smithi080 ceph-mon[90124]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:37:10.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:10 smithi154 ceph-mon[96967]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-09-07T19:37:10.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:10 smithi154 ceph-mon[96967]: osdmap e16: 3 total, 2 up, 3 in 2022-09-07T19:37:10.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:10.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:10 smithi154 ceph-mon[96967]: from='osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:37:10.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:10 smithi154 ceph-mon[96967]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:37:11.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: pgmap v80: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:11.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:37:11.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: osdmap e17: 3 total, 2 up, 3 in 2022-09-07T19:37:11.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:11.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:11.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:11.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: pgmap v80: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:37:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: osdmap e17: 3 total, 2 up, 3 in 2022-09-07T19:37:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:11.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: pgmap v80: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:37:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: osdmap e17: 3 total, 2 up, 3 in 2022-09-07T19:37:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:11.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:11.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-09-07T19:37:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-09-07T19:37:11.700 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2022-09-07T19:37:11.700 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2022-09-07T19:37:11.700 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0577579 s, 182 MB/s 2022-09-07T19:37:11.700 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2022-09-07T19:37:12.188 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2022-09-07T19:37:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:37:12.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:37:12.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi155 2022-09-07T19:37:12.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi155 to 17168M 2022-09-07T19:37:12.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] boot 2022-09-07T19:37:12.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: osdmap e18: 3 total, 3 up, 3 in 2022-09-07T19:37:12.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:12 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:37:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:37:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:37:13.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi155 2022-09-07T19:37:13.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi155 to 17168M 2022-09-07T19:37:13.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] boot 2022-09-07T19:37:13.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: osdmap e18: 3 total, 3 up, 3 in 2022-09-07T19:37:13.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:37:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:37:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi155 2022-09-07T19:37:13.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi155 to 17168M 2022-09-07T19:37:13.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: osd.2 [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] boot 2022-09-07T19:37:13.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: osdmap e18: 3 total, 3 up, 3 in 2022-09-07T19:37:13.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:12 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:37:13.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:13 smithi155 ceph-mon[97606]: pgmap v83: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:13.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2022-09-07T19:37:13.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2022-09-07T19:37:13.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:13 smithi155 ceph-mon[97606]: osdmap e19: 3 total, 3 up, 3 in 2022-09-07T19:37:13.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-09-07T19:37:14.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:13 smithi080 ceph-mon[90124]: pgmap v83: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:14.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2022-09-07T19:37:14.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2022-09-07T19:37:14.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:13 smithi080 ceph-mon[90124]: osdmap e19: 3 total, 3 up, 3 in 2022-09-07T19:37:14.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-09-07T19:37:14.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:13 smithi154 ceph-mon[96967]: pgmap v83: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2022-09-07T19:37:14.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2022-09-07T19:37:14.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2022-09-07T19:37:14.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:13 smithi154 ceph-mon[96967]: osdmap e19: 3 total, 3 up, 3 in 2022-09-07T19:37:14.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-09-07T19:37:14.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 -- 172.21.15.80:0/449845874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634105d50 msgr2=0x7fa634108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:14.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 --2- 172.21.15.80:0/449845874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634105d50 0x7fa634108150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009b00 tx=0x7fa62c009e10 comp rx=0 tx=0).stop 2022-09-07T19:37:14.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 -- 172.21.15.80:0/449845874 shutdown_connections 2022-09-07T19:37:14.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 --2- 172.21.15.80:0/449845874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634105d50 0x7fa634108150 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:14.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 --2- 172.21.15.80:0/449845874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634072c10 0x7fa6340710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:14.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 --2- 172.21.15.80:0/449845874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa634071630 0x7fa634071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:14.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 -- 172.21.15.80:0/449845874 >> 172.21.15.80:0/449845874 conn(0x7fa6340f9570 msgr2=0x7fa6340fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:37:14.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 -- 172.21.15.80:0/449845874 shutdown_connections 2022-09-07T19:37:14.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.492+0000 7fa6394a6700 1 -- 172.21.15.80:0/449845874 wait complete. 2022-09-07T19:37:14.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 Processor -- start 2022-09-07T19:37:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 -- start start 2022-09-07T19:37:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634071630 0x7fa634195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 0x7fa6341961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa634105d50 0x7fa63419d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63419d820 con 0x7fa634105d50 2022-09-07T19:37:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63419d990 con 0x7fa634072c10 2022-09-07T19:37:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.494+0000 7fa6394a6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63419db50 con 0x7fa634071630 2022-09-07T19:37:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 0x7fa6341961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa632ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634071630 0x7fa634195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 0x7fa6341961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:40482/0 (socket says 172.21.15.80:40482) 2022-09-07T19:37:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 -- 172.21.15.80:0/3734489386 learned_addr learned my addr 172.21.15.80:0/3734489386 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:37:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6337fe700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa634105d50 0x7fa63419d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 -- 172.21.15.80:0/3734489386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634071630 msgr2=0x7fa634195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634071630 0x7fa634195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 -- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa634105d50 msgr2=0x7fa63419d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa634105d50 0x7fa63419d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 -- 172.21.15.80:0/3734489386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628009470 con 0x7fa634072c10 2022-09-07T19:37:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa632ffd700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634071630 0x7fa634195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:37:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.495+0000 7fa6327fc700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 0x7fa6341961a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa62800e9c0 tx=0x7fa62800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:37:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.496+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628004220 con 0x7fa634072c10 2022-09-07T19:37:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.496+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fa628004380 con 0x7fa634072c10 2022-09-07T19:37:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.496+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628003c50 con 0x7fa634072c10 2022-09-07T19:37:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.496+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c009730 con 0x7fa634072c10 2022-09-07T19:37:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.496+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63419e1b0 con 0x7fa634072c10 2022-09-07T19:37:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.497+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63410b810 con 0x7fa634072c10 2022-09-07T19:37:14.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.499+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) v1 ==== 127638+0+0 (secure 0 0 0) 0x7fa62801e020 con 0x7fa634072c10 2022-09-07T19:37:14.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.500+0000 7fa61bfff700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa620098f60 0x7fa62009b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.500+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3233+0+0 (secure 0 0 0) 0x7fa628014070 con 0x7fa634072c10 2022-09-07T19:37:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.500+0000 7fa632ffd700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa620098f60 0x7fa62009b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.501+0000 7fa632ffd700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa620098f60 0x7fa62009b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa634197130 tx=0x7fa624005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:37:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.503+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa62808f3a0 con 0x7fa634072c10 2022-09-07T19:37:14.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.683+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fa62800c040 con 0x7fa634072c10 2022-09-07T19:37:14.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:14.739+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa63405fb20 con 0x7fa620098f60 2022-09-07T19:37:14.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:14 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-09-07T19:37:14.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:14 smithi080 ceph-mon[90124]: osdmap e20: 3 total, 3 up, 3 in 2022-09-07T19:37:14.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:14 smithi080 ceph-mon[90124]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:14.817 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:14 smithi080 sudo[105670]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2022-09-07T19:37:14.818 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:14 smithi080 sudo[105670]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:14.818 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:14 smithi080 sudo[105670]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:14.819 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:14 smithi080 sudo[105670]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:14 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-09-07T19:37:14.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:14 smithi155 ceph-mon[97606]: osdmap e20: 3 total, 3 up, 3 in 2022-09-07T19:37:14.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:14 smithi155 ceph-mon[97606]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:15.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:14 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-09-07T19:37:15.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:14 smithi154 ceph-mon[96967]: osdmap e20: 3 total, 3 up, 3 in 2022-09-07T19:37:15.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:14 smithi154 ceph-mon[96967]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:15.618 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:15 smithi080 sudo[105755]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2022-09-07T19:37:15.619 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:15 smithi080 sudo[105755]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:15.619 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:15 smithi080 sudo[105755]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:15.619 INFO:journalctl@ceph.osd.0.smithi080.stdout:Sep 07 19:37:15 smithi080 sudo[105755]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:15.893 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104547]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2022-09-07T19:37:15.894 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:15.894 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104547]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:15.894 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104547]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:15.895 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: osdmap e21: 3 total, 3 up, 3 in 2022-09-07T19:37:15.895 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: mgrmap e16: x(active, since 2m), standbys: z, y 2022-09-07T19:37:15.895 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:37:15.896 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:37:15.896 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:37:15.896 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:15.896 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:15.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: osdmap e21: 3 total, 3 up, 3 in 2022-09-07T19:37:15.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: mgrmap e16: x(active, since 2m), standbys: z, y 2022-09-07T19:37:15.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:37:15.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:37:15.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:37:15.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:15.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:16.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: osdmap e21: 3 total, 3 up, 3 in 2022-09-07T19:37:16.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: mgrmap e16: x(active, since 2m), standbys: z, y 2022-09-07T19:37:16.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:37:16.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:37:16.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:37:16.077 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:16.077 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:16.373 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104550]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2022-09-07T19:37:16.373 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104550]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:16.374 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104550]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:16.374 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 07 19:37:15 smithi154 sudo[104550]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:16.426 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105913]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2022-09-07T19:37:16.426 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105913]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:16.426 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105913]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:16.427 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105913]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:16.697 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105916]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2022-09-07T19:37:16.697 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105916]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:16.698 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105916]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:16.698 INFO:journalctl@ceph.osd.2.smithi155.stdout:Sep 07 19:37:16 smithi155 sudo[105916]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:17.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105898]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2022-09-07T19:37:17.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105898]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:17.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105898]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:17.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105898]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:18.252 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:17 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:18.252 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:17 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:18.253 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:17 smithi155 ceph-mon[97606]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:18.253 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105919]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2022-09-07T19:37:18.253 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105919]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:18.253 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105919]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:18.253 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105919]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:18.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105927]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2022-09-07T19:37:18.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105927]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:18.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105927]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:18.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 sudo[105927]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:18.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:18.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:18.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:17 smithi080 ceph-mon[90124]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:18.372 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:17 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:18.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:17 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:18.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:17 smithi154 ceph-mon[96967]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:18.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105922]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2022-09-07T19:37:18.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105922]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:18.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105922]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:18.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 sudo[105922]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:18.984 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104553]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2022-09-07T19:37:18.984 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:18.985 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104553]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:18.985 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104553]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:19.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:19.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:19.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:19.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3507817931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]: dispatch 2022-09-07T19:37:19.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]: dispatch 2022-09-07T19:37:19.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:18 smithi080 ceph-mon[90124]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:19.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]': finished 2022-09-07T19:37:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: osdmap e22: 4 total, 3 up, 4 in 2022-09-07T19:37:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:19 smithi080 ceph-mon[90124]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104556]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2022-09-07T19:37:19.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2022-09-07T19:37:19.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104556]: pam_unix(sudo:session): session opened for user root by (uid=0) 2022-09-07T19:37:19.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 sudo[104556]: pam_unix(sudo:session): session closed for user root 2022-09-07T19:37:19.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:19.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:19.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:19.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3507817931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]: dispatch 2022-09-07T19:37:19.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]: dispatch 2022-09-07T19:37:19.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:19.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]': finished 2022-09-07T19:37:19.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: osdmap e22: 4 total, 3 up, 4 in 2022-09-07T19:37:19.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:19.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:18 smithi154 ceph-mon[96967]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:19.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:19.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:19.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:19.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3507817931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]: dispatch 2022-09-07T19:37:19.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]: dispatch 2022-09-07T19:37:19.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-09-07T19:37:19.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:37:19.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:37:19.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489c00ce-8e46-462f-85ee-9444ff4540ec"}]': finished 2022-09-07T19:37:19.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: osdmap e22: 4 total, 3 up, 4 in 2022-09-07T19:37:19.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:37:19.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:19.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:18 smithi155 ceph-mon[97606]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-09-07T19:37:20.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:20 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1845932922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:37:20.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:20 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1845932922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:37:20.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:20 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1845932922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:37:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:21 smithi080 ceph-mon[90124]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:21 smithi154 ceph-mon[96967]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:21 smithi155 ceph-mon[97606]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:23.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:23 smithi080 ceph-mon[90124]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:23 smithi154 ceph-mon[96967]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:23 smithi155 ceph-mon[97606]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:25 smithi080 ceph-mon[90124]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2022-09-07T19:37:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:25 smithi154 ceph-mon[96967]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2022-09-07T19:37:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:25 smithi155 ceph-mon[97606]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2022-09-07T19:37:27.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:27 smithi080 ceph-mon[90124]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2022-09-07T19:37:27.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-09-07T19:37:27.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:27 smithi154 ceph-mon[96967]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2022-09-07T19:37:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-09-07T19:37:27.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:27 smithi155 ceph-mon[97606]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2022-09-07T19:37:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-09-07T19:37:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:28.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:28 smithi080 ceph-mon[90124]: Deploying daemon osd.3 on smithi080 2022-09-07T19:37:28.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:28 smithi154 ceph-mon[96967]: Deploying daemon osd.3 on smithi080 2022-09-07T19:37:28.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:28 smithi155 ceph-mon[97606]: Deploying daemon osd.3 on smithi080 2022-09-07T19:37:29.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:29 smithi080 ceph-mon[90124]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2022-09-07T19:37:29.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:29 smithi154 ceph-mon[96967]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2022-09-07T19:37:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:29 smithi155 ceph-mon[97606]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2022-09-07T19:37:31.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:31 smithi080 ceph-mon[90124]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2022-09-07T19:37:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:31 smithi154 ceph-mon[96967]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2022-09-07T19:37:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:31 smithi155 ceph-mon[97606]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2022-09-07T19:37:33.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:33 smithi080 ceph-mon[90124]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2022-09-07T19:37:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:33 smithi154 ceph-mon[96967]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2022-09-07T19:37:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:33 smithi155 ceph-mon[97606]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2022-09-07T19:37:35.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:35 smithi080 ceph-mon[90124]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2022-09-07T19:37:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:35 smithi154 ceph-mon[96967]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2022-09-07T19:37:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:35 smithi155 ceph-mon[97606]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2022-09-07T19:37:37.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:37 smithi080 ceph-mon[90124]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:37.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:37.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:37.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:37.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:37.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:37 smithi154 ceph-mon[96967]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:37.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:37.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:37.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:37 smithi155 ceph-mon[97606]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:37.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:39.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:39 smithi080 ceph-mon[90124]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:39 smithi154 ceph-mon[96967]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:39 smithi155 ceph-mon[97606]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:41.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:41 smithi080 ceph-mon[90124]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:41.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:41 smithi154 ceph-mon[96967]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:41 smithi155 ceph-mon[97606]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:41.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:42.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:42 smithi080 ceph-mon[90124]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-09-07T19:37:42.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:37:42.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:37:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:42 smithi154 ceph-mon[96967]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-09-07T19:37:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:37:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:37:42.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:42 smithi155 ceph-mon[97606]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-09-07T19:37:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:37:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:37:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:43 smithi080 ceph-mon[90124]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:43 smithi080 ceph-mon[90124]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-09-07T19:37:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:43 smithi080 ceph-mon[90124]: osdmap e23: 4 total, 3 up, 4 in 2022-09-07T19:37:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:43 smithi080 ceph-mon[90124]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:37:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:43 smithi154 ceph-mon[96967]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:43 smithi154 ceph-mon[96967]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-09-07T19:37:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:43 smithi154 ceph-mon[96967]: osdmap e23: 4 total, 3 up, 4 in 2022-09-07T19:37:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:43 smithi154 ceph-mon[96967]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:37:43.693 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 3 on host 'smithi080' 2022-09-07T19:37:43.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.694+0000 7fa61bfff700 1 -- 172.21.15.80:0/3734489386 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa63405fb20 con 0x7fa620098f60 2022-09-07T19:37:43.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.696+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa620098f60 msgr2=0x7fa62009b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.696+0000 7fa6394a6700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa620098f60 0x7fa62009b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa634197130 tx=0x7fa624005ea0 comp rx=0 tx=0).stop 2022-09-07T19:37:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 msgr2=0x7fa6341961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 0x7fa6341961a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa62800e9c0 tx=0x7fa62800ecd0 comp rx=0 tx=0).stop 2022-09-07T19:37:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 shutdown_connections 2022-09-07T19:37:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa634105d50 0x7fa63419d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa620098f60 0x7fa62009b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:43.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa634071630 0x7fa634195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:43.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 --2- 172.21.15.80:0/3734489386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634072c10 0x7fa6341961a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:43.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 >> 172.21.15.80:0/3734489386 conn(0x7fa6340f9570 msgr2=0x7fa6340fb950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:37:43.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 shutdown_connections 2022-09-07T19:37:43.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:37:43.697+0000 7fa6394a6700 1 -- 172.21.15.80:0/3734489386 wait complete. 2022-09-07T19:37:43.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:43 smithi155 ceph-mon[97606]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:43.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:43 smithi155 ceph-mon[97606]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-09-07T19:37:43.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:43 smithi155 ceph-mon[97606]: osdmap e23: 4 total, 3 up, 4 in 2022-09-07T19:37:43.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:43.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:43 smithi155 ceph-mon[97606]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:37:44.100 DEBUG:teuthology.orchestra.run.smithi080:osd.3> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.3.service 2022-09-07T19:37:44.106 INFO:tasks.cephadm:Deploying osd.4 on smithi154 with /dev/vg_nvme/lv_3... 2022-09-07T19:37:44.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-09-07T19:37:44.196 INFO:journalctl@ceph.osd.3.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:37:44.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:37:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: osdmap e24: 4 total, 3 up, 4 in 2022-09-07T19:37:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:44.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:44.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:44.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:44.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:44.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] boot 2022-09-07T19:37:44.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: osdmap e25: 4 total, 4 up, 4 in 2022-09-07T19:37:44.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:37:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: osdmap e24: 4 total, 3 up, 4 in 2022-09-07T19:37:44.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:44.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:44.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:44.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:44.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:44.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] boot 2022-09-07T19:37:44.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: osdmap e25: 4 total, 4 up, 4 in 2022-09-07T19:37:44.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:37:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: osdmap e24: 4 total, 3 up, 4 in 2022-09-07T19:37:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:44.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:44.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:37:44.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:44.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:37:44.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: osd.3 [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] boot 2022-09-07T19:37:44.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: osdmap e25: 4 total, 4 up, 4 in 2022-09-07T19:37:44.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:37:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:37:45.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:45 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:37:45.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:45 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:37:45.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:45 smithi080 ceph-mon[90124]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:45.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:45 smithi080 ceph-mon[90124]: osdmap e26: 4 total, 4 up, 4 in 2022-09-07T19:37:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:45 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:37:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:45 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:37:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:45 smithi154 ceph-mon[96967]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:45.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:45 smithi154 ceph-mon[96967]: osdmap e26: 4 total, 4 up, 4 in 2022-09-07T19:37:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:45 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:37:45.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:45 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:37:45.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:45 smithi155 ceph-mon[97606]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2022-09-07T19:37:45.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:45 smithi155 ceph-mon[97606]: osdmap e26: 4 total, 4 up, 4 in 2022-09-07T19:37:46.216 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-09-07T19:37:46.216 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-09-07T19:37:46.216 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2022-09-07T19:37:46.217 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2022-09-07T19:37:46.217 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0154291 s, 680 MB/s 2022-09-07T19:37:46.217 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2022-09-07T19:37:46.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2022-09-07T19:37:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:37:47.533 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:47 smithi154 ceph-mon[96967]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:37:47.534 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:47 smithi154 ceph-mon[96967]: osdmap e27: 4 total, 4 up, 4 in 2022-09-07T19:37:47.578 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:47 smithi155 ceph-mon[97606]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:37:47.579 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:47 smithi155 ceph-mon[97606]: osdmap e27: 4 total, 4 up, 4 in 2022-09-07T19:37:47.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:47 smithi080 ceph-mon[90124]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:37:47.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:47 smithi080 ceph-mon[90124]: osdmap e27: 4 total, 4 up, 4 in 2022-09-07T19:37:48.395 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.389+0000 7f15d09aa700 1 -- 172.21.15.154:0/3902134037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0ffa10 msgr2=0x7f15cc106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:48.395 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.389+0000 7f15d09aa700 1 --2- 172.21.15.154:0/3902134037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0ffa10 0x7f15cc106340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009bb0 tx=0x7f15c4009ec0 comp rx=0 tx=0).stop 2022-09-07T19:37:48.396 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 -- 172.21.15.154:0/3902134037 shutdown_connections 2022-09-07T19:37:48.396 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 --2- 172.21.15.154:0/3902134037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0ffa10 0x7f15cc106340 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:48.396 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 --2- 172.21.15.154:0/3902134037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15cc0fde80 0x7f15cc0fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:48.397 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 --2- 172.21.15.154:0/3902134037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15cc0ff060 0x7f15cc0ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:48.397 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 -- 172.21.15.154:0/3902134037 >> 172.21.15.154:0/3902134037 conn(0x7f15cc0f9570 msgr2=0x7f15cc0fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:37:48.397 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 -- 172.21.15.154:0/3902134037 shutdown_connections 2022-09-07T19:37:48.397 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 -- 172.21.15.154:0/3902134037 wait complete. 2022-09-07T19:37:48.398 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 Processor -- start 2022-09-07T19:37:48.398 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.390+0000 7f15d09aa700 1 -- start start 2022-09-07T19:37:48.398 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 0x7f15cc193a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:48.399 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15cc0ff060 0x7f15cc193fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:48.399 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15cc0ffa10 0x7f15cc19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:48.399 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc19b5e0 con 0x7f15cc0ff060 2022-09-07T19:37:48.400 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc19b750 con 0x7f15cc0fde80 2022-09-07T19:37:48.400 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc19b910 con 0x7f15cc0ffa10 2022-09-07T19:37:48.400 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 0x7f15cc193a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:48.401 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 0x7f15cc193a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41744/0 (socket says 172.21.15.154:41744) 2022-09-07T19:37:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 -- 172.21.15.154:0/2643011492 learned_addr learned my addr 172.21.15.154:0/2643011492 (peer_addr_for_me v2:172.21.15.154:0/0) 2022-09-07T19:37:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 -- 172.21.15.154:0/2643011492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15cc0ffa10 msgr2=0x7f15cc19b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15c9d9b700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15cc0ff060 0x7f15cc193fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15cc0ffa10 0x7f15cc19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 -- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15cc0ff060 msgr2=0x7f15cc193fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:37:48.404 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15cc0ff060 0x7f15cc193fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:37:48.404 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 -- 172.21.15.154:0/2643011492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40097e0 con 0x7f15cc0fde80 2022-09-07T19:37:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15ca59c700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 0x7f15cc193a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b3c0 tx=0x7f15c000b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:37:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011830 con 0x7f15cc0fde80 2022-09-07T19:37:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc19bbf0 con 0x7f15cc0fde80 2022-09-07T19:37:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f15c0011e30 con 0x7f15cc0fde80 2022-09-07T19:37:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c000f2e0 con 0x7f15cc0fde80 2022-09-07T19:37:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.391+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc19c100 con 0x7f15cc0fde80 2022-09-07T19:37:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.392+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc109680 con 0x7f15cc0fde80 2022-09-07T19:37:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.393+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f15c0021070 con 0x7f15cc0fde80 2022-09-07T19:37:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.394+0000 7f15bb7fe700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f15b4099010 0x7f15b409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:37:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.394+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3665+0+0 (secure 0 0 0) 0x7f15c00c0b70 con 0x7f15cc0fde80 2022-09-07T19:37:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.394+0000 7f15c9d9b700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f15b4099010 0x7f15b409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:37:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.395+0000 7f15c9d9b700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f15b4099010 0x7f15b409b4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00a730 tx=0x7f15bc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:37:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.398+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f15c008e4d0 con 0x7f15cc0fde80 2022-09-07T19:37:48.587 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:37:48.587+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f15cc05fbe0 con 0x7f15b4099010 2022-09-07T19:37:48.619 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: osdmap e28: 4 total, 4 up, 4 in 2022-09-07T19:37:48.619 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi080 2022-09-07T19:37:48.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:48.621 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:48.621 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi080 to 8635M 2022-09-07T19:37:48.621 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.621 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: osdmap e28: 4 total, 4 up, 4 in 2022-09-07T19:37:48.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi080 2022-09-07T19:37:48.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:48.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:48.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi080 to 8635M 2022-09-07T19:37:48.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: osdmap e28: 4 total, 4 up, 4 in 2022-09-07T19:37:48.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi080 2022-09-07T19:37:48.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:48.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:37:48.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi080 to 8635M 2022-09-07T19:37:48.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:48.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:37:49.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:49 smithi080 ceph-mon[90124]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:37:49.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:49 smithi080 ceph-mon[90124]: osdmap e29: 4 total, 4 up, 4 in 2022-09-07T19:37:49.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:37:49.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:37:49.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:49 smithi154 ceph-mon[96967]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:37:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:49 smithi154 ceph-mon[96967]: osdmap e29: 4 total, 4 up, 4 in 2022-09-07T19:37:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:37:49.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:37:49.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:49.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:49 smithi155 ceph-mon[97606]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:37:49.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:49 smithi155 ceph-mon[97606]: osdmap e29: 4 total, 4 up, 4 in 2022-09-07T19:37:49.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:37:49.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:37:49.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:50.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:50 smithi080 ceph-mon[90124]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:37:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:50 smithi154 ceph-mon[96967]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:37:50.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:50 smithi155 ceph-mon[97606]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:37:51.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:51 smithi080 ceph-mon[90124]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2022-09-07T19:37:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:51 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/743569561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]: dispatch 2022-09-07T19:37:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:51 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]: dispatch 2022-09-07T19:37:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:51 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]': finished 2022-09-07T19:37:51.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:51 smithi080 ceph-mon[90124]: osdmap e30: 5 total, 4 up, 5 in 2022-09-07T19:37:51.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:37:51.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:51 smithi154 ceph-mon[96967]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2022-09-07T19:37:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:51 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/743569561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]: dispatch 2022-09-07T19:37:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:51 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]: dispatch 2022-09-07T19:37:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:51 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]': finished 2022-09-07T19:37:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:51 smithi154 ceph-mon[96967]: osdmap e30: 5 total, 4 up, 5 in 2022-09-07T19:37:51.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:37:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:51 smithi155 ceph-mon[97606]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2022-09-07T19:37:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:51 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/743569561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]: dispatch 2022-09-07T19:37:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:51 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]: dispatch 2022-09-07T19:37:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:51 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6"}]': finished 2022-09-07T19:37:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:51 smithi155 ceph-mon[97606]: osdmap e30: 5 total, 4 up, 5 in 2022-09-07T19:37:51.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:37:52.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:52 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/2095223594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:37:52.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:52 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/2095223594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:37:52.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:52 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/2095223594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:37:53.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:53 smithi080 ceph-mon[90124]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2022-09-07T19:37:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:53 smithi154 ceph-mon[96967]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2022-09-07T19:37:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:53 smithi155 ceph-mon[97606]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2022-09-07T19:37:55.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:55 smithi080 ceph-mon[90124]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2022-09-07T19:37:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:55 smithi154 ceph-mon[96967]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2022-09-07T19:37:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:55 smithi155 ceph-mon[97606]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2022-09-07T19:37:57.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:57 smithi080 ceph-mon[90124]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2022-09-07T19:37:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:57 smithi154 ceph-mon[96967]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2022-09-07T19:37:57.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:57 smithi155 ceph-mon[97606]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2022-09-07T19:37:58.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-09-07T19:37:58.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:58.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-09-07T19:37:58.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-09-07T19:37:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:37:59.548 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:59 smithi154 ceph-mon[96967]: Deploying daemon osd.4 on smithi154 2022-09-07T19:37:59.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:37:59 smithi154 ceph-mon[96967]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2022-09-07T19:37:59.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:59 smithi080 ceph-mon[90124]: Deploying daemon osd.4 on smithi154 2022-09-07T19:37:59.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:37:59 smithi080 ceph-mon[90124]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2022-09-07T19:37:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:59 smithi155 ceph-mon[97606]: Deploying daemon osd.4 on smithi154 2022-09-07T19:37:59.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:37:59 smithi155 ceph-mon[97606]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2022-09-07T19:38:01.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:01 smithi080 ceph-mon[90124]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:01 smithi154 ceph-mon[96967]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:01 smithi155 ceph-mon[97606]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:03.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:03 smithi080 ceph-mon[90124]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:03.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:03 smithi154 ceph-mon[96967]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:03 smithi155 ceph-mon[97606]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:04.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:04 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:04.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:04 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:04.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:04 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:04.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:04 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:04.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:04 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:04.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:04 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:04.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:04 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:04.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:04 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:04.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:04 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:04.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:04 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:04.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:05.514 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:05 smithi154 ceph-mon[96967]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:05 smithi155 ceph-mon[97606]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:05.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:05 smithi080 ceph-mon[90124]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:06.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:06.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:06.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:06.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:06 smithi155 ceph-mon[97606]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:07.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:07.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:07.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:07.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:06 smithi080 ceph-mon[90124]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:07.122 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:07.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:07.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:07.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:06 smithi154 ceph-mon[96967]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:07.695 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.696+0000 7f15bb7fe700 1 -- 172.21.15.154:0/2643011492 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f15cc05fbe0 con 0x7f15b4099010 2022-09-07T19:38:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 4 on host 'smithi154' 2022-09-07T19:38:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f15b4099010 msgr2=0x7f15b409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:07.699 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f15b4099010 0x7f15b409b4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00a730 tx=0x7f15bc008040 comp rx=0 tx=0).stop 2022-09-07T19:38:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 msgr2=0x7f15cc193a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 0x7f15cc193a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b3c0 tx=0x7f15c000b780 comp rx=0 tx=0).stop 2022-09-07T19:38:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 shutdown_connections 2022-09-07T19:38:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f15b4099010 0x7f15b409b4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15cc0ffa10 0x7f15cc19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15cc0fde80 0x7f15cc193a60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 --2- 172.21.15.154:0/2643011492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15cc0ff060 0x7f15cc193fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 >> 172.21.15.154:0/2643011492 conn(0x7f15cc0f9570 msgr2=0x7f15cc0fb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:38:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 shutdown_connections 2022-09-07T19:38:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:38:07.698+0000 7f15d09aa700 1 -- 172.21.15.154:0/2643011492 wait complete. 2022-09-07T19:38:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:07 smithi154 ceph-mon[96967]: from='osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-09-07T19:38:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:07 smithi154 ceph-mon[96967]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-09-07T19:38:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:07 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:08.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:07 smithi080 ceph-mon[90124]: from='osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-09-07T19:38:08.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:07 smithi080 ceph-mon[90124]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-09-07T19:38:08.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:07 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:08.178 DEBUG:teuthology.orchestra.run.smithi154:osd.4> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.4.service 2022-09-07T19:38:08.182 INFO:tasks.cephadm:Deploying osd.5 on smithi155 with /dev/vg_nvme/lv_3... 2022-09-07T19:38:08.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-09-07T19:38:08.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:07 smithi155 ceph-mon[97606]: from='osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-09-07T19:38:08.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:07 smithi155 ceph-mon[97606]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-09-07T19:38:08.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:07 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:08.211 INFO:journalctl@ceph.osd.4.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:38:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:38:08.921 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-4[107966]: 2022-09-07T19:38:08.711+0000 7f545735c700 -1 osd.4 0 waiting for initial osdmap 2022-09-07T19:38:08.922 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-4[107966]: 2022-09-07T19:38:08.719+0000 7f5453952700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:38:08.922 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:08.922 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-09-07T19:38:08.923 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: osdmap e31: 5 total, 4 up, 5 in 2022-09-07T19:38:08.923 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:08.923 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:38:08.923 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:38:08.924 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:08.924 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:08.924 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:08.924 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:08 smithi154 ceph-mon[96967]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:08.981 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:08.981 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-09-07T19:38:08.982 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: osdmap e31: 5 total, 4 up, 5 in 2022-09-07T19:38:08.982 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:08.982 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:38:08.983 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:38:08.983 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:08.983 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:08.983 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:08.983 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:08 smithi155 ceph-mon[97606]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:09.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:09.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-09-07T19:38:09.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: osdmap e31: 5 total, 4 up, 5 in 2022-09-07T19:38:09.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:09.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:38:09.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:38:09.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:09.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:09.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:09.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:08 smithi080 ceph-mon[90124]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:09.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:09 smithi155 ceph-mon[97606]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:38:09.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:09 smithi155 ceph-mon[97606]: osdmap e32: 5 total, 4 up, 5 in 2022-09-07T19:38:09.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:09.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:09 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.003 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:09 smithi154 ceph-mon[96967]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:38:10.004 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:09 smithi154 ceph-mon[96967]: osdmap e32: 5 total, 4 up, 5 in 2022-09-07T19:38:10.004 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.005 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:09 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:09 smithi080 ceph-mon[90124]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:38:10.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:09 smithi080 ceph-mon[90124]: osdmap e32: 5 total, 4 up, 5 in 2022-09-07T19:38:10.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:09 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.168 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-09-07T19:38:10.168 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-09-07T19:38:10.168 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2022-09-07T19:38:10.169 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2022-09-07T19:38:10.169 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110565 s, 948 MB/s 2022-09-07T19:38:10.169 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2022-09-07T19:38:10.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2022-09-07T19:38:10.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:38:10.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:38:10.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] boot 2022-09-07T19:38:10.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: osdmap e33: 5 total, 5 up, 5 in 2022-09-07T19:38:10.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:10.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi154 2022-09-07T19:38:10.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:10.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:10.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi154 to 8584M 2022-09-07T19:38:10.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:38:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:38:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] boot 2022-09-07T19:38:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: osdmap e33: 5 total, 5 up, 5 in 2022-09-07T19:38:10.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:10.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:10.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi154 2022-09-07T19:38:10.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:10.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:10.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi154 to 8584M 2022-09-07T19:38:10.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:10.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:11.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:38:11.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:38:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: osd.4 [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] boot 2022-09-07T19:38:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: osdmap e33: 5 total, 5 up, 5 in 2022-09-07T19:38:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:38:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2022-09-07T19:38:11.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi154 2022-09-07T19:38:11.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:11.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:11.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:11.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:11.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi154 to 8584M 2022-09-07T19:38:11.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:11.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:11.235 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:38:12.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:11 smithi080 ceph-mon[90124]: osdmap e34: 5 total, 5 up, 5 in 2022-09-07T19:38:12.122 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:11 smithi154 ceph-mon[96967]: osdmap e34: 5 total, 5 up, 5 in 2022-09-07T19:38:12.190 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:11 smithi155 ceph-mon[97606]: osdmap e34: 5 total, 5 up, 5 in 2022-09-07T19:38:12.382 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 -- 172.21.15.155:0/4052865471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 msgr2=0x7f41e80ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:12.382 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 --2- 172.21.15.155:0/4052865471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80ff5c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009810 tx=0x7f41d8009b20 comp rx=0 tx=0).stop 2022-09-07T19:38:12.383 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 -- 172.21.15.155:0/4052865471 shutdown_connections 2022-09-07T19:38:12.383 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 --2- 172.21.15.155:0/4052865471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41e80fc110 0x7f41e80fc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:12.383 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 --2- 172.21.15.155:0/4052865471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e80ffb00 0x7f41e81063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:12.383 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 --2- 172.21.15.155:0/4052865471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80ff5c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:12.384 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 -- 172.21.15.155:0/4052865471 >> 172.21.15.155:0/4052865471 conn(0x7f41e80f7c00 msgr2=0x7f41e80fa010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:38:12.384 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 -- 172.21.15.155:0/4052865471 shutdown_connections 2022-09-07T19:38:12.385 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 -- 172.21.15.155:0/4052865471 wait complete. 2022-09-07T19:38:12.385 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.383+0000 7f41ed08e700 1 Processor -- start 2022-09-07T19:38:12.387 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 -- start start 2022-09-07T19:38:12.388 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e80fc110 0x7f41e80feae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:12.388 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80fd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:12.388 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41e80ffb00 0x7f41e80fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:12.388 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80fde60 con 0x7f41e80ffb00 2022-09-07T19:38:12.389 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80fdfd0 con 0x7f41e80fc110 2022-09-07T19:38:12.389 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41ed08e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e819dba0 con 0x7f41e80ff170 2022-09-07T19:38:12.389 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:12.390 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80fd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58920/0 (socket says 172.21.15.155:58920) 2022-09-07T19:38:12.390 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 -- 172.21.15.155:0/3685987218 learned_addr learned my addr 172.21.15.155:0/3685987218 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:38:12.390 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e6d9d700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e80fc110 0x7f41e80feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:12.390 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 -- 172.21.15.155:0/3685987218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e80fc110 msgr2=0x7f41e80feae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:12.391 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e80fc110 0x7f41e80feae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:12.391 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 -- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41e80ffb00 msgr2=0x7f41e80fd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:12.391 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41e80ffb00 0x7f41e80fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:12.391 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 -- 172.21.15.155:0/3685987218 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009470 con 0x7f41e80ff170 2022-09-07T19:38:12.392 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.384+0000 7f41e659c700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80fd120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f41d8006010 tx=0x7f41d800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:38:12.392 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.385+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d801d070 con 0x7f41e80ff170 2022-09-07T19:38:12.392 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.385+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e819de20 con 0x7f41e80ff170 2022-09-07T19:38:12.392 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.385+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f41d8005760 con 0x7f41e80ff170 2022-09-07T19:38:12.392 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.385+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8004760 con 0x7f41e80ff170 2022-09-07T19:38:12.393 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.385+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e819e320 con 0x7f41e80ff170 2022-09-07T19:38:12.393 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.386+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e8109660 con 0x7f41e80ff170 2022-09-07T19:38:12.393 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.386+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f41d8028030 con 0x7f41e80ff170 2022-09-07T19:38:12.393 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.387+0000 7f41cbfff700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41d0099010 0x7f41d009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:12.394 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.387+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4097+0+0 (secure 0 0 0) 0x7f41d80c2130 con 0x7f41e80ff170 2022-09-07T19:38:12.394 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.387+0000 7f41e6d9d700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41d0099010 0x7f41d009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:12.394 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.388+0000 7f41e6d9d700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41d0099010 0x7f41d009b4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41dc006fd0 tx=0x7f41dc009060 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:38:12.395 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.391+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f41d808f8e0 con 0x7f41e80ff170 2022-09-07T19:38:12.581 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:12.582+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f41e805f120 con 0x7f41d0099010 2022-09-07T19:38:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:12 smithi155 ceph-mon[97606]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 27 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:12.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:12 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:38:12.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:12 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:38:12.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:12 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:12 smithi080 ceph-mon[90124]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 27 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:38:13.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:38:13.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:12 smithi154 ceph-mon[96967]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 27 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:12 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:38:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:12 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:38:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:12 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:14.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:13 smithi080 ceph-mon[90124]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:38:14.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:13 smithi154 ceph-mon[96967]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:38:14.156 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:13 smithi155 ceph-mon[97606]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:38:15.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:15 smithi080 ceph-mon[90124]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:15 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/2770540399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]: dispatch 2022-09-07T19:38:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:15 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]: dispatch 2022-09-07T19:38:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:15 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]': finished 2022-09-07T19:38:15.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:15 smithi080 ceph-mon[90124]: osdmap e35: 6 total, 5 up, 6 in 2022-09-07T19:38:15.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:15 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:15 smithi154 ceph-mon[96967]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:15 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/2770540399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]: dispatch 2022-09-07T19:38:15.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:15 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]: dispatch 2022-09-07T19:38:15.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:15 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]': finished 2022-09-07T19:38:15.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:15 smithi154 ceph-mon[96967]: osdmap e35: 6 total, 5 up, 6 in 2022-09-07T19:38:15.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:15 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:15 smithi155 ceph-mon[97606]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:15 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/2770540399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]: dispatch 2022-09-07T19:38:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:15 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]: dispatch 2022-09-07T19:38:15.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:15 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3d50e79-fa11-4704-aed7-278b832cfc05"}]': finished 2022-09-07T19:38:15.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:15 smithi155 ceph-mon[97606]: osdmap e35: 6 total, 5 up, 6 in 2022-09-07T19:38:15.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:16.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:16 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/2717165392' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:38:16.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:16 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/2717165392' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:38:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:16 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/2717165392' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:38:17.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:17 smithi080 ceph-mon[90124]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:17 smithi154 ceph-mon[96967]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:17 smithi155 ceph-mon[97606]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:19.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:19 smithi080 ceph-mon[90124]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:19.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:19 smithi154 ceph-mon[96967]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:19 smithi155 ceph-mon[97606]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:21 smithi080 ceph-mon[90124]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-09-07T19:38:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:21 smithi154 ceph-mon[96967]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-09-07T19:38:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:21 smithi155 ceph-mon[97606]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-09-07T19:38:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:22.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:22 smithi155 ceph-mon[97606]: Deploying daemon osd.5 on smithi155 2022-09-07T19:38:22.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:22 smithi080 ceph-mon[90124]: Deploying daemon osd.5 on smithi155 2022-09-07T19:38:22.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:22 smithi154 ceph-mon[96967]: Deploying daemon osd.5 on smithi155 2022-09-07T19:38:23.592 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:23 smithi155 ceph-mon[97606]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:23.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:23 smithi080 ceph-mon[90124]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:23 smithi154 ceph-mon[96967]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:25 smithi080 ceph-mon[90124]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:25 smithi154 ceph-mon[96967]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:25.627 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:25 smithi155 ceph-mon[97606]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:27 smithi155 ceph-mon[97606]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:27.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:27.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:27.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:27.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:27 smithi080 ceph-mon[90124]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:27.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:27.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:27.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:27.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:27.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:27 smithi154 ceph-mon[96967]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:27.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:27.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:29.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:29 smithi080 ceph-mon[90124]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:29.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:29 smithi154 ceph-mon[96967]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:29 smithi155 ceph-mon[97606]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:29.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:30.459 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.460+0000 7f41cbfff700 1 -- 172.21.15.155:0/3685987218 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f41e805f120 con 0x7f41d0099010 2022-09-07T19:38:30.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 5 on host 'smithi155' 2022-09-07T19:38:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41d0099010 msgr2=0x7f41d009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41d0099010 0x7f41d009b4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41dc006fd0 tx=0x7f41dc009060 comp rx=0 tx=0).stop 2022-09-07T19:38:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 msgr2=0x7f41e80fd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80fd120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f41d8006010 tx=0x7f41d800f690 comp rx=0 tx=0).stop 2022-09-07T19:38:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 shutdown_connections 2022-09-07T19:38:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41e80ffb00 0x7f41e80fd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41d0099010 0x7f41d009b4c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e80fc110 0x7f41e80feae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 --2- 172.21.15.155:0/3685987218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e80ff170 0x7f41e80fd120 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:30.465 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 >> 172.21.15.155:0/3685987218 conn(0x7f41e80f7c00 msgr2=0x7f41e80faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:38:30.465 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 shutdown_connections 2022-09-07T19:38:30.465 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:38:30.462+0000 7f41ed08e700 1 -- 172.21.15.155:0/3685987218 wait complete. 2022-09-07T19:38:31.000 DEBUG:teuthology.orchestra.run.smithi155:osd.5> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.5.service 2022-09-07T19:38:31.004 INFO:tasks.cephadm:Deploying osd.6 on smithi080 with /dev/vg_nvme/lv_2... 2022-09-07T19:38:31.005 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-09-07T19:38:31.032 INFO:journalctl@ceph.osd.5.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:38:31.654 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:31.655 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:31.655 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:31.655 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:31.655 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:31.656 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:31.656 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-09-07T19:38:31.656 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:31 smithi155 ceph-mon[97606]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-09-07T19:38:31.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:31.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:31.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:31.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:31.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:31.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:31.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-09-07T19:38:31.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:31 smithi080 ceph-mon[90124]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-09-07T19:38:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:31.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:31.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:31.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:31.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-09-07T19:38:31.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:31 smithi154 ceph-mon[96967]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-09-07T19:38:31.878 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:38:32.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:32 smithi080 ceph-mon[90124]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-09-07T19:38:32.720 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:32 smithi080 ceph-mon[90124]: osdmap e36: 6 total, 5 up, 6 in 2022-09-07T19:38:32.720 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:32.720 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:32 smithi080 ceph-mon[90124]: from='osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:38:32.720 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:32 smithi080 ceph-mon[90124]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:38:32.754 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-5[109388]: 2022-09-07T19:38:32.469+0000 7f9ff3844700 -1 osd.5 0 waiting for initial osdmap 2022-09-07T19:38:32.755 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-5[109388]: 2022-09-07T19:38:32.476+0000 7f9fede36700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:38:32.755 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-mon[97606]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-09-07T19:38:32.756 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-mon[97606]: osdmap e36: 6 total, 5 up, 6 in 2022-09-07T19:38:32.756 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:32.757 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-mon[97606]: from='osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:38:32.757 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:32 smithi155 ceph-mon[97606]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:38:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:32 smithi154 ceph-mon[96967]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-09-07T19:38:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:32 smithi154 ceph-mon[96967]: osdmap e36: 6 total, 5 up, 6 in 2022-09-07T19:38:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:32.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:32 smithi154 ceph-mon[96967]: from='osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:38:32.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:32 smithi154 ceph-mon[96967]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:38:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:38:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: osdmap e37: 6 total, 5 up, 6 in 2022-09-07T19:38:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:33.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:33.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:38:33.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: osdmap e37: 6 total, 5 up, 6 in 2022-09-07T19:38:33.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:33.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:33.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:33.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:33.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:33.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:38:33.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: osdmap e37: 6 total, 5 up, 6 in 2022-09-07T19:38:33.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:33.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:33.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:33.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:38:33.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:33.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-09-07T19:38:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-09-07T19:38:34.053 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2022-09-07T19:38:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2022-09-07T19:38:34.053 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0445134 s, 236 MB/s 2022-09-07T19:38:34.054 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2022-09-07T19:38:34.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2022-09-07T19:38:34.732 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:38:34.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:38:34.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi155 2022-09-07T19:38:34.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi155 to 8584M 2022-09-07T19:38:34.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] boot 2022-09-07T19:38:34.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: osdmap e38: 6 total, 6 up, 6 in 2022-09-07T19:38:34.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:34.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:34 smithi080 ceph-mon[90124]: osdmap e39: 6 total, 6 up, 6 in 2022-09-07T19:38:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:38:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:38:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi155 2022-09-07T19:38:34.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi155 to 8584M 2022-09-07T19:38:34.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] boot 2022-09-07T19:38:34.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: osdmap e38: 6 total, 6 up, 6 in 2022-09-07T19:38:34.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:34.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:34 smithi154 ceph-mon[96967]: osdmap e39: 6 total, 6 up, 6 in 2022-09-07T19:38:34.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:38:34.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:38:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi155 2022-09-07T19:38:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi155 to 8584M 2022-09-07T19:38:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: osd.5 [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] boot 2022-09-07T19:38:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: osdmap e38: 6 total, 6 up, 6 in 2022-09-07T19:38:34.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:38:34.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:34 smithi155 ceph-mon[97606]: osdmap e39: 6 total, 6 up, 6 in 2022-09-07T19:38:35.519 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:38:35.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:35 smithi080 ceph-mon[90124]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:35.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:35 smithi080 ceph-mon[90124]: osdmap e40: 6 total, 6 up, 6 in 2022-09-07T19:38:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:35 smithi154 ceph-mon[96967]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:35 smithi154 ceph-mon[96967]: osdmap e40: 6 total, 6 up, 6 in 2022-09-07T19:38:35.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:35 smithi155 ceph-mon[97606]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2022-09-07T19:38:35.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:35 smithi155 ceph-mon[97606]: osdmap e40: 6 total, 6 up, 6 in 2022-09-07T19:38:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 -- 172.21.15.80:0/4014984092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180fde80 msgr2=0x7fe4180fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 --2- 172.21.15.80:0/4014984092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180fde80 0x7fe4180fe290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009810 tx=0x7fe40c009b20 comp rx=0 tx=0).stop 2022-09-07T19:38:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 -- 172.21.15.80:0/4014984092 shutdown_connections 2022-09-07T19:38:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 --2- 172.21.15.80:0/4014984092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180fde80 0x7fe4180fe290 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 --2- 172.21.15.80:0/4014984092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4180ffa10 0x7fe418106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 --2- 172.21.15.80:0/4014984092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180ff060 0x7fe4180ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 -- 172.21.15.80:0/4014984092 >> 172.21.15.80:0/4014984092 conn(0x7fe4180f9550 msgr2=0x7fe4180fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:38:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 -- 172.21.15.80:0/4014984092 shutdown_connections 2022-09-07T19:38:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.054+0000 7fe41eb19700 1 -- 172.21.15.80:0/4014984092 wait complete. 2022-09-07T19:38:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.055+0000 7fe41eb19700 1 Processor -- start 2022-09-07T19:38:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 -- start start 2022-09-07T19:38:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180fde80 0x7fe418195c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 0x7fe4181961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4180ffa10 0x7fe41819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41819d840 con 0x7fe4180ff060 2022-09-07T19:38:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41819d9b0 con 0x7fe4180ffa10 2022-09-07T19:38:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41eb19700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41819db70 con 0x7fe4180fde80 2022-09-07T19:38:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe417fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 0x7fe4181961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe417fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 0x7fe4181961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55728/0 (socket says 172.21.15.80:55728) 2022-09-07T19:38:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe417fff700 1 -- 172.21.15.80:0/2478959942 learned_addr learned my addr 172.21.15.80:0/2478959942 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:38:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41c8b5700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180fde80 0x7fe418195c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.056+0000 7fe41d0b6700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4180ffa10 0x7fe41819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe417fff700 1 -- 172.21.15.80:0/2478959942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180fde80 msgr2=0x7fe418195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe417fff700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180fde80 0x7fe418195c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe417fff700 1 -- 172.21.15.80:0/2478959942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4180ffa10 msgr2=0x7fe41819d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:38:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe417fff700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4180ffa10 0x7fe41819d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:38:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe417fff700 1 -- 172.21.15.80:0/2478959942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410009730 con 0x7fe4180ff060 2022-09-07T19:38:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe417fff700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 0x7fe4181961c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e740 tx=0x7fe40400ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:38:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404005220 con 0x7fe4180ff060 2022-09-07T19:38:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c009470 con 0x7fe4180ff060 2022-09-07T19:38:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fe404005380 con 0x7fe4180ff060 2022-09-07T19:38:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.057+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404010ba0 con 0x7fe4180ff060 2022-09-07T19:38:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.058+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41819e1d0 con 0x7fe4180ff060 2022-09-07T19:38:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.059+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418109630 con 0x7fe4180ff060 2022-09-07T19:38:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.062+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fe40401e020 con 0x7fe4180ff060 2022-09-07T19:38:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.063+0000 7fe415ffb700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe408099010 0x7fe40809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:38:37.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.063+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4529+0+0 (secure 0 0 0) 0x7fe404014070 con 0x7fe4180ff060 2022-09-07T19:38:37.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.064+0000 7fe41c8b5700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe408099010 0x7fe40809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:38:37.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.064+0000 7fe41c8b5700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe408099010 0x7fe40809b4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00f4d0 tx=0x7fe40c009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:38:37.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.066+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fe40408f380 con 0x7fe4180ff060 2022-09-07T19:38:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:38:37.291+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe418105a80 con 0x7fe408099010 2022-09-07T19:38:37.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:37 smithi080 ceph-mon[90124]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:37.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:37 smithi080 ceph-mon[90124]: osdmap e41: 6 total, 6 up, 6 in 2022-09-07T19:38:37.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:38:37.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:38:37.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:37 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:37 smithi154 ceph-mon[96967]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:37 smithi154 ceph-mon[96967]: osdmap e41: 6 total, 6 up, 6 in 2022-09-07T19:38:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:38:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:38:37.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:37 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:37.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:37 smithi155 ceph-mon[97606]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:37 smithi155 ceph-mon[97606]: osdmap e41: 6 total, 6 up, 6 in 2022-09-07T19:38:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:38:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:38:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:37 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:38.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:38 smithi080 ceph-mon[90124]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:38:38.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:38 smithi080 ceph-mon[90124]: osdmap e42: 6 total, 6 up, 6 in 2022-09-07T19:38:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:38 smithi154 ceph-mon[96967]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:38:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:38 smithi154 ceph-mon[96967]: osdmap e42: 6 total, 6 up, 6 in 2022-09-07T19:38:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:38 smithi155 ceph-mon[97606]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:38:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:38 smithi155 ceph-mon[97606]: osdmap e42: 6 total, 6 up, 6 in 2022-09-07T19:38:39.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:39 smithi080 ceph-mon[90124]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:39.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:39 smithi154 ceph-mon[96967]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:39.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:39 smithi155 ceph-mon[97606]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:41 smithi080 ceph-mon[90124]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2022-09-07T19:38:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:41 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3068831496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f293a0d2-be68-4495-8419-9fb71666554c"}]: dispatch 2022-09-07T19:38:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:41 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3068831496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f293a0d2-be68-4495-8419-9fb71666554c"}]': finished 2022-09-07T19:38:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:41 smithi080 ceph-mon[90124]: osdmap e43: 7 total, 6 up, 7 in 2022-09-07T19:38:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:38:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:41 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3286838866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:38:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:41 smithi154 ceph-mon[96967]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2022-09-07T19:38:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:41 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3068831496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f293a0d2-be68-4495-8419-9fb71666554c"}]: dispatch 2022-09-07T19:38:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:41 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3068831496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f293a0d2-be68-4495-8419-9fb71666554c"}]': finished 2022-09-07T19:38:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:41 smithi154 ceph-mon[96967]: osdmap e43: 7 total, 6 up, 7 in 2022-09-07T19:38:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:38:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:41 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3286838866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:38:41.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:41 smithi155 ceph-mon[97606]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2022-09-07T19:38:41.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:41 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3068831496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f293a0d2-be68-4495-8419-9fb71666554c"}]: dispatch 2022-09-07T19:38:41.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:41 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3068831496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f293a0d2-be68-4495-8419-9fb71666554c"}]': finished 2022-09-07T19:38:41.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:41 smithi155 ceph-mon[97606]: osdmap e43: 7 total, 6 up, 7 in 2022-09-07T19:38:41.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:38:41.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:41 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3286838866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:38:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:38:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:38:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:38:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:38:42.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:38:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:38:43.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:43 smithi080 ceph-mon[90124]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2022-09-07T19:38:43.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:43 smithi154 ceph-mon[96967]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2022-09-07T19:38:43.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:43 smithi155 ceph-mon[97606]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2022-09-07T19:38:45.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:45 smithi080 ceph-mon[90124]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2022-09-07T19:38:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:45 smithi154 ceph-mon[96967]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2022-09-07T19:38:45.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:45 smithi155 ceph-mon[97606]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2022-09-07T19:38:47.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:47 smithi080 ceph-mon[90124]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2022-09-07T19:38:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:47 smithi154 ceph-mon[96967]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2022-09-07T19:38:47.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:47 smithi155 ceph-mon[97606]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2022-09-07T19:38:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:49 smithi080 ceph-mon[90124]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2022-09-07T19:38:49.901 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-09-07T19:38:49.902 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:49.903 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:49 smithi154 ceph-mon[96967]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2022-09-07T19:38:49.903 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-09-07T19:38:49.903 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:49 smithi155 ceph-mon[97606]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2022-09-07T19:38:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-09-07T19:38:49.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:50.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:50 smithi080 ceph-mon[90124]: Deploying daemon osd.6 on smithi080 2022-09-07T19:38:50.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:50 smithi154 ceph-mon[96967]: Deploying daemon osd.6 on smithi080 2022-09-07T19:38:50.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:50 smithi155 ceph-mon[97606]: Deploying daemon osd.6 on smithi080 2022-09-07T19:38:51.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:51 smithi080 ceph-mon[90124]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:51 smithi154 ceph-mon[96967]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:51.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:51 smithi155 ceph-mon[97606]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:53.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:53 smithi080 ceph-mon[90124]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:53 smithi154 ceph-mon[96967]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:53.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:53 smithi155 ceph-mon[97606]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:55.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:55 smithi080 ceph-mon[90124]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:55 smithi154 ceph-mon[96967]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:55.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:55 smithi155 ceph-mon[97606]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:57.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:57 smithi080 ceph-mon[90124]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:57.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:57 smithi154 ceph-mon[96967]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:57.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:57 smithi155 ceph-mon[97606]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:59.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:59 smithi080 ceph-mon[90124]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:59.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:59.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:59.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:59.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:59.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:38:59 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:59 smithi154 ceph-mon[96967]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:59.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:59.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:38:59 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:38:59.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:59 smithi155 ceph-mon[97606]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:38:59.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:59.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:38:59.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:38:59.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:38:59.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:38:59 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:01.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:01 smithi080 ceph-mon[90124]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:01 smithi154 ceph-mon[96967]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:01.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:01 smithi155 ceph-mon[97606]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:03.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:03 smithi080 ceph-mon[90124]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:03.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:03 smithi080 ceph-mon[90124]: from='osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-09-07T19:39:03.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:03 smithi080 ceph-mon[90124]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-09-07T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:03 smithi154 ceph-mon[96967]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:03 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:03 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:03 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:03 smithi154 ceph-mon[96967]: from='osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-09-07T19:39:03.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:03 smithi154 ceph-mon[96967]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-09-07T19:39:03.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:03 smithi155 ceph-mon[97606]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:03.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:03 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:03 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:03 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:03.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:03 smithi155 ceph-mon[97606]: from='osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-09-07T19:39:03.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:03 smithi155 ceph-mon[97606]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-09-07T19:39:04.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:04 smithi080 ceph-mon[90124]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-09-07T19:39:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:04 smithi080 ceph-mon[90124]: osdmap e44: 7 total, 6 up, 7 in 2022-09-07T19:39:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:04 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:04.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:04 smithi080 ceph-mon[90124]: from='osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:39:04.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:04 smithi080 ceph-mon[90124]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:39:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:04 smithi154 ceph-mon[96967]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-09-07T19:39:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:04 smithi154 ceph-mon[96967]: osdmap e44: 7 total, 6 up, 7 in 2022-09-07T19:39:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:04 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:04 smithi154 ceph-mon[96967]: from='osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:39:04.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:04 smithi154 ceph-mon[96967]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:39:04.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:04 smithi155 ceph-mon[97606]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-09-07T19:39:04.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:04 smithi155 ceph-mon[97606]: osdmap e44: 7 total, 6 up, 7 in 2022-09-07T19:39:04.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:04 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:04.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:04 smithi155 ceph-mon[97606]: from='osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:39:04.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:04 smithi155 ceph-mon[97606]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:39:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:05 smithi080 ceph-mon[90124]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:05.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:05 smithi080 ceph-mon[90124]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:39:05.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:05 smithi080 ceph-mon[90124]: osdmap e45: 7 total, 6 up, 7 in 2022-09-07T19:39:05.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:05.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:05.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:05 smithi154 ceph-mon[96967]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:05.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:05 smithi154 ceph-mon[96967]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:39:05.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:05 smithi154 ceph-mon[96967]: osdmap e45: 7 total, 6 up, 7 in 2022-09-07T19:39:05.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:05.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:05.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:05 smithi155 ceph-mon[97606]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:05.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:05 smithi155 ceph-mon[97606]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:39:05.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:05 smithi155 ceph-mon[97606]: osdmap e45: 7 total, 6 up, 7 in 2022-09-07T19:39:05.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:05.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:06.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.121+0000 7fe415ffb700 1 -- 172.21.15.80:0/2478959942 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe418105a80 con 0x7fe408099010 2022-09-07T19:39:06.122 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 6 on host 'smithi080' 2022-09-07T19:39:06.124 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.124+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe408099010 msgr2=0x7fe40809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:06.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.124+0000 7fe41eb19700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe408099010 0x7fe40809b4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00f4d0 tx=0x7fe40c009eb0 comp rx=0 tx=0).stop 2022-09-07T19:39:06.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.124+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 msgr2=0x7fe4181961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:06.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.124+0000 7fe41eb19700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 0x7fe4181961c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e740 tx=0x7fe40400ea50 comp rx=0 tx=0).stop 2022-09-07T19:39:06.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 shutdown_connections 2022-09-07T19:39:06.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe408099010 0x7fe40809b4c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:06.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4180ffa10 0x7fe41819d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:06.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180fde80 0x7fe418195c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:06.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 --2- 172.21.15.80:0/2478959942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4180ff060 0x7fe4181961c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:06.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 >> 172.21.15.80:0/2478959942 conn(0x7fe4180f9550 msgr2=0x7fe4180fb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:39:06.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 shutdown_connections 2022-09-07T19:39:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:06.125+0000 7fe41eb19700 1 -- 172.21.15.80:0/2478959942 wait complete. 2022-09-07T19:39:06.654 DEBUG:teuthology.orchestra.run.smithi080:osd.6> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.6.service 2022-09-07T19:39:06.659 INFO:tasks.cephadm:Deploying osd.7 on smithi154 with /dev/vg_nvme/lv_2... 2022-09-07T19:39:06.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-09-07T19:39:06.749 INFO:journalctl@ceph.osd.6.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:39:06.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:39:06.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:39:06.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] boot 2022-09-07T19:39:06.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: osdmap e46: 7 total, 7 up, 7 in 2022-09-07T19:39:06.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:06.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:06.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:06.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:06.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:06.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:06.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:39:06.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:39:06.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] boot 2022-09-07T19:39:06.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: osdmap e46: 7 total, 7 up, 7 in 2022-09-07T19:39:06.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:06.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:06.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:06.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:06.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:06.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:06.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:39:06.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:39:06.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: osd.6 [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] boot 2022-09-07T19:39:06.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: osdmap e46: 7 total, 7 up, 7 in 2022-09-07T19:39:06.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:39:06.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:06.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:06.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:06.951 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:06.951 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:07.256 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:39:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:07 smithi154 ceph-mon[96967]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:07 smithi154 ceph-mon[96967]: osdmap e47: 7 total, 7 up, 7 in 2022-09-07T19:39:07.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:07 smithi080 ceph-mon[90124]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:07.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:07 smithi080 ceph-mon[90124]: osdmap e47: 7 total, 7 up, 7 in 2022-09-07T19:39:07.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:07 smithi155 ceph-mon[97606]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2022-09-07T19:39:07.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:07 smithi155 ceph-mon[97606]: osdmap e47: 7 total, 7 up, 7 in 2022-09-07T19:39:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-09-07T19:39:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-09-07T19:39:08.757 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2022-09-07T19:39:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2022-09-07T19:39:08.757 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110712 s, 947 MB/s 2022-09-07T19:39:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2022-09-07T19:39:09.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2022-09-07T19:39:09.780 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:39:09.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:09 smithi080 ceph-mon[90124]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:09.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:09 smithi154 ceph-mon[96967]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:09.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:09 smithi155 ceph-mon[97606]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:10.945 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi080 2022-09-07T19:39:10.945 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:10.946 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:10.946 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:10.946 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:10.946 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:10.947 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi080 to 5757M 2022-09-07T19:39:10.947 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:10.947 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:10.947 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:10 smithi154 ceph-mon[96967]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 -- 172.21.15.154:0/119086192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314067370 msgr2=0x7f8314102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 --2- 172.21.15.154:0/119086192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314067370 0x7f8314102e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8310009810 tx=0x7f8310009b20 comp rx=0 tx=0).stop 2022-09-07T19:39:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 -- 172.21.15.154:0/119086192 shutdown_connections 2022-09-07T19:39:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 --2- 172.21.15.154:0/119086192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314105cc0 0x7f83141080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 --2- 172.21.15.154:0/119086192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314067370 0x7f8314102e60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 --2- 172.21.15.154:0/119086192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83141033a0 0x7f8314105780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 -- 172.21.15.154:0/119086192 >> 172.21.15.154:0/119086192 conn(0x7f83140f8430 msgr2=0x7f83140fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:39:11.092 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 -- 172.21.15.154:0/119086192 shutdown_connections 2022-09-07T19:39:11.092 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.085+0000 7f831beeb700 1 -- 172.21.15.154:0/119086192 wait complete. 2022-09-07T19:39:11.092 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 Processor -- start 2022-09-07T19:39:11.093 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 -- start start 2022-09-07T19:39:11.093 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314067370 0x7f8314195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:11.094 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83141033a0 0x7f8314196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:11.094 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 0x7f831419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:11.094 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831419d8f0 con 0x7f8314067370 2022-09-07T19:39:11.095 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831419da60 con 0x7f8314105cc0 2022-09-07T19:39:11.095 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831beeb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831419dc20 con 0x7f83141033a0 2022-09-07T19:39:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 0x7f831419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 0x7f831419d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41864/0 (socket says 172.21.15.154:41864) 2022-09-07T19:39:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 -- 172.21.15.154:0/1448889383 learned_addr learned my addr 172.21.15.154:0/1448889383 (peer_addr_for_me v2:172.21.15.154:0/0) 2022-09-07T19:39:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f8319486700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83141033a0 0x7f8314196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f8319c87700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314067370 0x7f8314195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 -- 172.21.15.154:0/1448889383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83141033a0 msgr2=0x7f8314196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83141033a0 0x7f8314196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 -- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314067370 msgr2=0x7f8314195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314067370 0x7f8314195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 -- 172.21.15.154:0/1448889383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009470 con 0x7f8314105cc0 2022-09-07T19:39:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f8319c87700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314067370 0x7f8314195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-07T19:39:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f831a488700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 0x7f831419d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f830c00b9e0 tx=0x7f830c00bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:39:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.086+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00c930 con 0x7f8314105cc0 2022-09-07T19:39:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.087+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f830c014440 con 0x7f8314105cc0 2022-09-07T19:39:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.087+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831419df00 con 0x7f8314105cc0 2022-09-07T19:39:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.087+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c012580 con 0x7f8314105cc0 2022-09-07T19:39:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.087+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831419e350 con 0x7f8314105cc0 2022-09-07T19:39:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.088+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831410b880 con 0x7f8314105cc0 2022-09-07T19:39:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.088+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f830c01b030 con 0x7f8314105cc0 2022-09-07T19:39:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.089+0000 7f830affd700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8300099010 0x7f830009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:11.101 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.089+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4961+0+0 (secure 0 0 0) 0x7f830c0c0d40 con 0x7f8314105cc0 2022-09-07T19:39:11.101 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.089+0000 7f8319c87700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8300099010 0x7f830009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:11.101 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.090+0000 7f8319c87700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8300099010 0x7f830009b4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8310006010 tx=0x7f8310005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:39:11.102 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.093+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f830c04cc80 con 0x7f8314105cc0 2022-09-07T19:39:11.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi080 2022-09-07T19:39:11.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:11.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:11.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:11.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi080 to 5757M 2022-09-07T19:39:11.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:10 smithi080 ceph-mon[90124]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:11.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi080 2022-09-07T19:39:11.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:11.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:11.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:11.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi080 to 5757M 2022-09-07T19:39:11.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:11.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:10 smithi155 ceph-mon[97606]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 39 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:11.282 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:11.283+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f831405f120 con 0x7f8300099010 2022-09-07T19:39:12.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:11 smithi080 ceph-mon[90124]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:39:12.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:39:12.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:39:12.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:12.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:11 smithi154 ceph-mon[96967]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:39:12.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:39:12.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:39:12.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:12.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:11 smithi155 ceph-mon[97606]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:39:12.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:39:12.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:39:12.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:12 smithi080 ceph-mon[90124]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:12 smithi154 ceph-mon[96967]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:13.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:12 smithi155 ceph-mon[97606]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:14.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:13 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/4211097397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]: dispatch 2022-09-07T19:39:14.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:13 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]: dispatch 2022-09-07T19:39:14.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:13 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]': finished 2022-09-07T19:39:14.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:13 smithi080 ceph-mon[90124]: osdmap e48: 8 total, 7 up, 8 in 2022-09-07T19:39:14.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:14.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:13 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/4211097397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]: dispatch 2022-09-07T19:39:14.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:13 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]: dispatch 2022-09-07T19:39:14.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:13 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]': finished 2022-09-07T19:39:14.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:13 smithi154 ceph-mon[96967]: osdmap e48: 8 total, 7 up, 8 in 2022-09-07T19:39:14.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:14.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:13 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/4211097397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]: dispatch 2022-09-07T19:39:14.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:13 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]: dispatch 2022-09-07T19:39:14.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:13 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "710d71e8-8f3a-432b-a7b4-c2962d0f6d32"}]': finished 2022-09-07T19:39:14.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:13 smithi155 ceph-mon[97606]: osdmap e48: 8 total, 7 up, 8 in 2022-09-07T19:39:14.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:15.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:15 smithi080 ceph-mon[90124]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:15.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:15 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/3871458539' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:39:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:15 smithi154 ceph-mon[96967]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:15 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/3871458539' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:39:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:15 smithi155 ceph-mon[97606]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:15 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/3871458539' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:39:17.610 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:17 smithi154 ceph-mon[96967]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:17.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:17 smithi080 ceph-mon[90124]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:17 smithi155 ceph-mon[97606]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:19.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:19 smithi154 ceph-mon[96967]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:19.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:19 smithi080 ceph-mon[90124]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:19 smithi155 ceph-mon[97606]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:21 smithi080 ceph-mon[90124]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-09-07T19:39:21.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:21 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:21.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:21 smithi080 ceph-mon[90124]: Deploying daemon osd.7 on smithi154 2022-09-07T19:39:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:21 smithi154 ceph-mon[96967]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-09-07T19:39:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:21 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:21 smithi154 ceph-mon[96967]: Deploying daemon osd.7 on smithi154 2022-09-07T19:39:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:21 smithi155 ceph-mon[97606]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-09-07T19:39:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:21 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:21 smithi155 ceph-mon[97606]: Deploying daemon osd.7 on smithi154 2022-09-07T19:39:23.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:23 smithi080 ceph-mon[90124]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:23 smithi154 ceph-mon[96967]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:23 smithi155 ceph-mon[97606]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:25 smithi080 ceph-mon[90124]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:25 smithi154 ceph-mon[96967]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:25 smithi155 ceph-mon[97606]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:27.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:27 smithi154 ceph-mon[96967]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:27.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:27.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:27.341 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:27.341 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:27.342 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:27.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:27 smithi080 ceph-mon[90124]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:27.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:27.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:27.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:27.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:27.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:27.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:27 smithi155 ceph-mon[97606]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:27.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:27.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:27.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:27.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:27.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:29.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:29 smithi080 ceph-mon[90124]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:29.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:29 smithi154 ceph-mon[96967]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:29.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:29 smithi155 ceph-mon[97606]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:29.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:29.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:30.324 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.324+0000 7f830affd700 1 -- 172.21.15.154:0/1448889383 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f831405f120 con 0x7f8300099010 2022-09-07T19:39:30.325 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 7 on host 'smithi154' 2022-09-07T19:39:30.327 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8300099010 msgr2=0x7f830009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:30.327 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8300099010 0x7f830009b4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8310006010 tx=0x7f8310005910 comp rx=0 tx=0).stop 2022-09-07T19:39:30.328 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 msgr2=0x7f831419d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:30.328 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 0x7f831419d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f830c00b9e0 tx=0x7f830c00bcf0 comp rx=0 tx=0).stop 2022-09-07T19:39:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 shutdown_connections 2022-09-07T19:39:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8314067370 0x7f8314195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8300099010 0x7f830009b4c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8314105cc0 0x7f831419d2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 --2- 172.21.15.154:0/1448889383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83141033a0 0x7f8314196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 >> 172.21.15.154:0/1448889383 conn(0x7f83140f8430 msgr2=0x7f8314103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:39:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 shutdown_connections 2022-09-07T19:39:30.332 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:39:30.326+0000 7f831beeb700 1 -- 172.21.15.154:0/1448889383 wait complete. 2022-09-07T19:39:30.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:30 smithi080 ceph-mon[90124]: from='osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-09-07T19:39:30.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:30 smithi080 ceph-mon[90124]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-09-07T19:39:30.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:30 smithi154 ceph-mon[96967]: from='osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-09-07T19:39:30.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:30 smithi154 ceph-mon[96967]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-09-07T19:39:30.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:30 smithi155 ceph-mon[97606]: from='osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-09-07T19:39:30.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:30 smithi155 ceph-mon[97606]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-09-07T19:39:30.755 DEBUG:teuthology.orchestra.run.smithi154:osd.7> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.7.service 2022-09-07T19:39:30.759 INFO:tasks.cephadm:Deploying osd.8 on smithi155 with /dev/vg_nvme/lv_2... 2022-09-07T19:39:30.760 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-09-07T19:39:30.786 INFO:journalctl@ceph.osd.7.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:39:31.359 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:39:31.578 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:31.578 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2022-09-07T19:39:31.579 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: osdmap e49: 8 total, 7 up, 8 in 2022-09-07T19:39:31.579 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:31.579 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:39:31.579 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:39:31.580 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:31.580 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:31.580 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:31.581 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:31.581 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:31 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:31.602 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-7[113739]: 2022-09-07T19:39:31.323+0000 7f6f4f27e700 -1 osd.7 0 waiting for initial osdmap 2022-09-07T19:39:31.603 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-7[113739]: 2022-09-07T19:39:31.333+0000 7f6f4786c700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:39:31.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:31.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2022-09-07T19:39:31.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: osdmap e49: 8 total, 7 up, 8 in 2022-09-07T19:39:31.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:31.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:39:31.605 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:39:31.605 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:31.605 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:31.605 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:31.605 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:31.606 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:31 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:31.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:31.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2022-09-07T19:39:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: osdmap e49: 8 total, 7 up, 8 in 2022-09-07T19:39:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:39:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:39:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:31.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:31 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:32.342 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:32 smithi155 ceph-mon[97606]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:39:32.342 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:32 smithi155 ceph-mon[97606]: osdmap e50: 8 total, 7 up, 8 in 2022-09-07T19:39:32.343 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:32.343 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:32.598 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:32 smithi154 ceph-mon[96967]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:39:32.598 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:32 smithi154 ceph-mon[96967]: osdmap e50: 8 total, 7 up, 8 in 2022-09-07T19:39:32.599 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:32.599 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:32.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:32 smithi080 ceph-mon[90124]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:39:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:32 smithi080 ceph-mon[90124]: osdmap e50: 8 total, 7 up, 8 in 2022-09-07T19:39:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-09-07T19:39:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-09-07T19:39:32.797 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2022-09-07T19:39:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2022-09-07T19:39:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113148 s, 927 MB/s 2022-09-07T19:39:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2022-09-07T19:39:33.184 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2022-09-07T19:39:33.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:39:33.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:39:33.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:33.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:33.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] boot 2022-09-07T19:39:33.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: osdmap e51: 8 total, 8 up, 8 in 2022-09-07T19:39:33.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:33.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:39:33.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:39:33.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:33.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:33.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] boot 2022-09-07T19:39:33.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: osdmap e51: 8 total, 8 up, 8 in 2022-09-07T19:39:33.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:33.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:39:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:39:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2022-09-07T19:39:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: osd.7 [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] boot 2022-09-07T19:39:33.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: osdmap e51: 8 total, 8 up, 8 in 2022-09-07T19:39:33.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:39:33.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:33.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:33.789 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:39:34.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:34 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi154 2022-09-07T19:39:34.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:34 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi154 to 5722M 2022-09-07T19:39:34.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:34 smithi080 ceph-mon[90124]: osdmap e52: 8 total, 8 up, 8 in 2022-09-07T19:39:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:34 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi154 2022-09-07T19:39:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:34 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi154 to 5722M 2022-09-07T19:39:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:34 smithi154 ceph-mon[96967]: osdmap e52: 8 total, 8 up, 8 in 2022-09-07T19:39:34.642 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:34 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi154 2022-09-07T19:39:34.643 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:34 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi154 to 5722M 2022-09-07T19:39:34.643 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:34 smithi155 ceph-mon[97606]: osdmap e52: 8 total, 8 up, 8 in 2022-09-07T19:39:34.827 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.827+0000 7f47adda1700 1 -- 172.21.15.155:0/2042586548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80feed0 msgr2=0x7f47a80ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:34.828 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.827+0000 7f47adda1700 1 --2- 172.21.15.155:0/2042586548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80feed0 0x7f47a80ff320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4794009810 tx=0x7f4794009b20 comp rx=0 tx=0).stop 2022-09-07T19:39:34.828 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- 172.21.15.155:0/2042586548 shutdown_connections 2022-09-07T19:39:34.828 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 --2- 172.21.15.155:0/2042586548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47a80ff860 0x7f47a8106120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 --2- 172.21.15.155:0/2042586548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80fdc50 0x7f47a80fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 --2- 172.21.15.155:0/2042586548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80feed0 0x7f47a80ff320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- 172.21.15.155:0/2042586548 >> 172.21.15.155:0/2042586548 conn(0x7f47a80f9300 msgr2=0x7f47a80fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:39:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- 172.21.15.155:0/2042586548 shutdown_connections 2022-09-07T19:39:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- 172.21.15.155:0/2042586548 wait complete. 2022-09-07T19:39:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 Processor -- start 2022-09-07T19:39:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- start start 2022-09-07T19:39:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80fdc50 0x7f47a8072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80feed0 0x7f47a80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47a80ff860 0x7f47a8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8071e10 con 0x7f47a80ff860 2022-09-07T19:39:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8071f80 con 0x7f47a80feed0 2022-09-07T19:39:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.828+0000 7f47adda1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a819d9a0 con 0x7f47a80fdc50 2022-09-07T19:39:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80feed0 0x7f47a80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80feed0 0x7f47a80710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.155:36874/0 (socket says 172.21.15.155:36874) 2022-09-07T19:39:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47a7fff700 1 -- 172.21.15.155:0/336569702 learned_addr learned my addr 172.21.15.155:0/336569702 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:39:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80fdc50 0x7f47a8072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 -- 172.21.15.155:0/336569702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80feed0 msgr2=0x7f47a80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:34.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80feed0 0x7f47a80710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:34.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 -- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47a80ff860 msgr2=0x7f47a8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:34.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47a80ff860 0x7f47a8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:34.837 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 -- 172.21.15.155:0/336569702 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009470 con 0x7f47a80fdc50 2022-09-07T19:39:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47acd9f700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80fdc50 0x7f47a8072a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f479c00d660 tx=0x7f479c00d970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:39:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c005220 con 0x7f47a80fdc50 2022-09-07T19:39:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f479c005380 con 0x7f47a80fdc50 2022-09-07T19:39:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a819dc80 con 0x7f47a80fdc50 2022-09-07T19:39:34.839 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c010c60 con 0x7f47a80fdc50 2022-09-07T19:39:34.839 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.829+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a819e140 con 0x7f47a80fdc50 2022-09-07T19:39:34.839 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.831+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8109470 con 0x7f47a80fdc50 2022-09-07T19:39:34.839 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.831+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f479c021070 con 0x7f47a80fdc50 2022-09-07T19:39:34.839 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.832+0000 7f47a5ffb700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4798099010 0x7f479809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:34.840 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.832+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5422+0+0 (secure 0 0 0) 0x7f479c0c1220 con 0x7f47a80fdc50 2022-09-07T19:39:34.840 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.833+0000 7f47a7fff700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4798099010 0x7f479809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:34.840 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.833+0000 7f47a7fff700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4798099010 0x7f479809b4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47940059c0 tx=0x7f4794005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:39:34.841 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:34.836+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f479c08e3c0 con 0x7f47a80fdc50 2022-09-07T19:39:35.027 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:35.027+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f47a805fb60 con 0x7f4798099010 2022-09-07T19:39:35.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:35 smithi080 ceph-mon[90124]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:35.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:35 smithi080 ceph-mon[90124]: osdmap e53: 8 total, 8 up, 8 in 2022-09-07T19:39:35.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:35 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:39:35.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:35 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:39:35.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:35 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:35 smithi154 ceph-mon[96967]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:35 smithi154 ceph-mon[96967]: osdmap e53: 8 total, 8 up, 8 in 2022-09-07T19:39:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:35 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:39:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:35 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:39:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:35 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:35 smithi155 ceph-mon[97606]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:35 smithi155 ceph-mon[97606]: osdmap e53: 8 total, 8 up, 8 in 2022-09-07T19:39:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:35 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:39:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:35 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:39:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:35 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:36.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:36 smithi155 ceph-mon[97606]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:39:36.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:36 smithi155 ceph-mon[97606]: osdmap e54: 8 total, 8 up, 8 in 2022-09-07T19:39:36.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:36 smithi080 ceph-mon[90124]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:39:36.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:36 smithi080 ceph-mon[90124]: osdmap e54: 8 total, 8 up, 8 in 2022-09-07T19:39:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:36 smithi154 ceph-mon[96967]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:39:36.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:36 smithi154 ceph-mon[96967]: osdmap e54: 8 total, 8 up, 8 in 2022-09-07T19:39:37.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:37 smithi080 ceph-mon[90124]: pgmap v191: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2022-09-07T19:39:37.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:37 smithi080 ceph-mon[90124]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2022-09-07T19:39:37.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:37 smithi080 ceph-mon[90124]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2022-09-07T19:39:37.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:37 smithi080 ceph-mon[90124]: osdmap e55: 8 total, 8 up, 8 in 2022-09-07T19:39:37.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:37 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/1486793487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]: dispatch 2022-09-07T19:39:37.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:37 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]: dispatch 2022-09-07T19:39:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:37 smithi154 ceph-mon[96967]: pgmap v191: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2022-09-07T19:39:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:37 smithi154 ceph-mon[96967]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2022-09-07T19:39:37.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:37 smithi154 ceph-mon[96967]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2022-09-07T19:39:37.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:37 smithi154 ceph-mon[96967]: osdmap e55: 8 total, 8 up, 8 in 2022-09-07T19:39:37.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:37 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/1486793487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]: dispatch 2022-09-07T19:39:37.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:37 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]: dispatch 2022-09-07T19:39:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:37 smithi155 ceph-mon[97606]: pgmap v191: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2022-09-07T19:39:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:37 smithi155 ceph-mon[97606]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2022-09-07T19:39:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:37 smithi155 ceph-mon[97606]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2022-09-07T19:39:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:37 smithi155 ceph-mon[97606]: osdmap e55: 8 total, 8 up, 8 in 2022-09-07T19:39:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:37 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/1486793487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]: dispatch 2022-09-07T19:39:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:37 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]: dispatch 2022-09-07T19:39:38.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:38 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]': finished 2022-09-07T19:39:38.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:38 smithi155 ceph-mon[97606]: osdmap e56: 9 total, 8 up, 9 in 2022-09-07T19:39:38.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:38 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:38.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:38 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/115605679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:39:38.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:38 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]': finished 2022-09-07T19:39:38.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:38 smithi080 ceph-mon[90124]: osdmap e56: 9 total, 8 up, 9 in 2022-09-07T19:39:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:38 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:38 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/115605679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:39:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:38 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f17b0b5e-b37e-4026-927e-f5172cd5abbe"}]': finished 2022-09-07T19:39:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:38 smithi154 ceph-mon[96967]: osdmap e56: 9 total, 8 up, 9 in 2022-09-07T19:39:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:38 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:38 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/115605679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:39:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:39 smithi155 ceph-mon[97606]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2022-09-07T19:39:39.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:39 smithi080 ceph-mon[90124]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2022-09-07T19:39:39.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:39 smithi154 ceph-mon[96967]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2022-09-07T19:39:40.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:40 smithi155 ceph-mon[97606]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2022-09-07T19:39:40.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:40 smithi155 ceph-mon[97606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2022-09-07T19:39:40.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:40 smithi155 ceph-mon[97606]: Cluster is now healthy 2022-09-07T19:39:40.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:40 smithi080 ceph-mon[90124]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2022-09-07T19:39:40.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:40 smithi080 ceph-mon[90124]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2022-09-07T19:39:40.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:40 smithi080 ceph-mon[90124]: Cluster is now healthy 2022-09-07T19:39:40.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:40 smithi154 ceph-mon[96967]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2022-09-07T19:39:40.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:40 smithi154 ceph-mon[96967]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2022-09-07T19:39:40.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:40 smithi154 ceph-mon[96967]: Cluster is now healthy 2022-09-07T19:39:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:41 smithi155 ceph-mon[97606]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:41 smithi080 ceph-mon[90124]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:41 smithi154 ceph-mon[96967]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:42.661 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:39:42.661 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:39:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:39:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:39:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:39:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:39:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:43 smithi155 ceph-mon[97606]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:43.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:43 smithi080 ceph-mon[90124]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:43 smithi154 ceph-mon[96967]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2022-09-07T19:39:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:44.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2022-09-07T19:39:44.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2022-09-07T19:39:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:45 smithi155 ceph-mon[97606]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:45.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:45 smithi155 ceph-mon[97606]: Deploying daemon osd.8 on smithi155 2022-09-07T19:39:45.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:45 smithi080 ceph-mon[90124]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:45.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:45 smithi080 ceph-mon[90124]: Deploying daemon osd.8 on smithi155 2022-09-07T19:39:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:45 smithi154 ceph-mon[96967]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:45 smithi154 ceph-mon[96967]: Deploying daemon osd.8 on smithi155 2022-09-07T19:39:47.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:47 smithi080 ceph-mon[90124]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:47 smithi154 ceph-mon[96967]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:47.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:47 smithi155 ceph-mon[97606]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:49.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:49 smithi080 ceph-mon[90124]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:49.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:49.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:49 smithi154 ceph-mon[96967]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:49.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:49.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:49.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:49.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:49.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:49.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:49 smithi155 ceph-mon[97606]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:49.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:49.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:51 smithi080 ceph-mon[90124]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:51.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:51 smithi154 ceph-mon[96967]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:51 smithi155 ceph-mon[97606]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:51.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:51.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.008 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.009+0000 7f47a5ffb700 1 -- 172.21.15.155:0/336569702 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f47a805fb60 con 0x7f4798099010 2022-09-07T19:39:53.009 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 8 on host 'smithi155' 2022-09-07T19:39:53.010 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4798099010 msgr2=0x7f479809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:53.010 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4798099010 0x7f479809b4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47940059c0 tx=0x7f4794005910 comp rx=0 tx=0).stop 2022-09-07T19:39:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80fdc50 msgr2=0x7f47a8072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80fdc50 0x7f47a8072a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f479c00d660 tx=0x7f479c00d970 comp rx=0 tx=0).stop 2022-09-07T19:39:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 shutdown_connections 2022-09-07T19:39:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47a80ff860 0x7f47a8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4798099010 0x7f479809b4c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a80fdc50 0x7f47a8072a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 --2- 172.21.15.155:0/336569702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a80feed0 0x7f47a80710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 >> 172.21.15.155:0/336569702 conn(0x7f47a80f9300 msgr2=0x7f47a80fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:39:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 shutdown_connections 2022-09-07T19:39:53.013 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:39:53.011+0000 7f47adda1700 1 -- 172.21.15.155:0/336569702 wait complete. 2022-09-07T19:39:53.356 DEBUG:teuthology.orchestra.run.smithi155:osd.8> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.8.service 2022-09-07T19:39:53.359 INFO:tasks.cephadm:Deploying osd.9 on smithi080 with /dev/vg_nvme/lv_1... 2022-09-07T19:39:53.360 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2022-09-07T19:39:53.387 INFO:journalctl@ceph.osd.8.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:39:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:53.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:53.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2022-09-07T19:39:53.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:53 smithi155 ceph-mon[97606]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2022-09-07T19:39:53.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:53.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:53.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:53.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:53.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2022-09-07T19:39:53.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:53 smithi080 ceph-mon[90124]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2022-09-07T19:39:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:39:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:39:53.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:39:53.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2022-09-07T19:39:53.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:53 smithi154 ceph-mon[96967]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2022-09-07T19:39:54.230 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:39:55.333 INFO:journalctl@ceph.osd.8.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-8[115272]: 2022-09-07T19:39:55.021+0000 7f1f5f3d6700 -1 osd.8 0 waiting for initial osdmap 2022-09-07T19:39:55.334 INFO:journalctl@ceph.osd.8.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-8[115272]: 2022-09-07T19:39:55.032+0000 7f1f599c8700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:39:55.335 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-mon[97606]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:55.335 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-mon[97606]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2022-09-07T19:39:55.336 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-mon[97606]: osdmap e57: 9 total, 8 up, 9 in 2022-09-07T19:39:55.336 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:55.336 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-mon[97606]: from='osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:39:55.337 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:55 smithi155 ceph-mon[97606]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:39:55.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:55 smithi080 ceph-mon[90124]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:55.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:55 smithi080 ceph-mon[90124]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2022-09-07T19:39:55.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:55 smithi080 ceph-mon[90124]: osdmap e57: 9 total, 8 up, 9 in 2022-09-07T19:39:55.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:55.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:55 smithi080 ceph-mon[90124]: from='osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:39:55.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:55 smithi080 ceph-mon[90124]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:39:55.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:55 smithi154 ceph-mon[96967]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:55.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:55 smithi154 ceph-mon[96967]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2022-09-07T19:39:55.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:55 smithi154 ceph-mon[96967]: osdmap e57: 9 total, 8 up, 9 in 2022-09-07T19:39:55.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:55.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:55 smithi154 ceph-mon[96967]: from='osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:39:55.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:55 smithi154 ceph-mon[96967]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:39:56.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:39:56.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: osdmap e58: 9 total, 8 up, 9 in 2022-09-07T19:39:56.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:56.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:56.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi155 2022-09-07T19:39:56.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi155 to 5722M 2022-09-07T19:39:56.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:56 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:39:56.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: osdmap e58: 9 total, 8 up, 9 in 2022-09-07T19:39:56.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:56.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:56.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi155 2022-09-07T19:39:56.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi155 to 5722M 2022-09-07T19:39:56.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:56 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.394 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2022-09-07T19:39:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2022-09-07T19:39:56.395 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2022-09-07T19:39:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2022-09-07T19:39:56.396 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0462694 s, 227 MB/s 2022-09-07T19:39:56.396 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2022-09-07T19:39:56.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:39:56.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: osdmap e58: 9 total, 8 up, 9 in 2022-09-07T19:39:56.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:56.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:56.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi155 2022-09-07T19:39:56.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:39:56.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi155 to 5722M 2022-09-07T19:39:56.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:56 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:39:56.901 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2022-09-07T19:39:57.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:39:57.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:39:57.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:57.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:57.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] boot 2022-09-07T19:39:57.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: osdmap e59: 9 total, 9 up, 9 in 2022-09-07T19:39:57.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:57 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:57.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:39:57.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:39:57.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:57.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:57.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] boot 2022-09-07T19:39:57.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: osdmap e59: 9 total, 9 up, 9 in 2022-09-07T19:39:57.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:57 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:57.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:39:57.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:39:57.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2022-09-07T19:39:57.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:57.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: osd.8 [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] boot 2022-09-07T19:39:57.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: osdmap e59: 9 total, 9 up, 9 in 2022-09-07T19:39:57.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:57 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:39:57.778 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:39:58.364 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:58 smithi080 ceph-mon[90124]: osdmap e60: 9 total, 9 up, 9 in 2022-09-07T19:39:58.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:58 smithi154 ceph-mon[96967]: osdmap e60: 9 total, 9 up, 9 in 2022-09-07T19:39:58.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:58 smithi155 ceph-mon[97606]: osdmap e60: 9 total, 9 up, 9 in 2022-09-07T19:39:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1540001273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600fde20 msgr2=0x7ffb600fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1540001273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600fde20 0x7ffb600fe230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009840 tx=0x7ffb5c009b50 comp rx=0 tx=0).stop 2022-09-07T19:39:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1540001273 shutdown_connections 2022-09-07T19:39:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1540001273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600fde20 0x7ffb600fe230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1540001273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600ffa40 0x7ffb60106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1540001273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb600ff090 0x7ffb600ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:59.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1540001273 >> 172.21.15.80:0/1540001273 conn(0x7ffb600f9580 msgr2=0x7ffb600fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:39:59.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1540001273 shutdown_connections 2022-09-07T19:39:59.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.220+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1540001273 wait complete. 2022-09-07T19:39:59.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.222+0000 7ffb67a4f700 1 Processor -- start 2022-09-07T19:39:59.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.222+0000 7ffb67a4f700 1 -- start start 2022-09-07T19:39:59.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb67a4f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 0x7ffb60072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:59.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb67a4f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb600ff090 0x7ffb600710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:59.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb67a4f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600ffa40 0x7ffb60071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:59.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb67a4f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60071e10 con 0x7ffb600ffa40 2022-09-07T19:39:59.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb67a4f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60071f80 con 0x7ffb600ff090 2022-09-07T19:39:59.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb67a4f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6019db10 con 0x7ffb600fde20 2022-09-07T19:39:59.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 0x7ffb60072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:59.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb64fea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb600ff090 0x7ffb600710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 0x7ffb60072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:41422/0 (socket says 172.21.15.80:41422) 2022-09-07T19:39:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 -- 172.21.15.80:0/1046794813 learned_addr learned my addr 172.21.15.80:0/1046794813 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:39:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb65fec700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600ffa40 0x7ffb60071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 -- 172.21.15.80:0/1046794813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb600ff090 msgr2=0x7ffb600710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb600ff090 0x7ffb600710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 -- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600ffa40 msgr2=0x7ffb60071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:39:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600ffa40 0x7ffb60071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:39:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.223+0000 7ffb657eb700 1 -- 172.21.15.80:0/1046794813 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500093b0 con 0x7ffb600fde20 2022-09-07T19:39:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.224+0000 7ffb657eb700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 0x7ffb60072a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00b590 tx=0x7ffb5c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:39:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.224+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c01d070 con 0x7ffb600fde20 2022-09-07T19:39:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.224+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c009470 con 0x7ffb600fde20 2022-09-07T19:39:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.224+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ffb5c00f780 con 0x7ffb600fde20 2022-09-07T19:39:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.224+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c004870 con 0x7ffb600fde20 2022-09-07T19:39:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.224+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6019e100 con 0x7ffb600fde20 2022-09-07T19:39:59.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.225+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb60109640 con 0x7ffb600fde20 2022-09-07T19:39:59.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.227+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ffb5c028030 con 0x7ffb600fde20 2022-09-07T19:39:59.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.228+0000 7ffb567fc700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb4c099090 0x7ffb4c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:39:59.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.229+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffb5c0c25d0 con 0x7ffb600fde20 2022-09-07T19:39:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.229+0000 7ffb64fea700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb4c099090 0x7ffb4c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:39:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.229+0000 7ffb64fea700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb4c099090 0x7ffb4c09b540 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb600fdbd0 tx=0x7ffb50005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:39:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.231+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ffb5c08f5d0 con 0x7ffb600fde20 2022-09-07T19:39:59.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:59 smithi080 ceph-mon[90124]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:39:59.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:39:59 smithi080 ceph-mon[90124]: osdmap e61: 9 total, 9 up, 9 in 2022-09-07T19:39:59.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:59 smithi154 ceph-mon[96967]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:39:59.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:39:59 smithi154 ceph-mon[96967]: osdmap e61: 9 total, 9 up, 9 in 2022-09-07T19:39:59.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:59 smithi155 ceph-mon[97606]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:39:59.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:39:59 smithi155 ceph-mon[97606]: osdmap e61: 9 total, 9 up, 9 in 2022-09-07T19:39:59.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:39:59.459+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb6005fbd0 con 0x7ffb4c099090 2022-09-07T19:40:00.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:00 smithi080 ceph-mon[90124]: osdmap e62: 9 total, 9 up, 9 in 2022-09-07T19:40:00.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:00 smithi080 ceph-mon[90124]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:00.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:00.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:00.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:00.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:00 smithi080 ceph-mon[90124]: overall HEALTH_OK 2022-09-07T19:40:00.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:00 smithi154 ceph-mon[96967]: osdmap e62: 9 total, 9 up, 9 in 2022-09-07T19:40:00.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:00 smithi154 ceph-mon[96967]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:00.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:00.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:00.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:00.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:00 smithi154 ceph-mon[96967]: overall HEALTH_OK 2022-09-07T19:40:00.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:00 smithi155 ceph-mon[97606]: osdmap e62: 9 total, 9 up, 9 in 2022-09-07T19:40:00.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:00 smithi155 ceph-mon[97606]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:00.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:00.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:00.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:00.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:00 smithi155 ceph-mon[97606]: overall HEALTH_OK 2022-09-07T19:40:01.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:01 smithi080 ceph-mon[90124]: pgmap v211: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2022-09-07T19:40:01.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:01 smithi080 ceph-mon[90124]: osdmap e63: 9 total, 9 up, 9 in 2022-09-07T19:40:01.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:01 smithi154 ceph-mon[96967]: pgmap v211: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2022-09-07T19:40:01.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:01 smithi154 ceph-mon[96967]: osdmap e63: 9 total, 9 up, 9 in 2022-09-07T19:40:01.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:01 smithi155 ceph-mon[97606]: pgmap v211: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2022-09-07T19:40:01.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:01 smithi155 ceph-mon[97606]: osdmap e63: 9 total, 9 up, 9 in 2022-09-07T19:40:03.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:03 smithi080 ceph-mon[90124]: pgmap v213: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2022-09-07T19:40:03.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:03 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2849435189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]: dispatch 2022-09-07T19:40:03.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:03 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]: dispatch 2022-09-07T19:40:03.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:03 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]': finished 2022-09-07T19:40:03.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:03 smithi080 ceph-mon[90124]: osdmap e64: 10 total, 9 up, 10 in 2022-09-07T19:40:03.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:03.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:03 smithi154 ceph-mon[96967]: pgmap v213: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2022-09-07T19:40:03.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:03 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2849435189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]: dispatch 2022-09-07T19:40:03.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:03 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]: dispatch 2022-09-07T19:40:03.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:03 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]': finished 2022-09-07T19:40:03.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:03 smithi154 ceph-mon[96967]: osdmap e64: 10 total, 9 up, 10 in 2022-09-07T19:40:03.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:03 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:03.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:03 smithi155 ceph-mon[97606]: pgmap v213: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2022-09-07T19:40:03.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:03 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2849435189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]: dispatch 2022-09-07T19:40:03.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:03 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]: dispatch 2022-09-07T19:40:03.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:03 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f44e9821-dbca-493a-99c6-4d4439873b53"}]': finished 2022-09-07T19:40:03.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:03 smithi155 ceph-mon[97606]: osdmap e64: 10 total, 9 up, 10 in 2022-09-07T19:40:03.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:03 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:04.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:04 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/632503011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:40:04.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:04 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/632503011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:40:04.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:04 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/632503011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:40:05.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:05 smithi080 ceph-mon[90124]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2022-09-07T19:40:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:05 smithi154 ceph-mon[96967]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2022-09-07T19:40:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:05 smithi155 ceph-mon[97606]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2022-09-07T19:40:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:07 smithi080 ceph-mon[90124]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:07 smithi154 ceph-mon[96967]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:07 smithi155 ceph-mon[97606]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:09 smithi080 ceph-mon[90124]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:09 smithi154 ceph-mon[96967]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:09 smithi155 ceph-mon[97606]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:11.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:11 smithi080 ceph-mon[90124]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:11.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:11 smithi154 ceph-mon[96967]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:11 smithi155 ceph-mon[97606]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:12.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2022-09-07T19:40:12.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:12 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:12.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:12 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2022-09-07T19:40:12.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:12 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:12.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:12 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2022-09-07T19:40:12.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:12 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:13.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:13 smithi080 ceph-mon[90124]: Deploying daemon osd.9 on smithi080 2022-09-07T19:40:13.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:13 smithi080 ceph-mon[90124]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:13 smithi154 ceph-mon[96967]: Deploying daemon osd.9 on smithi080 2022-09-07T19:40:13.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:13 smithi154 ceph-mon[96967]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:13 smithi155 ceph-mon[97606]: Deploying daemon osd.9 on smithi080 2022-09-07T19:40:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:13 smithi155 ceph-mon[97606]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:15.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:15 smithi080 ceph-mon[90124]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:15 smithi154 ceph-mon[96967]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:15 smithi155 ceph-mon[97606]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:17.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:17 smithi080 ceph-mon[90124]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:17 smithi154 ceph-mon[96967]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:17 smithi155 ceph-mon[97606]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:19.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:19 smithi080 ceph-mon[90124]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:19 smithi154 ceph-mon[96967]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:19 smithi155 ceph-mon[97606]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:21.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:21 smithi080 ceph-mon[90124]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:21 smithi154 ceph-mon[96967]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:21 smithi155 ceph-mon[97606]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:22.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:22 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:22.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:22 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:22.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:22 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:22.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:22 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:22.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:22 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:22.778 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:22.778 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:22.779 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:22.779 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:22.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:22 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:22.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:22 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:22.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:22 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:22.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:22 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:22.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:22 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:22.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:22 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:23.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:23 smithi080 ceph-mon[90124]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:23 smithi155 ceph-mon[97606]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:23 smithi154 ceph-mon[96967]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:25 smithi080 ceph-mon[90124]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:25 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:25 smithi154 ceph-mon[96967]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:25 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:25 smithi155 ceph-mon[97606]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:25.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:25.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:25 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:26.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:26 smithi155 ceph-mon[97606]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2022-09-07T19:40:26.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:26 smithi080 ceph-mon[90124]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2022-09-07T19:40:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:26 smithi154 ceph-mon[96967]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2022-09-07T19:40:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:27 smithi155 ceph-mon[97606]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:27 smithi155 ceph-mon[97606]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2022-09-07T19:40:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:27 smithi155 ceph-mon[97606]: osdmap e65: 10 total, 9 up, 10 in 2022-09-07T19:40:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:27.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:27 smithi155 ceph-mon[97606]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:40:27.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:27 smithi080 ceph-mon[90124]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:27.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:27 smithi080 ceph-mon[90124]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2022-09-07T19:40:27.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:27 smithi080 ceph-mon[90124]: osdmap e65: 10 total, 9 up, 10 in 2022-09-07T19:40:27.737 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:27.737 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:27 smithi080 ceph-mon[90124]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:40:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:27 smithi154 ceph-mon[96967]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:27 smithi154 ceph-mon[96967]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2022-09-07T19:40:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:27 smithi154 ceph-mon[96967]: osdmap e65: 10 total, 9 up, 10 in 2022-09-07T19:40:27.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:27.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:27 smithi154 ceph-mon[96967]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2022-09-07T19:40:28.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.223+0000 7ffb567fc700 1 -- 172.21.15.80:0/1046794813 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffb6005fbd0 con 0x7ffb4c099090 2022-09-07T19:40:28.225 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 9 on host 'smithi080' 2022-09-07T19:40:28.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb4c099090 msgr2=0x7ffb4c09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:28.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb4c099090 0x7ffb4c09b540 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb600fdbd0 tx=0x7ffb50005ea0 comp rx=0 tx=0).stop 2022-09-07T19:40:28.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 msgr2=0x7ffb60072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:28.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 0x7ffb60072a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00b590 tx=0x7ffb5c00f690 comp rx=0 tx=0).stop 2022-09-07T19:40:28.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 shutdown_connections 2022-09-07T19:40:28.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb600ffa40 0x7ffb60071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:28.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb4c099090 0x7ffb4c09b540 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:28.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600fde20 0x7ffb60072a90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:28.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 --2- 172.21.15.80:0/1046794813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb600ff090 0x7ffb600710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:28.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.225+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 >> 172.21.15.80:0/1046794813 conn(0x7ffb600f9580 msgr2=0x7ffb600fb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:40:28.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.226+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 shutdown_connections 2022-09-07T19:40:28.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:40:28.226+0000 7ffb67a4f700 1 -- 172.21.15.80:0/1046794813 wait complete. 2022-09-07T19:40:28.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:40:28.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: osdmap e66: 10 total, 9 up, 10 in 2022-09-07T19:40:28.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:28.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:28.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:28.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:28.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:28.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:28.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:28.709 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:40:28.710 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: osdmap e66: 10 total, 9 up, 10 in 2022-09-07T19:40:28.710 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:28.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:28.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:28.712 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:28.712 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:28.713 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:28.713 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:28.716 DEBUG:teuthology.orchestra.run.smithi080:osd.9> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.9.service 2022-09-07T19:40:28.722 INFO:tasks.cephadm:Deploying osd.10 on smithi154 with /dev/vg_nvme/lv_1... 2022-09-07T19:40:28.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2022-09-07T19:40:28.753 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2022-09-07T19:40:28.753 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: osdmap e66: 10 total, 9 up, 10 in 2022-09-07T19:40:28.754 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:28.754 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:28.754 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:28.754 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:28.755 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:28.755 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:28.755 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:28.813 INFO:journalctl@ceph.osd.9.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:40:29.325 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:40:29.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:29 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:40:29.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:29 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:40:29.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:29 smithi080 ceph-mon[90124]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:29.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:29 smithi080 ceph-mon[90124]: osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] boot 2022-09-07T19:40:29.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:29 smithi080 ceph-mon[90124]: osdmap e67: 10 total, 10 up, 10 in 2022-09-07T19:40:29.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:29 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:40:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:29 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:40:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:29 smithi155 ceph-mon[97606]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:29 smithi155 ceph-mon[97606]: osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] boot 2022-09-07T19:40:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:29 smithi155 ceph-mon[97606]: osdmap e67: 10 total, 10 up, 10 in 2022-09-07T19:40:29.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:29.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:29 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:40:29.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:29 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:40:29.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:29 smithi154 ceph-mon[96967]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2022-09-07T19:40:29.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:29 smithi154 ceph-mon[96967]: osd.9 [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] boot 2022-09-07T19:40:29.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:29 smithi154 ceph-mon[96967]: osdmap e67: 10 total, 10 up, 10 in 2022-09-07T19:40:29.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:40:30.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:30 smithi155 ceph-mon[97606]: osdmap e68: 10 total, 10 up, 10 in 2022-09-07T19:40:30.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:30 smithi080 ceph-mon[90124]: osdmap e68: 10 total, 10 up, 10 in 2022-09-07T19:40:30.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:30 smithi154 ceph-mon[96967]: osdmap e68: 10 total, 10 up, 10 in 2022-09-07T19:40:30.960 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_1 2022-09-07T19:40:30.960 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2022-09-07T19:40:30.961 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2022-09-07T19:40:30.961 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2022-09-07T19:40:30.961 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011059 s, 948 MB/s 2022-09-07T19:40:30.961 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2022-09-07T19:40:31.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2022-09-07T19:40:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:31 smithi154 ceph-mon[96967]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 58 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:31 smithi155 ceph-mon[97606]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 58 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:31.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:31 smithi080 ceph-mon[90124]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 58 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.b/config 2022-09-07T19:40:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.365+0000 7fd94270a700 1 -- 172.21.15.154:0/720813951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c0fe960 msgr2=0x7fd93c100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.365+0000 7fd94270a700 1 --2- 172.21.15.154:0/720813951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c0fe960 0x7fd93c100d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009810 tx=0x7fd92c009b20 comp rx=0 tx=0).stop 2022-09-07T19:40:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 -- 172.21.15.154:0/720813951 shutdown_connections 2022-09-07T19:40:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 --2- 172.21.15.154:0/720813951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd93c103ba0 0x7fd93c105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 --2- 172.21.15.154:0/720813951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c0fe960 0x7fd93c100d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 --2- 172.21.15.154:0/720813951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd93c101280 0x7fd93c103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 -- 172.21.15.154:0/720813951 >> 172.21.15.154:0/720813951 conn(0x7fd93c0f8460 msgr2=0x7fd93c0fa870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:40:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 -- 172.21.15.154:0/720813951 shutdown_connections 2022-09-07T19:40:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 -- 172.21.15.154:0/720813951 wait complete. 2022-09-07T19:40:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 Processor -- start 2022-09-07T19:40:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.366+0000 7fd94270a700 1 -- start start 2022-09-07T19:40:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd93c0fe960 0x7fd93c0fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 0x7fd93c0fc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd93c103ba0 0x7fd93c0fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0fd5c0 con 0x7fd93c0fe960 2022-09-07T19:40:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0fd730 con 0x7fd93c101280 2022-09-07T19:40:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c19d9f0 con 0x7fd93c103ba0 2022-09-07T19:40:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 0x7fd93c0fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:40:33.381 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 0x7fd93c0fc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42006/0 (socket says 172.21.15.154:42006) 2022-09-07T19:40:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 -- 172.21.15.154:0/1906067822 learned_addr learned my addr 172.21.15.154:0/1906067822 (peer_addr_for_me v2:172.21.15.154:0/0) 2022-09-07T19:40:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93bfff700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd93c0fe960 0x7fd93c0fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:40:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 -- 172.21.15.154:0/1906067822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd93c103ba0 msgr2=0x7fd93c0fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:33.383 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd93c103ba0 0x7fd93c0fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:33.383 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 -- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd93c0fe960 msgr2=0x7fd93c0fe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:33.383 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd93c0fe960 0x7fd93c0fe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:33.384 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 -- 172.21.15.154:0/1906067822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c009470 con 0x7fd93c101280 2022-09-07T19:40:33.384 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd93b7fe700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 0x7fd93c0fc910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd93000d700 tx=0x7fd93000dac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:40:33.385 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93000f890 con 0x7fd93c101280 2022-09-07T19:40:33.385 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c19dca0 con 0x7fd93c101280 2022-09-07T19:40:33.386 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd93000fe90 con 0x7fd93c101280 2022-09-07T19:40:33.386 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93001a3e0 con 0x7fd93c101280 2022-09-07T19:40:33.387 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.367+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c19e1b0 con 0x7fd93c101280 2022-09-07T19:40:33.387 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.368+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c109590 con 0x7fd93c101280 2022-09-07T19:40:33.387 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.369+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fd930022070 con 0x7fd93c101280 2022-09-07T19:40:33.387 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.370+0000 7fd9397fa700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd924099010 0x7fd92409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:33.387 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.370+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6257+0+0 (secure 0 0 0) 0x7fd930016030 con 0x7fd93c101280 2022-09-07T19:40:33.388 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.370+0000 7fd93bfff700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd924099010 0x7fd92409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:40:33.389 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.371+0000 7fd93bfff700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd924099010 0x7fd92409b4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0059c0 tx=0x7fd92c005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:40:33.389 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.374+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fd93008e830 con 0x7fd93c101280 2022-09-07T19:40:33.565 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:33.566+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd93c05fbb0 con 0x7fd924099010 2022-09-07T19:40:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:33.894 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.894 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.896 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.899 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:33.899 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.900 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.900 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.900 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.901 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.901 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:33.902 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:33.902 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:34.696 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:34 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi080 2022-09-07T19:40:34.696 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:34 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi080 to 4317M 2022-09-07T19:40:34.697 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:34 smithi154 ceph-mon[96967]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:34.697 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:34 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:34.697 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:34 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:34.697 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:34 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:34.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:34 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi080 2022-09-07T19:40:34.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:34 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi080 to 4317M 2022-09-07T19:40:34.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:34 smithi155 ceph-mon[97606]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:34 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:34 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:34 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:34.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:34 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi080 2022-09-07T19:40:34.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:34 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi080 to 4317M 2022-09-07T19:40:34.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:34 smithi080 ceph-mon[90124]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:34.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:34 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:34.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:34 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:34.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:34 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:35 smithi155 ceph-mon[97606]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:35.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:35 smithi080 ceph-mon[90124]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:35 smithi154 ceph-mon[96967]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:36.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:36 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/1711020493' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]: dispatch 2022-09-07T19:40:36.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:36 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]: dispatch 2022-09-07T19:40:36.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:36 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]': finished 2022-09-07T19:40:36.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:36 smithi155 ceph-mon[97606]: osdmap e69: 11 total, 10 up, 11 in 2022-09-07T19:40:36.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:36.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:36 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/1711020493' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]: dispatch 2022-09-07T19:40:36.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:36 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]: dispatch 2022-09-07T19:40:36.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:36 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]': finished 2022-09-07T19:40:36.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:36 smithi080 ceph-mon[90124]: osdmap e69: 11 total, 10 up, 11 in 2022-09-07T19:40:36.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:36 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/1711020493' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]: dispatch 2022-09-07T19:40:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:36 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]: dispatch 2022-09-07T19:40:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:36 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfa508c5-47de-4d2b-acf3-8f4a0776dd98"}]': finished 2022-09-07T19:40:36.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:36 smithi154 ceph-mon[96967]: osdmap e69: 11 total, 10 up, 11 in 2022-09-07T19:40:36.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:37.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:37 smithi080 ceph-mon[90124]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:37.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:37 smithi080 ceph-mon[90124]: from='client.? 172.21.15.154:0/1593947505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:40:37.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:37 smithi154 ceph-mon[96967]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:37 smithi154 ceph-mon[96967]: from='client.? 172.21.15.154:0/1593947505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:40:37.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:37 smithi155 ceph-mon[97606]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:37 smithi155 ceph-mon[97606]: from='client.? 172.21.15.154:0/1593947505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:40:39.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:39 smithi154 ceph-mon[96967]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:39.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:39 smithi080 ceph-mon[90124]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:39.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:39 smithi155 ceph-mon[97606]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:41.563 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:41 smithi154 ceph-mon[96967]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:41 smithi080 ceph-mon[90124]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:41.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:41 smithi155 ceph-mon[97606]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:40:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:40:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:40:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:40:42.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:40:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:40:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:43 smithi154 ceph-mon[96967]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2022-09-07T19:40:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:43.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:43 smithi080 ceph-mon[90124]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:43.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2022-09-07T19:40:43.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:43.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:43 smithi155 ceph-mon[97606]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:43.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2022-09-07T19:40:43.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:44 smithi080 ceph-mon[90124]: Deploying daemon osd.10 on smithi154 2022-09-07T19:40:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:44 smithi154 ceph-mon[96967]: Deploying daemon osd.10 on smithi154 2022-09-07T19:40:44.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:44 smithi155 ceph-mon[97606]: Deploying daemon osd.10 on smithi154 2022-09-07T19:40:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:45 smithi154 ceph-mon[96967]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:45 smithi080 ceph-mon[90124]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:45.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:45 smithi155 ceph-mon[97606]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:47.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:47 smithi080 ceph-mon[90124]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:47 smithi154 ceph-mon[96967]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:47.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:47 smithi155 ceph-mon[97606]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:49.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:49 smithi080 ceph-mon[90124]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:49.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:49 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:49 smithi154 ceph-mon[96967]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:49.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:49.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:49 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:49.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:49 smithi155 ceph-mon[97606]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:49 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:51.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:51 smithi080 ceph-mon[90124]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:51.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:51 smithi154 ceph-mon[96967]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:51 smithi155 ceph-mon[97606]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:51.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:51.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:52.809 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:52 smithi154 ceph-mon[96967]: from='osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2022-09-07T19:40:52.809 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:52 smithi154 ceph-mon[96967]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2022-09-07T19:40:52.811 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.812+0000 7fd9397fa700 1 -- 172.21.15.154:0/1906067822 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd93c05fbb0 con 0x7fd924099010 2022-09-07T19:40:52.811 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 10 on host 'smithi154' 2022-09-07T19:40:52.813 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd924099010 msgr2=0x7fd92409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:52.813 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd924099010 0x7fd92409b4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0059c0 tx=0x7fd92c005910 comp rx=0 tx=0).stop 2022-09-07T19:40:52.813 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 msgr2=0x7fd93c0fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:52.814 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 0x7fd93c0fc910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd93000d700 tx=0x7fd93000dac0 comp rx=0 tx=0).stop 2022-09-07T19:40:52.814 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 shutdown_connections 2022-09-07T19:40:52.814 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd93c0fe960 0x7fd93c0fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:52.814 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd924099010 0x7fd92409b4c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:52.814 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd93c103ba0 0x7fd93c0fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:52.815 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 --2- 172.21.15.154:0/1906067822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd93c101280 0x7fd93c0fc910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:52.815 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 >> 172.21.15.154:0/1906067822 conn(0x7fd93c0f8460 msgr2=0x7fd93c0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:40:52.815 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 shutdown_connections 2022-09-07T19:40:52.815 INFO:teuthology.orchestra.run.smithi154.stderr:2022-09-07T19:40:52.814+0000 7fd94270a700 1 -- 172.21.15.154:0/1906067822 wait complete. 2022-09-07T19:40:52.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:52 smithi080 ceph-mon[90124]: from='osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2022-09-07T19:40:52.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:52 smithi080 ceph-mon[90124]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2022-09-07T19:40:52.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:52 smithi155 ceph-mon[97606]: from='osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2022-09-07T19:40:52.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:52 smithi155 ceph-mon[97606]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2022-09-07T19:40:53.238 DEBUG:teuthology.orchestra.run.smithi154:osd.10> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.10.service 2022-09-07T19:40:53.241 INFO:tasks.cephadm:Deploying osd.11 on smithi155 with /dev/vg_nvme/lv_1... 2022-09-07T19:40:53.242 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2022-09-07T19:40:53.269 INFO:journalctl@ceph.osd.10.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:40:53.783 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-10[119753]: 2022-09-07T19:40:53.527+0000 7f47ff4b6700 -1 osd.10 0 waiting for initial osdmap 2022-09-07T19:40:53.784 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-10[119753]: 2022-09-07T19:40:53.541+0000 7f47faaaa700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:40:53.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:53.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2022-09-07T19:40:53.785 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: osdmap e70: 11 total, 10 up, 11 in 2022-09-07T19:40:53.785 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:53.785 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:40:53.786 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:40:53.786 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:53.787 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:53.787 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:53.787 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:53.787 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:53 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:53.845 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:40:53.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:53.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2022-09-07T19:40:53.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: osdmap e70: 11 total, 10 up, 11 in 2022-09-07T19:40:53.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:53.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:40:53.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:40:53.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:53.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:53.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:53.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:53.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:53 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:53.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:53.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2022-09-07T19:40:53.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: osdmap e70: 11 total, 10 up, 11 in 2022-09-07T19:40:53.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:53.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:40:53.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2022-09-07T19:40:53.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:53.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:53.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:40:53.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:53.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:53 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:40:54.554 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:40:54.555 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: osdmap e71: 11 total, 10 up, 11 in 2022-09-07T19:40:54.556 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.556 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.556 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] boot 2022-09-07T19:40:54.557 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: osdmap e72: 11 total, 11 up, 11 in 2022-09-07T19:40:54.557 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.581 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:40:54.582 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: osdmap e71: 11 total, 10 up, 11 in 2022-09-07T19:40:54.582 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.583 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.583 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] boot 2022-09-07T19:40:54.583 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: osdmap e72: 11 total, 11 up, 11 in 2022-09-07T19:40:54.583 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2022-09-07T19:40:54.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: osdmap e71: 11 total, 10 up, 11 in 2022-09-07T19:40:54.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:54.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: osd.10 [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] boot 2022-09-07T19:40:54.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: osdmap e72: 11 total, 11 up, 11 in 2022-09-07T19:40:54.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:40:55.322 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_1 2022-09-07T19:40:55.323 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2022-09-07T19:40:55.323 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2022-09-07T19:40:55.323 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2022-09-07T19:40:55.323 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010998 s, 953 MB/s 2022-09-07T19:40:55.324 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2022-09-07T19:40:55.668 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:40:55.669 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:40:55.669 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:55.669 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: osdmap e73: 11 total, 11 up, 11 in 2022-09-07T19:40:55.670 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.670 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.670 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.670 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.671 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.671 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.671 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.671 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:55 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.673 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_1 2022-09-07T19:40:55.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:40:55.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:40:55.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:55.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: osdmap e73: 11 total, 11 up, 11 in 2022-09-07T19:40:55.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:55 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:40:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:40:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2022-09-07T19:40:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: osdmap e73: 11 total, 11 up, 11 in 2022-09-07T19:40:55.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:40:55.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:55.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:55 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:40:56.305 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:40:56.790 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:56 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi154 2022-09-07T19:40:56.791 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:56 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi154 to 4292M 2022-09-07T19:40:56.791 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:56 smithi155 ceph-mon[97606]: osdmap e74: 11 total, 11 up, 11 in 2022-09-07T19:40:56.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:56 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi154 2022-09-07T19:40:56.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:56 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi154 to 4292M 2022-09-07T19:40:56.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:56 smithi080 ceph-mon[90124]: osdmap e74: 11 total, 11 up, 11 in 2022-09-07T19:40:56.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:56 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi154 2022-09-07T19:40:56.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:56 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi154 to 4292M 2022-09-07T19:40:56.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:56 smithi154 ceph-mon[96967]: osdmap e74: 11 total, 11 up, 11 in 2022-09-07T19:40:57.363 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 -- 172.21.15.155:0/3107075719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 msgr2=0x7ff4f80fd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:57.364 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 --2- 172.21.15.155:0/3107075719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f80fd1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009810 tx=0x7ff4ec009b20 comp rx=0 tx=0).stop 2022-09-07T19:40:57.364 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 -- 172.21.15.155:0/3107075719 shutdown_connections 2022-09-07T19:40:57.365 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 --2- 172.21.15.155:0/3107075719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f80fe970 0x7ff4f8105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:57.365 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 --2- 172.21.15.155:0/3107075719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f80fd1f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:57.365 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 --2- 172.21.15.155:0/3107075719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4f80fdfc0 0x7ff4f80fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:57.366 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 -- 172.21.15.155:0/3107075719 >> 172.21.15.155:0/3107075719 conn(0x7ff4f80f8430 msgr2=0x7ff4f80fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:40:57.366 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 -- 172.21.15.155:0/3107075719 shutdown_connections 2022-09-07T19:40:57.366 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.364+0000 7ff4fed17700 1 -- 172.21.15.155:0/3107075719 wait complete. 2022-09-07T19:40:57.371 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 Processor -- start 2022-09-07T19:40:57.371 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 -- start start 2022-09-07T19:40:57.372 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f8192960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:57.372 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4f80fdfc0 0x7ff4f8192ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:57.372 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f80fe970 0x7ff4f8199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:57.373 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f819a450 con 0x7ff4f80fdfc0 2022-09-07T19:40:57.373 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f819a5c0 con 0x7ff4f80fe970 2022-09-07T19:40:57.373 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fed17700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f819a780 con 0x7ff4f80fcde0 2022-09-07T19:40:57.374 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fcab3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f8192960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:40:57.374 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fcab3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f8192960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59194/0 (socket says 172.21.15.155:59194) 2022-09-07T19:40:57.375 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.365+0000 7ff4fcab3700 1 -- 172.21.15.155:0/2492981586 learned_addr learned my addr 172.21.15.155:0/2492981586 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:40:57.375 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fd2b4700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f80fe970 0x7ff4f8199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:40:57.375 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fcab3700 1 -- 172.21.15.155:0/2492981586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f80fe970 msgr2=0x7ff4f8199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:57.376 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fcab3700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f80fe970 0x7ff4f8199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:57.376 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fcab3700 1 -- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4f80fdfc0 msgr2=0x7ff4f8192ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:40:57.376 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fcab3700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4f80fdfc0 0x7ff4f8192ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:40:57.377 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fcab3700 1 -- 172.21.15.155:0/2492981586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009470 con 0x7ff4f80fcde0 2022-09-07T19:40:57.377 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fcab3700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f8192960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00f6c0 tx=0x7ff4ec00f7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:40:57.377 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec01d070 con 0x7ff4f80fcde0 2022-09-07T19:40:57.378 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff4ec005760 con 0x7ff4f80fcde0 2022-09-07T19:40:57.378 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f819aa00 con 0x7ff4f80fcde0 2022-09-07T19:40:57.378 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec004ba0 con 0x7ff4f80fcde0 2022-09-07T19:40:57.378 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.366+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f819af80 con 0x7ff4f80fcde0 2022-09-07T19:40:57.379 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.367+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8108530 con 0x7ff4f80fcde0 2022-09-07T19:40:57.379 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.368+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ff4ec028030 con 0x7ff4f80fcde0 2022-09-07T19:40:57.379 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.368+0000 7ff4f5ffb700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff4e8099090 0x7ff4e809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:40:57.380 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.369+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6690+0+0 (secure 0 0 0) 0x7ff4ec0c2cc0 con 0x7ff4f80fcde0 2022-09-07T19:40:57.380 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.369+0000 7ff4f7fff700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff4e8099090 0x7ff4e809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:40:57.380 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.370+0000 7ff4f7fff700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff4e8099090 0x7ff4e809b540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009630 tx=0x7ff4e4006ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:40:57.381 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.373+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff4ec08fa50 con 0x7ff4f80fcde0 2022-09-07T19:40:57.567 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:40:57.568+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f805f120 con 0x7ff4e8099090 2022-09-07T19:40:57.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:57 smithi080 ceph-mon[90124]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:40:57.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:57 smithi080 ceph-mon[90124]: osdmap e75: 11 total, 11 up, 11 in 2022-09-07T19:40:57.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:57 smithi154 ceph-mon[96967]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:40:57.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:57 smithi154 ceph-mon[96967]: osdmap e75: 11 total, 11 up, 11 in 2022-09-07T19:40:57.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:57 smithi155 ceph-mon[97606]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:40:57.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:57 smithi155 ceph-mon[97606]: osdmap e75: 11 total, 11 up, 11 in 2022-09-07T19:40:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:58 smithi155 ceph-mon[97606]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:58.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:58.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:58.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:58.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:58 smithi155 ceph-mon[97606]: osdmap e76: 11 total, 11 up, 11 in 2022-09-07T19:40:58.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:58 smithi080 ceph-mon[90124]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:58.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:58.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:58.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:58.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:58 smithi080 ceph-mon[90124]: osdmap e76: 11 total, 11 up, 11 in 2022-09-07T19:40:58.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:58 smithi154 ceph-mon[96967]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:40:58.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-09-07T19:40:58.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-09-07T19:40:58.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:40:58.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:58 smithi154 ceph-mon[96967]: osdmap e76: 11 total, 11 up, 11 in 2022-09-07T19:40:59.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:40:59 smithi080 ceph-mon[90124]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:40:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:40:59 smithi154 ceph-mon[96967]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:40:59.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:40:59 smithi155 ceph-mon[97606]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:00.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:00 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/1899868155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]: dispatch 2022-09-07T19:41:00.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:00 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]: dispatch 2022-09-07T19:41:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:00 smithi080 ceph-mon[90124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]': finished 2022-09-07T19:41:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:00 smithi080 ceph-mon[90124]: osdmap e77: 12 total, 11 up, 12 in 2022-09-07T19:41:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:00 smithi080 ceph-mon[90124]: from='client.? 172.21.15.155:0/2235978987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:41:00.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:00 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/1899868155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]: dispatch 2022-09-07T19:41:00.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:00 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]: dispatch 2022-09-07T19:41:00.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:00 smithi154 ceph-mon[96967]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]': finished 2022-09-07T19:41:00.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:00 smithi154 ceph-mon[96967]: osdmap e77: 12 total, 11 up, 12 in 2022-09-07T19:41:00.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:00.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:00 smithi154 ceph-mon[96967]: from='client.? 172.21.15.155:0/2235978987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:41:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:00 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/1899868155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]: dispatch 2022-09-07T19:41:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:00 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]: dispatch 2022-09-07T19:41:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:00 smithi155 ceph-mon[97606]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37b9e7ef-ee23-4345-98d1-1a07ab13dc0f"}]': finished 2022-09-07T19:41:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:00 smithi155 ceph-mon[97606]: osdmap e77: 12 total, 11 up, 12 in 2022-09-07T19:41:00.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:00.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:00 smithi155 ceph-mon[97606]: from='client.? 172.21.15.155:0/2235978987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-09-07T19:41:01.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:01 smithi080 ceph-mon[90124]: pgmap v256: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2022-09-07T19:41:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:01 smithi154 ceph-mon[96967]: pgmap v256: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2022-09-07T19:41:01.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:01 smithi155 ceph-mon[97606]: pgmap v256: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2022-09-07T19:41:03.864 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:03 smithi155 ceph-mon[97606]: pgmap v257: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2022-09-07T19:41:03.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:03 smithi080 ceph-mon[90124]: pgmap v257: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2022-09-07T19:41:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:03 smithi154 ceph-mon[96967]: pgmap v257: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2022-09-07T19:41:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:05 smithi080 ceph-mon[90124]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2022-09-07T19:41:05.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:05 smithi154 ceph-mon[96967]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2022-09-07T19:41:05.876 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:05 smithi155 ceph-mon[97606]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2022-09-07T19:41:06.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2022-09-07T19:41:06.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:06.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2022-09-07T19:41:06.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:06.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2022-09-07T19:41:06.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:07.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:07 smithi080 ceph-mon[90124]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2022-09-07T19:41:07.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:07 smithi080 ceph-mon[90124]: Deploying daemon osd.11 on smithi155 2022-09-07T19:41:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:07 smithi154 ceph-mon[96967]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2022-09-07T19:41:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:07 smithi154 ceph-mon[96967]: Deploying daemon osd.11 on smithi155 2022-09-07T19:41:07.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:07 smithi155 ceph-mon[97606]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2022-09-07T19:41:07.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:07 smithi155 ceph-mon[97606]: Deploying daemon osd.11 on smithi155 2022-09-07T19:41:09.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:09 smithi080 ceph-mon[90124]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:09.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:09 smithi154 ceph-mon[96967]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:09.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:09 smithi155 ceph-mon[97606]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:11.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:11 smithi080 ceph-mon[90124]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:11.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:11.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:11.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:11.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:11.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:11.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:11 smithi154 ceph-mon[96967]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:11.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:11.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:11.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:11.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:11.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:11.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:11 smithi155 ceph-mon[97606]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:11.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:11.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:11.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:11.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:11.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:13.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:13 smithi080 ceph-mon[90124]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:13.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:13 smithi154 ceph-mon[96967]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:13.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:13 smithi155 ceph-mon[97606]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:15.231 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:15 smithi155 ceph-mon[97606]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:15.232 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.232 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.232 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:15 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.259 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 11 on host 'smithi155' 2022-09-07T19:41:15.259 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.258+0000 7ff4f5ffb700 1 -- 172.21.15.155:0/2492981586 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ff4f805f120 con 0x7ff4e8099090 2022-09-07T19:41:15.261 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff4e8099090 msgr2=0x7ff4e809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:15.261 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff4e8099090 0x7ff4e809b540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009630 tx=0x7ff4e4006ba0 comp rx=0 tx=0).stop 2022-09-07T19:41:15.261 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 msgr2=0x7ff4f8192960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:15.262 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f8192960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00f6c0 tx=0x7ff4ec00f7a0 comp rx=0 tx=0).stop 2022-09-07T19:41:15.262 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 shutdown_connections 2022-09-07T19:41:15.262 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff4e8099090 0x7ff4e809b540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:15.263 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f80fe970 0x7ff4f8199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:15.263 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4f80fcde0 0x7ff4f8192960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:15.263 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 --2- 172.21.15.155:0/2492981586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4f80fdfc0 0x7ff4f8192ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:15.263 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 >> 172.21.15.155:0/2492981586 conn(0x7ff4f80f8430 msgr2=0x7ff4f80fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:15.264 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 shutdown_connections 2022-09-07T19:41:15.264 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:15.261+0000 7ff4fed17700 1 -- 172.21.15.155:0/2492981586 wait complete. 2022-09-07T19:41:15.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:14 smithi080 ceph-mon[90124]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:15.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:14 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:14 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:14 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:14 smithi154 ceph-mon[96967]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:15.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:14 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:14 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:14 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:15.670 DEBUG:teuthology.orchestra.run.smithi155:osd.11> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@osd.11.service 2022-09-07T19:41:15.674 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2022-09-07T19:41:15.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd stat -f json 2022-09-07T19:41:15.701 INFO:journalctl@ceph.osd.11.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:41:16.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:16.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:16.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:16.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:16.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:16.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2022-09-07T19:41:16.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:16 smithi155 ceph-mon[97606]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2022-09-07T19:41:16.553 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:41:16.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:16.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:16.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:16.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:16.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:16.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2022-09-07T19:41:16.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:16 smithi080 ceph-mon[90124]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2022-09-07T19:41:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:16.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:16.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:16.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2022-09-07T19:41:16.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:16 smithi154 ceph-mon[96967]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2022-09-07T19:41:17.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:17 smithi080 ceph-mon[90124]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:17.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:17 smithi080 ceph-mon[90124]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2022-09-07T19:41:17.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:17 smithi080 ceph-mon[90124]: osdmap e78: 12 total, 11 up, 12 in 2022-09-07T19:41:17.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:17 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:17.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:17 smithi080 ceph-mon[90124]: from='osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:41:17.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:17 smithi080 ceph-mon[90124]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:41:17.604 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-mon[97606]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:17.604 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-mon[97606]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2022-09-07T19:41:17.605 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-mon[97606]: osdmap e78: 12 total, 11 up, 12 in 2022-09-07T19:41:17.605 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:17.605 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-mon[97606]: from='osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:41:17.605 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-mon[97606]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:41:17.606 INFO:journalctl@ceph.osd.11.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-11[121142]: 2022-09-07T19:41:17.269+0000 7f7b511a5700 -1 osd.11 0 waiting for initial osdmap 2022-09-07T19:41:17.606 INFO:journalctl@ceph.osd.11.smithi155.stdout:Sep 07 19:41:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-osd-11[121142]: 2022-09-07T19:41:17.288+0000 7f7b4a795700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-07T19:41:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:17 smithi154 ceph-mon[96967]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:17 smithi154 ceph-mon[96967]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2022-09-07T19:41:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:17 smithi154 ceph-mon[96967]: osdmap e78: 12 total, 11 up, 12 in 2022-09-07T19:41:17.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:17 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:17.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:17 smithi154 ceph-mon[96967]: from='osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:41:17.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:17 smithi154 ceph-mon[96967]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2022-09-07T19:41:18.097 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/847738520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 msgr2=0x7f1b480fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:18.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/847738520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b480fe060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009750 tx=0x7f1b44009a60 comp rx=0 tx=0).stop 2022-09-07T19:41:18.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/847738520 shutdown_connections 2022-09-07T19:41:18.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/847738520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480ff860 0x7f1b48106120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/847738520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b480fe060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/847738520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b480feed0 0x7f1b480ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/847738520 >> 172.21.15.80:0/847738520 conn(0x7f1b480f9320 msgr2=0x7f1b480fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/847738520 shutdown_connections 2022-09-07T19:41:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.097+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/847738520 wait complete. 2022-09-07T19:41:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.098+0000 7f1b4e7b5700 1 Processor -- start 2022-09-07T19:41:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.098+0000 7f1b4e7b5700 1 -- start start 2022-09-07T19:41:18.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4e7b5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b48195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:18.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4e7b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 0x7f1b48196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4e7b5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b480ff860 0x7f1b4819d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4e7b5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4819d640 con 0x7f1b480ff860 2022-09-07T19:41:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4e7b5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4819d7b0 con 0x7f1b480feed0 2022-09-07T19:41:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4e7b5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4819d970 con 0x7f1b480fdc50 2022-09-07T19:41:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4cfb2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 0x7f1b48196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4dfb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b480ff860 0x7f1b4819d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4cfb2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 0x7f1b48196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:51946/0 (socket says 172.21.15.80:51946) 2022-09-07T19:41:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4cfb2700 1 -- 172.21.15.80:0/1188365548 learned_addr learned my addr 172.21.15.80:0/1188365548 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:18.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.099+0000 7f1b4d7b3700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b48195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:18.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4d7b3700 1 -- 172.21.15.80:0/1188365548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 msgr2=0x7f1b48196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:18.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4d7b3700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 0x7f1b48196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4d7b3700 1 -- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b480ff860 msgr2=0x7f1b4819d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4d7b3700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b480ff860 0x7f1b4819d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4d7b3700 1 -- 172.21.15.80:0/1188365548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009470 con 0x7f1b480fdc50 2022-09-07T19:41:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4cfb2700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 0x7f1b48196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:41:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4d7b3700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b48195ac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b440096a0 tx=0x7f1b44004230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4401d070 con 0x7f1b480fdc50 2022-09-07T19:41:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f1b44005320 con 0x7f1b480fdc50 2022-09-07T19:41:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004760 con 0x7f1b480fdc50 2022-09-07T19:41:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b440093b0 con 0x7f1b480fdc50 2022-09-07T19:41:18.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.100+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4819dec0 con 0x7f1b480fdc50 2022-09-07T19:41:18.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.101+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b48109400 con 0x7f1b480fdc50 2022-09-07T19:41:18.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.103+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f1b4400c040 con 0x7f1b480fdc50 2022-09-07T19:41:18.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.104+0000 7f1b3e7fc700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b34099010 0x7f1b3409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:18.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.104+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f1b440c2d30 con 0x7f1b480fdc50 2022-09-07T19:41:18.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.104+0000 7f1b4cfb2700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b34099010 0x7f1b3409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:18.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.105+0000 7f1b4cfb2700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b34099010 0x7f1b3409b4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005b90 tx=0x7f1b38005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:18.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.108+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f1b4408f940 con 0x7f1b480fdc50 2022-09-07T19:41:18.328 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.328+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1b48190010 con 0x7f1b480fdc50 2022-09-07T19:41:18.329 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.329+0000 7f1b3e7fc700 1 -- 172.21.15.80:0/1188365548 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f1b440c2030 con 0x7f1b480fdc50 2022-09-07T19:41:18.330 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:18.331 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.331+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b34099010 msgr2=0x7f1b3409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:18.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.331+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b34099010 0x7f1b3409b4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005b90 tx=0x7f1b38005f60 comp rx=0 tx=0).stop 2022-09-07T19:41:18.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.331+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 msgr2=0x7f1b48195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:18.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.331+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b48195ac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b440096a0 tx=0x7f1b44004230 comp rx=0 tx=0).stop 2022-09-07T19:41:18.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.331+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 shutdown_connections 2022-09-07T19:41:18.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b480ff860 0x7f1b4819d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b34099010 0x7f1b3409b4c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b480fdc50 0x7f1b48195ac0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 --2- 172.21.15.80:0/1188365548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b480feed0 0x7f1b48196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:18.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 >> 172.21.15.80:0/1188365548 conn(0x7f1b480f9320 msgr2=0x7f1b481048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:18.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 shutdown_connections 2022-09-07T19:41:18.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:18.332+0000 7f1b4e7b5700 1 -- 172.21.15.80:0/1188365548 wait complete. 2022-09-07T19:41:18.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:41:18.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: osdmap e79: 12 total, 11 up, 12 in 2022-09-07T19:41:18.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:18.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:18.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:18 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:41:18.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: osdmap e79: 12 total, 11 up, 12 in 2022-09-07T19:41:18.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:18.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:18.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.449 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.450 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.451 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.452 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:18 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2022-09-07T19:41:18.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: osdmap e79: 12 total, 11 up, 12 in 2022-09-07T19:41:18.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:18.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:18.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:41:18.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:18 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:18.718 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1662579678,"num_in_osds":12,"osd_in_since":1662579659,"num_remapped_pgs":0} 2022-09-07T19:41:18.720 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd dump --format=json 2022-09-07T19:41:19.596 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:41:19.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: purged_snaps scrub starts 2022-09-07T19:41:19.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: purged_snaps scrub ok 2022-09-07T19:41:19.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: Detected new or changed devices on smithi155 2022-09-07T19:41:19.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi155 to 4292M 2022-09-07T19:41:19.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:19.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:19.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] boot 2022-09-07T19:41:19.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: osdmap e80: 12 total, 12 up, 12 in 2022-09-07T19:41:19.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:19.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:19 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1188365548' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-09-07T19:41:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: purged_snaps scrub starts 2022-09-07T19:41:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: purged_snaps scrub ok 2022-09-07T19:41:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: Detected new or changed devices on smithi155 2022-09-07T19:41:19.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi155 to 4292M 2022-09-07T19:41:19.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:19.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:19.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] boot 2022-09-07T19:41:19.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: osdmap e80: 12 total, 12 up, 12 in 2022-09-07T19:41:19.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:19.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:19 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1188365548' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-09-07T19:41:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: purged_snaps scrub starts 2022-09-07T19:41:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: purged_snaps scrub ok 2022-09-07T19:41:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: Detected new or changed devices on smithi155 2022-09-07T19:41:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi155 to 4292M 2022-09-07T19:41:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2022-09-07T19:41:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:19.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: osd.11 [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] boot 2022-09-07T19:41:19.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: osdmap e80: 12 total, 12 up, 12 in 2022-09-07T19:41:19.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:41:19.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:19 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1188365548' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-09-07T19:41:20.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:20 smithi080 ceph-mon[90124]: osdmap e81: 12 total, 12 up, 12 in 2022-09-07T19:41:20.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:20 smithi154 ceph-mon[96967]: osdmap e81: 12 total, 12 up, 12 in 2022-09-07T19:41:20.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:20 smithi155 ceph-mon[97606]: osdmap e81: 12 total, 12 up, 12 in 2022-09-07T19:41:21.145 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.141+0000 7efc000d5700 1 -- 172.21.15.80:0/1147776434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 msgr2=0x7efbf8067b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:21.146 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.141+0000 7efc000d5700 1 --2- 172.21.15.80:0/1147776434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 0x7efbf8067b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009810 tx=0x7efbe8009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:21.146 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 -- 172.21.15.80:0/1147776434 shutdown_connections 2022-09-07T19:41:21.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 --2- 172.21.15.80:0/1147776434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf80671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 --2- 172.21.15.80:0/1147776434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf81008c0 0x7efbf8100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 --2- 172.21.15.80:0/1147776434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 0x7efbf8067b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 -- 172.21.15.80:0/1147776434 >> 172.21.15.80:0/1147776434 conn(0x7efbf8074100 msgr2=0x7efbf8074500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:21.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 -- 172.21.15.80:0/1147776434 shutdown_connections 2022-09-07T19:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.142+0000 7efc000d5700 1 -- 172.21.15.80:0/1147776434 wait complete. 2022-09-07T19:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 Processor -- start 2022-09-07T19:41:21.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 -- start start 2022-09-07T19:41:21.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 0x7efbf819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf81008c0 0x7efbf819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf819f260 con 0x7efbf8102d30 2022-09-07T19:41:21.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf819f3d0 con 0x7efbf80676e0 2022-09-07T19:41:21.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.143+0000 7efc000d5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf819f590 con 0x7efbf81008c0 2022-09-07T19:41:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42686/0 (socket says 172.21.15.80:42686) 2022-09-07T19:41:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 -- 172.21.15.80:0/3049401857 learned_addr learned my addr 172.21.15.80:0/3049401857 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfd670700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf81008c0 0x7efbf819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:21.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfde71700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 0x7efbf819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:21.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 -- 172.21.15.80:0/3049401857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf81008c0 msgr2=0x7efbf819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:21.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf81008c0 0x7efbf819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 -- 172.21.15.80:0/3049401857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 msgr2=0x7efbf819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 0x7efbf819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.144+0000 7efbfe672700 1 -- 172.21.15.80:0/3049401857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009470 con 0x7efbf8102d30 2022-09-07T19:41:21.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.145+0000 7efbfe672700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf819ebd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf000ebf0 tx=0x7efbf000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:21.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.145+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf00099c0 con 0x7efbf8102d30 2022-09-07T19:41:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.145+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf819f870 con 0x7efbf8102d30 2022-09-07T19:41:21.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.145+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efbf000cc90 con 0x7efbf8102d30 2022-09-07T19:41:21.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.145+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0010430 con 0x7efbf8102d30 2022-09-07T19:41:21.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.145+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf81a7060 con 0x7efbf8102d30 2022-09-07T19:41:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.146+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8064ea0 con 0x7efbf8102d30 2022-09-07T19:41:21.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.148+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7efbf001e020 con 0x7efbf8102d30 2022-09-07T19:41:21.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.149+0000 7efbeeffd700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe4099010 0x7efbe409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:21.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.149+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7efbf0014070 con 0x7efbf8102d30 2022-09-07T19:41:21.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.149+0000 7efbfde71700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe4099010 0x7efbe409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:21.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.150+0000 7efbfde71700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe4099010 0x7efbe409b4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005fd0 tx=0x7efbf4005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:21.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.153+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7efbf008efc0 con 0x7efbf8102d30 2022-09-07T19:41:21.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.362+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efbf8114290 con 0x7efbf8102d30 2022-09-07T19:41:21.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.363+0000 7efbeeffd700 1 -- 172.21.15.80:0/3049401857 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18123 (secure 0 0 0) 0x7efbf00925e0 con 0x7efbf8102d30 2022-09-07T19:41:21.364 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:21.365 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:41:19.282385+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:41:21.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.365+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe4099010 msgr2=0x7efbe409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:21.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.365+0000 7efc000d5700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe4099010 0x7efbe409b4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005fd0 tx=0x7efbf4005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.365+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 msgr2=0x7efbf819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.365+0000 7efc000d5700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf819ebd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf000ebf0 tx=0x7efbf000ef00 comp rx=0 tx=0).stop 2022-09-07T19:41:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 shutdown_connections 2022-09-07T19:41:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8102d30 0x7efbf819ebd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe4099010 0x7efbe409b4c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80676e0 0x7efbf819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 --2- 172.21.15.80:0/3049401857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf81008c0 0x7efbf819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 >> 172.21.15.80:0/3049401857 conn(0x7efbf8074100 msgr2=0x7efbf80ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 shutdown_connections 2022-09-07T19:41:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:21.366+0000 7efc000d5700 1 -- 172.21.15.80:0/3049401857 wait complete. 2022-09-07T19:41:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:21 smithi080 ceph-mon[90124]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 72 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:21 smithi154 ceph-mon[96967]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 72 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:21 smithi155 ceph-mon[97606]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 72 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:21.861 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-09-07T19:41:21.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd pool get .mgr pg_num 2022-09-07T19:41:22.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:22 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3049401857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:41:22.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:22 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3049401857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:41:22.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:22 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3049401857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:41:22.735 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:41:23.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:23 smithi080 ceph-mon[90124]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:23 smithi154 ceph-mon[96967]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:23 smithi155 ceph-mon[97606]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:24.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.283+0000 7f25c7fff700 1 -- 172.21.15.80:0/105554450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fdea0 msgr2=0x7f25c80fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:24.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.283+0000 7f25c7fff700 1 --2- 172.21.15.80:0/105554450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fdea0 0x7f25c80fe270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009840 tx=0x7f25b8009b50 comp rx=0 tx=0).stop 2022-09-07T19:41:24.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 -- 172.21.15.80:0/105554450 shutdown_connections 2022-09-07T19:41:24.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 --2- 172.21.15.80:0/105554450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fdea0 0x7f25c80fe270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 --2- 172.21.15.80:0/105554450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 0x7f25c810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 --2- 172.21.15.80:0/105554450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fe840 0x7f25c8102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 -- 172.21.15.80:0/105554450 >> 172.21.15.80:0/105554450 conn(0x7f25c80f9800 msgr2=0x7f25c80fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:24.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 -- 172.21.15.80:0/105554450 shutdown_connections 2022-09-07T19:41:24.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.284+0000 7f25c7fff700 1 -- 172.21.15.80:0/105554450 wait complete. 2022-09-07T19:41:24.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 Processor -- start 2022-09-07T19:41:24.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 -- start start 2022-09-07T19:41:24.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fdea0 0x7f25c8070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:24.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fe840 0x7f25c8071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:24.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 0x7f25c81a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:24.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8071db0 con 0x7f25c80fe840 2022-09-07T19:41:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81a22d0 con 0x7f25c80fdea0 2022-09-07T19:41:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.285+0000 7f25c7fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81a2410 con 0x7f25c8102fa0 2022-09-07T19:41:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fe840 0x7f25c8071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 0x7f25c81a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fdea0 0x7f25c8070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:24.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fe840 0x7f25c8071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33688/0 (socket says 172.21.15.80:33688) 2022-09-07T19:41:24.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c67fc700 1 -- 172.21.15.80:0/3008456292 learned_addr learned my addr 172.21.15.80:0/3008456292 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:24.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 -- 172.21.15.80:0/3008456292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fdea0 msgr2=0x7f25c8070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:24.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fdea0 0x7f25c8070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 -- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fe840 msgr2=0x7f25c8071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:24.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fe840 0x7f25c8071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 -- 172.21.15.80:0/3008456292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8009470 con 0x7f25c8102fa0 2022-09-07T19:41:24.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c6ffd700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fdea0 0x7f25c8070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:41:24.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c77fe700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 0x7f25c81a1d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25c000eab0 tx=0x7f25c000edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:24.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00098c0 con 0x7f25c8102fa0 2022-09-07T19:41:24.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f25c000ce10 con 0x7f25c8102fa0 2022-09-07T19:41:24.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c81a26a0 con 0x7f25c8102fa0 2022-09-07T19:41:24.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0004280 con 0x7f25c8102fa0 2022-09-07T19:41:24.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.287+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c81a2b60 con 0x7f25c8102fa0 2022-09-07T19:41:24.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.288+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c804d480 con 0x7f25c8102fa0 2022-09-07T19:41:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.290+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f25c000c040 con 0x7f25c8102fa0 2022-09-07T19:41:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.291+0000 7f25cc9e3700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f25b0099010 0x7f25b009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.291+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f25c0014070 con 0x7f25c8102fa0 2022-09-07T19:41:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.291+0000 7f25c6ffd700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f25b0099010 0x7f25b009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:24.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.292+0000 7f25c6ffd700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f25b0099010 0x7f25b009b4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009810 tx=0x7f25b8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:24.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.293+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f25c008ed30 con 0x7f25c8102fa0 2022-09-07T19:41:24.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.512+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25c8072610 con 0x7f25c8102fa0 2022-09-07T19:41:24.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.512+0000 7f25cc9e3700 1 -- 172.21.15.80:0/3008456292 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25c0017e90 con 0x7f25c8102fa0 2022-09-07T19:41:24.513 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:41:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f25b0099010 msgr2=0x7f25b009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f25b0099010 0x7f25b009b4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009810 tx=0x7f25b8000bc0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 msgr2=0x7f25c81a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 0x7f25c81a1d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25c000eab0 tx=0x7f25c000edc0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 shutdown_connections 2022-09-07T19:41:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f25b0099010 0x7f25b009b4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c8102fa0 0x7f25c81a1d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c80fdea0 0x7f25c8070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 --2- 172.21.15.80:0/3008456292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c80fe840 0x7f25c8071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 >> 172.21.15.80:0/3008456292 conn(0x7f25c80f9800 msgr2=0x7f25c80fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 shutdown_connections 2022-09-07T19:41:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:24.515+0000 7f25c7fff700 1 -- 172.21.15.80:0/3008456292 wait complete. 2022-09-07T19:41:25.005 INFO:tasks.cephadm:Adding mds.a on smithi080 2022-09-07T19:41:25.005 INFO:tasks.cephadm:Adding mds.d on smithi080 2022-09-07T19:41:25.006 INFO:tasks.cephadm:Adding mds.g on smithi080 2022-09-07T19:41:25.006 INFO:tasks.cephadm:Adding mds.j on smithi080 2022-09-07T19:41:25.007 INFO:tasks.cephadm:Adding mds.b on smithi154 2022-09-07T19:41:25.007 INFO:tasks.cephadm:Adding mds.e on smithi154 2022-09-07T19:41:25.008 INFO:tasks.cephadm:Adding mds.h on smithi154 2022-09-07T19:41:25.008 INFO:tasks.cephadm:Adding mds.k on smithi154 2022-09-07T19:41:25.008 INFO:tasks.cephadm:Adding mds.c on smithi155 2022-09-07T19:41:25.009 INFO:tasks.cephadm:Adding mds.f on smithi155 2022-09-07T19:41:25.009 INFO:tasks.cephadm:Adding mds.i on smithi155 2022-09-07T19:41:25.009 INFO:tasks.cephadm:Adding mds.l on smithi155 2022-09-07T19:41:25.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph orch apply mds all '12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l' 2022-09-07T19:41:25.614 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.c/config 2022-09-07T19:41:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:25 smithi080 ceph-mon[90124]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:25.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:25 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3008456292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:41:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:25 smithi154 ceph-mon[96967]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:25 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3008456292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:41:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:25 smithi155 ceph-mon[97606]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3008456292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:41:26.796 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3287171162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8100fc0 msgr2=0x7f79b81033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:26.796 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3287171162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8100fc0 0x7f79b81033a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009810 tx=0x7f79b4009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:26.796 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3287171162 shutdown_connections 2022-09-07T19:41:26.797 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3287171162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b8067350 0x7f79b8100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:26.797 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3287171162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b8103a30 0x7f79b8105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:26.797 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3287171162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8100fc0 0x7f79b81033a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:26.798 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.793+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3287171162 >> 172.21.15.155:0/3287171162 conn(0x7f79b80f8430 msgr2=0x7f79b80fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:26.798 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3287171162 shutdown_connections 2022-09-07T19:41:26.799 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3287171162 wait complete. 2022-09-07T19:41:26.799 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 Processor -- start 2022-09-07T19:41:26.800 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 -- start start 2022-09-07T19:41:26.800 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 0x7f79b8193a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:26.801 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b8100fc0 0x7f79b8193f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:26.801 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b8103a30 0x7f79b819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:26.801 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b819b500 con 0x7f79b8103a30 2022-09-07T19:41:26.802 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b819b670 con 0x7f79b8100fc0 2022-09-07T19:41:26.802 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bf3c5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b819b830 con 0x7f79b8067350 2022-09-07T19:41:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bd161700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 0x7f79b8193a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bd161700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 0x7f79b8193a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59314/0 (socket says 172.21.15.155:59314) 2022-09-07T19:41:26.804 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.794+0000 7f79bd161700 1 -- 172.21.15.155:0/3043367755 learned_addr learned my addr 172.21.15.155:0/3043367755 (peer_addr_for_me v2:172.21.15.155:0/0) 2022-09-07T19:41:26.804 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd962700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b8103a30 0x7f79b819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:26.804 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bc960700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b8100fc0 0x7f79b8193f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd161700 1 -- 172.21.15.155:0/3043367755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b8100fc0 msgr2=0x7f79b8193f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd161700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b8100fc0 0x7f79b8193f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd161700 1 -- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b8103a30 msgr2=0x7f79b819afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd161700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b8103a30 0x7f79b819afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd161700 1 -- 172.21.15.155:0/3043367755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4009470 con 0x7f79b8067350 2022-09-07T19:41:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bd161700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 0x7f79b8193a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c970 tx=0x7f79a800cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:26.807 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8004220 con 0x7f79b8067350 2022-09-07T19:41:26.807 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b819bb10 con 0x7f79b8067350 2022-09-07T19:41:26.807 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f79a800ae20 con 0x7f79b8067350 2022-09-07T19:41:26.807 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8003c20 con 0x7f79b8067350 2022-09-07T19:41:26.808 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.795+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b819c070 con 0x7f79b8067350 2022-09-07T19:41:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.796+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b81095b0 con 0x7f79b8067350 2022-09-07T19:41:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.797+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f79a801f070 con 0x7f79b8067350 2022-09-07T19:41:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.797+0000 7f79ae7fc700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f799c098fb0 0x7f799c09b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.798+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f79a80c1950 con 0x7f79b8067350 2022-09-07T19:41:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.798+0000 7f79bc960700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f799c098fb0 0x7f799c09b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.798+0000 7f79bc960700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f799c098fb0 0x7f799c09b460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79b4003610 tx=0x7f79b4005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.802+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f79a808e530 con 0x7f79b8067350 2022-09-07T19:41:26.990 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.990+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f79b805f220 con 0x7f799c098fb0 2022-09-07T19:41:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:26.998+0000 7f79ae7fc700 1 -- 172.21.15.155:0/3043367755 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f79b805f220 con 0x7f799c098fb0 2022-09-07T19:41:26.999 INFO:teuthology.orchestra.run.smithi155.stdout:Scheduled mds.all update... 2022-09-07T19:41:27.001 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f799c098fb0 msgr2=0x7f799c09b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:27.001 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f799c098fb0 0x7f799c09b460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79b4003610 tx=0x7f79b4005910 comp rx=0 tx=0).stop 2022-09-07T19:41:27.001 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 msgr2=0x7f79b8193a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:27.001 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 0x7f79b8193a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c970 tx=0x7f79a800cd30 comp rx=0 tx=0).stop 2022-09-07T19:41:27.002 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 shutdown_connections 2022-09-07T19:41:27.002 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b8103a30 0x7f79b819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.002 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f799c098fb0 0x7f799c09b460 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.002 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b8067350 0x7f79b8193a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.003 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 --2- 172.21.15.155:0/3043367755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b8100fc0 0x7f79b8193f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.003 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 >> 172.21.15.155:0/3043367755 conn(0x7f79b80f8430 msgr2=0x7f79b80ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:27.003 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 shutdown_connections 2022-09-07T19:41:27.003 INFO:teuthology.orchestra.run.smithi155.stderr:2022-09-07T19:41:27.001+0000 7f79bf3c5700 1 -- 172.21.15.155:0/3043367755 wait complete. 2022-09-07T19:41:27.346 DEBUG:teuthology.orchestra.run.smithi080:mds.a> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.a.service 2022-09-07T19:41:27.353 DEBUG:teuthology.orchestra.run.smithi080:mds.d> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.d.service 2022-09-07T19:41:27.399 DEBUG:teuthology.orchestra.run.smithi080:mds.g> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.g.service 2022-09-07T19:41:27.446 DEBUG:teuthology.orchestra.run.smithi080:mds.j> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.j.service 2022-09-07T19:41:27.459 INFO:journalctl@ceph.mds.a.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:41:27.465 DEBUG:teuthology.orchestra.run.smithi154:mds.b> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.b.service 2022-09-07T19:41:27.470 DEBUG:teuthology.orchestra.run.smithi154:mds.e> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.e.service 2022-09-07T19:41:27.497 INFO:journalctl@ceph.mds.b.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:41:27.498 DEBUG:teuthology.orchestra.run.smithi154:mds.h> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.h.service 2022-09-07T19:41:27.500 INFO:journalctl@ceph.mds.d.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:41:27.524 INFO:journalctl@ceph.mds.e.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:41:27.526 DEBUG:teuthology.orchestra.run.smithi154:mds.k> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.k.service 2022-09-07T19:41:27.541 INFO:journalctl@ceph.mds.g.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:41:27.551 INFO:journalctl@ceph.mds.h.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:41:27.553 DEBUG:teuthology.orchestra.run.smithi155:mds.c> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.c.service 2022-09-07T19:41:27.557 DEBUG:teuthology.orchestra.run.smithi155:mds.f> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.f.service 2022-09-07T19:41:27.559 INFO:journalctl@ceph.mds.j.smithi080.stdout:-- Logs begin at Wed 2022-09-07 19:16:23 UTC. -- 2022-09-07T19:41:27.577 INFO:journalctl@ceph.mds.k.smithi154.stdout:-- Logs begin at Wed 2022-09-07 19:12:25 UTC. -- 2022-09-07T19:41:27.584 INFO:journalctl@ceph.mds.c.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:41:27.586 DEBUG:teuthology.orchestra.run.smithi155:mds.i> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.i.service 2022-09-07T19:41:27.594 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:27 smithi155 ceph-mon[97606]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:27.594 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:27.594 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:27.595 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:27.595 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:27 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:27.596 DEBUG:teuthology.orchestra.run.smithi155:mds.l> sudo journalctl -f -n 0 -u ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c@mds.l.service 2022-09-07T19:41:27.612 INFO:journalctl@ceph.mds.f.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:41:27.613 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2022-09-07T19:41:27.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:41:27.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:27 smithi080 ceph-mon[90124]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:27.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:27.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:27.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:27.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:27 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:27 smithi154 ceph-mon[96967]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:41:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:27.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:27 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:41:27.624 INFO:journalctl@ceph.mds.i.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:41:27.640 INFO:journalctl@ceph.mds.l.smithi155.stdout:-- Logs begin at Wed 2022-09-07 19:12:33 UTC. -- 2022-09-07T19:41:27.887 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 -- 172.21.15.80:0/4224496474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680ff900 msgr2=0x7f38681061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 --2- 172.21.15.80:0/4224496474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680ff900 0x7f38681061c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3860009b00 tx=0x7f3860009e10 comp rx=0 tx=0).stop 2022-09-07T19:41:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 -- 172.21.15.80:0/4224496474 shutdown_connections 2022-09-07T19:41:27.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 --2- 172.21.15.80:0/4224496474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680ff900 0x7f38681061c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 --2- 172.21.15.80:0/4224496474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38680fdcf0 0x7f38680fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 --2- 172.21.15.80:0/4224496474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38680fef70 0x7f38680ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 -- 172.21.15.80:0/4224496474 >> 172.21.15.80:0/4224496474 conn(0x7f38680f93c0 msgr2=0x7f38680fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:27.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 -- 172.21.15.80:0/4224496474 shutdown_connections 2022-09-07T19:41:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.888+0000 7f386cfff700 1 -- 172.21.15.80:0/4224496474 wait complete. 2022-09-07T19:41:27.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.889+0000 7f386cfff700 1 Processor -- start 2022-09-07T19:41:27.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.889+0000 7f386cfff700 1 -- start start 2022-09-07T19:41:27.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386cfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38680fdcf0 0x7f3868195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:27.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386cfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 0x7f38681960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:27.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386cfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38680ff900 0x7f386819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:27.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386cfff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386819d730 con 0x7f38680fef70 2022-09-07T19:41:27.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386cfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386819d8a0 con 0x7f38680ff900 2022-09-07T19:41:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386cfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386819da60 con 0x7f38680fdcf0 2022-09-07T19:41:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 0x7f38681960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 0x7f38681960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33704/0 (socket says 172.21.15.80:33704) 2022-09-07T19:41:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 -- 172.21.15.80:0/700359968 learned_addr learned my addr 172.21.15.80:0/700359968 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:27.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f386659c700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38680fdcf0 0x7f3868195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3866d9d700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38680ff900 0x7f386819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 -- 172.21.15.80:0/700359968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38680fdcf0 msgr2=0x7f3868195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38680fdcf0 0x7f3868195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 -- 172.21.15.80:0/700359968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38680ff900 msgr2=0x7f386819d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38680ff900 0x7f386819d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.890+0000 7f3865d9b700 1 -- 172.21.15.80:0/700359968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860009730 con 0x7f38680fef70 2022-09-07T19:41:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.891+0000 7f3865d9b700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 0x7f38681960f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e740 tx=0x7f385c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:27.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.891+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c005220 con 0x7f38680fef70 2022-09-07T19:41:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.891+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f385c005380 con 0x7f38680fef70 2022-09-07T19:41:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.891+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c004c10 con 0x7f38680fef70 2022-09-07T19:41:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.891+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386819dd40 con 0x7f38680fef70 2022-09-07T19:41:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.891+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386819e1a0 con 0x7f38680fef70 2022-09-07T19:41:27.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.892+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38681094b0 con 0x7f38680fef70 2022-09-07T19:41:27.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.894+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f385c01e020 con 0x7f38680fef70 2022-09-07T19:41:27.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.895+0000 7f38577fe700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3850099010 0x7f385009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:27.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.895+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f385c014070 con 0x7f38680fef70 2022-09-07T19:41:27.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.896+0000 7f386659c700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3850099010 0x7f385009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:27.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.896+0000 7f386659c700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3850099010 0x7f385009b4c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38680fedd0 tx=0x7f3858005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:27.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:27.899+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f385c08ecd0 con 0x7f38680fef70 2022-09-07T19:41:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.096+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38681900c0 con 0x7f38680fef70 2022-09-07T19:41:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.097+0000 7f38577fe700 1 -- 172.21.15.80:0/700359968 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18123 (secure 0 0 0) 0x7f385c0922f0 con 0x7f38680fef70 2022-09-07T19:41:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:28.098 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:41:19.282385+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:41:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3850099010 msgr2=0x7f385009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3850099010 0x7f385009b4c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38680fedd0 tx=0x7f3858005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 msgr2=0x7f38681960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 0x7f38681960f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e740 tx=0x7f385c00ea50 comp rx=0 tx=0).stop 2022-09-07T19:41:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 shutdown_connections 2022-09-07T19:41:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3850099010 0x7f385009b4c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38680ff900 0x7f386819d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38680fdcf0 0x7f3868195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 --2- 172.21.15.80:0/700359968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38680fef70 0x7f38681960f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 >> 172.21.15.80:0/700359968 conn(0x7f38680f93c0 msgr2=0x7f3868104940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 shutdown_connections 2022-09-07T19:41:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.100+0000 7f386cfff700 1 -- 172.21.15.80:0/700359968 wait complete. 2022-09-07T19:41:28.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-09-07T19:41:28.131 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:41:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 -- 172.21.15.80:0/3149730484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28072c90 msgr2=0x7fca28071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/3149730484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28072c90 0x7fca28071170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca24009810 tx=0x7fca24009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 -- 172.21.15.80:0/3149730484 shutdown_connections 2022-09-07T19:41:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/3149730484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28105bc0 0x7fca28108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/3149730484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28072c90 0x7fca28071170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/3149730484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca28071740 0x7fca28071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 -- 172.21.15.80:0/3149730484 >> 172.21.15.80:0/3149730484 conn(0x7fca280f93f0 msgr2=0x7fca280fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 -- 172.21.15.80:0/3149730484 shutdown_connections 2022-09-07T19:41:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.361+0000 7fca2f5ff700 1 -- 172.21.15.80:0/3149730484 wait complete. 2022-09-07T19:41:28.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.363+0000 7fca2f5ff700 1 Processor -- start 2022-09-07T19:41:28.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.363+0000 7fca2f5ff700 1 -- start start 2022-09-07T19:41:28.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2f5ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 0x7fca28195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2f5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca28072c90 0x7fca281960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2f5ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28105bc0 0x7fca2819d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2f5ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819d710 con 0x7fca28071740 2022-09-07T19:41:28.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2f5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819d880 con 0x7fca28072c90 2022-09-07T19:41:28.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2f5ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819da40 con 0x7fca28105bc0 2022-09-07T19:41:28.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2d39b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 0x7fca28195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2d39b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 0x7fca28195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33726/0 (socket says 172.21.15.80:33726) 2022-09-07T19:41:28.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2d39b700 1 -- 172.21.15.80:0/4082582654 learned_addr learned my addr 172.21.15.80:0/4082582654 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:28.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2db9c700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28105bc0 0x7fca2819d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2cb9a700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca28072c90 0x7fca281960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2d39b700 1 -- 172.21.15.80:0/4082582654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28105bc0 msgr2=0x7fca2819d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2d39b700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28105bc0 0x7fca2819d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.364+0000 7fca2d39b700 1 -- 172.21.15.80:0/4082582654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca28072c90 msgr2=0x7fca281960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca2d39b700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca28072c90 0x7fca281960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca2d39b700 1 -- 172.21.15.80:0/4082582654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24009470 con 0x7fca28071740 2022-09-07T19:41:28.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca2d39b700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 0x7fca28195b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca2400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:28.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2401d070 con 0x7fca28071740 2022-09-07T19:41:28.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fca2400f8b0 con 0x7fca28071740 2022-09-07T19:41:28.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240047f0 con 0x7fca28071740 2022-09-07T19:41:28.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2819dcc0 con 0x7fca28071740 2022-09-07T19:41:28.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.365+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2819e120 con 0x7fca28071740 2022-09-07T19:41:28.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.366+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2810b700 con 0x7fca28071740 2022-09-07T19:41:28.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.368+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fca24028030 con 0x7fca28071740 2022-09-07T19:41:28.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.369+0000 7fca1e7fc700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fca14099010 0x7fca1409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.369+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7fca240c2c20 con 0x7fca28071740 2022-09-07T19:41:28.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.370+0000 7fca2cb9a700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fca14099010 0x7fca1409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.370+0000 7fca2cb9a700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fca14099010 0x7fca1409b4c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca18005fd0 tx=0x7fca18005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:28.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.373+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fca2408f710 con 0x7fca28071740 2022-09-07T19:41:28.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.567+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca28104180 con 0x7fca28071740 2022-09-07T19:41:28.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.567+0000 7fca1e7fc700 1 -- 172.21.15.80:0/4082582654 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca24092d30 con 0x7fca28071740 2022-09-07T19:41:28.567 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:41:28.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fca14099010 msgr2=0x7fca1409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fca14099010 0x7fca1409b4c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca18005fd0 tx=0x7fca18005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 msgr2=0x7fca28195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 0x7fca28195b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca2400f690 comp rx=0 tx=0).stop 2022-09-07T19:41:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 shutdown_connections 2022-09-07T19:41:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca28071740 0x7fca28195b90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fca14099010 0x7fca1409b4c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28105bc0 0x7fca2819d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 --2- 172.21.15.80:0/4082582654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca28072c90 0x7fca281960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 >> 172.21.15.80:0/4082582654 conn(0x7fca280f93f0 msgr2=0x7fca280fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.572+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 shutdown_connections 2022-09-07T19:41:28.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.573+0000 7fca2f5ff700 1 -- 172.21.15.80:0/4082582654 wait complete. 2022-09-07T19:41:28.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 -- 172.21.15.80:0/2958687147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86881038c0 msgr2=0x7f8688105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 --2- 172.21.15.80:0/2958687147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86881038c0 0x7f8688105d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8680009bb0 tx=0x7f8680009ec0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 -- 172.21.15.80:0/2958687147 shutdown_connections 2022-09-07T19:41:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 --2- 172.21.15.80:0/2958687147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8688066bf0 0x7f8688100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 --2- 172.21.15.80:0/2958687147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86881038c0 0x7f8688105d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 --2- 172.21.15.80:0/2958687147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688100dd0 0x7f8688103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 -- 172.21.15.80:0/2958687147 >> 172.21.15.80:0/2958687147 conn(0x7f86880f82a0 msgr2=0x7f86880fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 -- 172.21.15.80:0/2958687147 shutdown_connections 2022-09-07T19:41:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.827+0000 7f868d7ff700 1 -- 172.21.15.80:0/2958687147 wait complete. 2022-09-07T19:41:28.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 Processor -- start 2022-09-07T19:41:28.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 -- start start 2022-09-07T19:41:28.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 0x7f8688195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8688100dd0 0x7f8688196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86881038c0 0x7f868819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819d690 con 0x7f8688100dd0 2022-09-07T19:41:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819d800 con 0x7f86881038c0 2022-09-07T19:41:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f868d7ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819d9c0 con 0x7f8688066bf0 2022-09-07T19:41:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f8686ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 0x7f8688195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f8686ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 0x7f8688195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:50336/0 (socket says 172.21.15.80:50336) 2022-09-07T19:41:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f8686ffd700 1 -- 172.21.15.80:0/3685989629 learned_addr learned my addr 172.21.15.80:0/3685989629 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f86867fc700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8688100dd0 0x7f8688196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.829+0000 7f86877fe700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86881038c0 0x7f868819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f8686ffd700 1 -- 172.21.15.80:0/3685989629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86881038c0 msgr2=0x7f868819d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f8686ffd700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86881038c0 0x7f868819d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f8686ffd700 1 -- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8688100dd0 msgr2=0x7f8688196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f8686ffd700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8688100dd0 0x7f8688196050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f8686ffd700 1 -- 172.21.15.80:0/3685989629 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800097e0 con 0x7f8688066bf0 2022-09-07T19:41:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f8686ffd700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 0x7f8688195b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f867800e6e0 tx=0x7f867800e9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678009500 con 0x7f8688066bf0 2022-09-07T19:41:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868819dca0 con 0x7f8688066bf0 2022-09-07T19:41:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f8678010da0 con 0x7f8688066bf0 2022-09-07T19:41:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.830+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780173d0 con 0x7f8688066bf0 2022-09-07T19:41:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.831+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868819e1b0 con 0x7f8688066bf0 2022-09-07T19:41:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.832+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86881094d0 con 0x7f8688066bf0 2022-09-07T19:41:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.834+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f867800c040 con 0x7f8688066bf0 2022-09-07T19:41:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.835+0000 7f866ffff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8670099010 0x7f867009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.835+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f8678014070 con 0x7f8688066bf0 2022-09-07T19:41:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.835+0000 7f86867fc700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8670099010 0x7f867009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.836+0000 7f86867fc700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8670099010 0x7f867009b4c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f867c005fd0 tx=0x7f867c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:28.838+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f867804fc80 con 0x7f8688066bf0 2022-09-07T19:41:28.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:41:28.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l;count:12 2022-09-07T19:41:28.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:28.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:28.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:28.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:28.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:28.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: Deploying daemon mds.l on smithi155 2022-09-07T19:41:28.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:28 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/700359968' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:41:28.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:41:28.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l;count:12 2022-09-07T19:41:28.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:28.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:28.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:28.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:28.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:28.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: Deploying daemon mds.l on smithi155 2022-09-07T19:41:28.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:28 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/700359968' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:41:28.930 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:41:28.930 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l;count:12 2022-09-07T19:41:28.931 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:28.931 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:28.931 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:28.931 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:28.932 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:28.932 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: Deploying daemon mds.l on smithi155 2022-09-07T19:41:28.932 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:28 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/700359968' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:41:29.073 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.074+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f868805fb20 con 0x7f8688066bf0 2022-09-07T19:41:29.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.074+0000 7f866ffff700 1 -- 172.21.15.80:0/3685989629 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f867808ebc0 con 0x7f8688066bf0 2022-09-07T19:41:29.074 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:29.074 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2022-09-07T19:41:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8670099010 msgr2=0x7f867009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8670099010 0x7f867009b4c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f867c005fd0 tx=0x7f867c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 msgr2=0x7f8688195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 0x7f8688195b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f867800e6e0 tx=0x7f867800e9f0 comp rx=0 tx=0).stop 2022-09-07T19:41:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 shutdown_connections 2022-09-07T19:41:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8670099010 0x7f867009b4c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86881038c0 0x7f868819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688066bf0 0x7f8688195b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 --2- 172.21.15.80:0/3685989629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8688100dd0 0x7f8688196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 >> 172.21.15.80:0/3685989629 conn(0x7f86880f82a0 msgr2=0x7f86880ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 shutdown_connections 2022-09-07T19:41:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:29.077+0000 7f868d7ff700 1 -- 172.21.15.80:0/3685989629 wait complete. 2022-09-07T19:41:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 1 2022-09-07T19:41:29.196 INFO:journalctl@ceph.mds.l.smithi155.stdout:Sep 07 19:41:29 smithi155 systemd[1]: Starting Ceph mds.l for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:29.554 INFO:journalctl@ceph.mds.l.smithi155.stdout:Sep 07 19:41:29 smithi155 podman[124344]: 2022-09-07T19:41:29.555 INFO:journalctl@ceph.mds.l.smithi155.stdout:Sep 07 19:41:29 smithi155 bash[124344]: 541684929c633bac34e54e88941eaedd86c70a60010389f356b8998abfb02d70 2022-09-07T19:41:29.555 INFO:journalctl@ceph.mds.l.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mds[124384]: -- 172.21.15.155:0/1317455836 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e422fa4820 con 0x55e422f78c00 2022-09-07T19:41:29.555 INFO:journalctl@ceph.mds.l.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-l[124360]: starting mds.l at 2022-09-07T19:41:29.556 INFO:journalctl@ceph.mds.l.smithi155.stdout:Sep 07 19:41:29 smithi155 systemd[1]: Started Ceph mds.l for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:29.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:29 smithi080 ceph-mon[90124]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:29.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:29 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4082582654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:41:29.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:29 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3685989629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:29.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:29 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.155:6832/4090687760,v1:172.21.15.155:6833/4090687760] up:boot 2022-09-07T19:41:29.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:29 smithi080 ceph-mon[90124]: fsmap 1 up:standby 2022-09-07T19:41:29.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:29 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2022-09-07T19:41:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:29 smithi154 ceph-mon[96967]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:29 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4082582654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:41:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:29 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3685989629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:29.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:29 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.155:6832/4090687760,v1:172.21.15.155:6833/4090687760] up:boot 2022-09-07T19:41:29.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:29 smithi154 ceph-mon[96967]: fsmap 1 up:standby 2022-09-07T19:41:29.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:29 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2022-09-07T19:41:29.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mon[97606]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4082582654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:41:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3685989629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.155:6832/4090687760,v1:172.21.15.155:6833/4090687760] up:boot 2022-09-07T19:41:29.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mon[97606]: fsmap 1 up:standby 2022-09-07T19:41:29.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:29 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2022-09-07T19:41:30.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:30 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:30.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:30 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:30.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:30 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:30.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:30 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:30.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:30 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:30.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:30 smithi154 ceph-mon[96967]: Deploying daemon mds.k on smithi154 2022-09-07T19:41:30.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:30.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:30.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:30.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:30.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:30 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:30.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:30 smithi080 ceph-mon[90124]: Deploying daemon mds.k on smithi154 2022-09-07T19:41:30.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:30.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:30.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:30.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:30.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:30 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:30.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:30 smithi155 ceph-mon[97606]: Deploying daemon mds.k on smithi154 2022-09-07T19:41:31.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:31.123 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 07 19:41:31 smithi154 systemd[1]: Starting Ceph mds.k for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:31.336 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.336+0000 7f270499d700 1 -- 172.21.15.80:0/390625267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fdb70 msgr2=0x7f27000fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:31.336 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.336+0000 7f270499d700 1 --2- 172.21.15.80:0/390625267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fdb70 0x7f27000fdf80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009810 tx=0x7f26f0009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:31.337 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 -- 172.21.15.80:0/390625267 shutdown_connections 2022-09-07T19:41:31.337 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 --2- 172.21.15.80:0/390625267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27000ff540 0x7f27001060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.337 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 --2- 172.21.15.80:0/390625267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fdb70 0x7f27000fdf80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.338 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 --2- 172.21.15.80:0/390625267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27000fe4c0 0x7f27000feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.338 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 -- 172.21.15.80:0/390625267 >> 172.21.15.80:0/390625267 conn(0x7f27000f9260 msgr2=0x7f27000fb690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:31.338 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 -- 172.21.15.80:0/390625267 shutdown_connections 2022-09-07T19:41:31.339 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.337+0000 7f270499d700 1 -- 172.21.15.80:0/390625267 wait complete. 2022-09-07T19:41:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 Processor -- start 2022-09-07T19:41:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 -- start start 2022-09-07T19:41:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27000fdb70 0x7f2700072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 0x7f27000710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27000ff540 0x7f2700071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700071e10 con 0x7f27000fdb70 2022-09-07T19:41:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700071f80 con 0x7f27000fe4c0 2022-09-07T19:41:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.338+0000 7f270499d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270019d800 con 0x7f27000ff540 2022-09-07T19:41:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 0x7f27000710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 0x7f27000710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:55674/0 (socket says 172.21.15.80:55674) 2022-09-07T19:41:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 -- 172.21.15.80:0/4237952814 learned_addr learned my addr 172.21.15.80:0/4237952814 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27000fdb70 0x7f2700072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26fffff700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27000ff540 0x7f2700071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 -- 172.21.15.80:0/4237952814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27000ff540 msgr2=0x7f2700071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27000ff540 0x7f2700071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 -- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27000fdb70 msgr2=0x7f2700072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27000fdb70 0x7f2700072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 -- 172.21.15.80:0/4237952814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0009470 con 0x7f27000fe4c0 2022-09-07T19:41:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.339+0000 7f26feffd700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 0x7f27000710d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26f400e710 tx=0x7f26f400ea20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.340+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4009500 con 0x7f27000fe4c0 2022-09-07T19:41:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.340+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f26f4010da0 con 0x7f27000fe4c0 2022-09-07T19:41:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.340+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270019dae0 con 0x7f27000fe4c0 2022-09-07T19:41:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.340+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400f420 con 0x7f27000fe4c0 2022-09-07T19:41:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.340+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270019dff0 con 0x7f27000fe4c0 2022-09-07T19:41:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.341+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700109360 con 0x7f27000fe4c0 2022-09-07T19:41:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.342+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f26f400c040 con 0x7f27000fe4c0 2022-09-07T19:41:31.348 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.344+0000 7f26fcff9700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f26e8099010 0x7f26e809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:31.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.344+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f26f4014070 con 0x7f27000fe4c0 2022-09-07T19:41:31.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.344+0000 7f26ff7fe700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f26e8099010 0x7f26e809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:31.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.345+0000 7f26ff7fe700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f26e8099010 0x7f26e809b4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b4f0 tx=0x7f26f0009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:31.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.346+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f26f408ec70 con 0x7f27000fe4c0 2022-09-07T19:41:31.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.584+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27001094f0 con 0x7f27000fe4c0 2022-09-07T19:41:31.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.585+0000 7f26fcff9700 1 -- 172.21.15.80:0/4237952814 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f27001094f0 con 0x7f27000fe4c0 2022-09-07T19:41:31.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:31.585 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2022-09-07T19:41:31.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f26e8099010 msgr2=0x7f26e809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:31.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f26e8099010 0x7f26e809b4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b4f0 tx=0x7f26f0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 msgr2=0x7f27000710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:31.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 0x7f27000710d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26f400e710 tx=0x7f26f400ea20 comp rx=0 tx=0).stop 2022-09-07T19:41:31.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 shutdown_connections 2022-09-07T19:41:31.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27000fdb70 0x7f2700072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f26e8099010 0x7f26e809b4c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27000ff540 0x7f2700071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 --2- 172.21.15.80:0/4237952814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27000fe4c0 0x7f27000710d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:31.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 >> 172.21.15.80:0/4237952814 conn(0x7f27000f9260 msgr2=0x7f27000fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:31.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 shutdown_connections 2022-09-07T19:41:31.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:31.588+0000 7f270499d700 1 -- 172.21.15.80:0/4237952814 wait complete. 2022-09-07T19:41:31.591 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 2 2022-09-07T19:41:31.618 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:31 smithi154 ceph-mon[96967]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:31.618 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 07 19:41:31 smithi154 podman[122700]: 2022-09-07T19:41:31.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:31 smithi080 ceph-mon[90124]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:31.873 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 07 19:41:31 smithi154 bash[122700]: ce65e3319fa916e95075d7f17b0bd276e76044702e05749dc1fe137a64f659a6 2022-09-07T19:41:31.873 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 07 19:41:31 smithi154 ceph-mds[122738]: -- 172.21.15.154:0/3831877312 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7cc7c2820 con 0x55a7cc797000 2022-09-07T19:41:31.874 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 07 19:41:31 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-k[122716]: starting mds.k at 2022-09-07T19:41:31.874 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 07 19:41:31 smithi154 systemd[1]: Started Ceph mds.k for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:31.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:31 smithi155 ceph-mon[97606]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:32.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:32 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4237952814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:32.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:32.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:32.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:32.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:32.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:32 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:32 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4237952814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:32.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:32.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:32 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:32.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:32 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4237952814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:32.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:32.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:32.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:32.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:32.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:32 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:33.615 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:33.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:33 smithi080 ceph-mon[90124]: Deploying daemon mds.j on smithi080 2022-09-07T19:41:33.892 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:33 smithi080 ceph-mon[90124]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:33.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:33 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.154:6832/788391399,v1:172.21.15.154:6833/788391399] up:boot 2022-09-07T19:41:33.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:33 smithi080 ceph-mon[90124]: fsmap 2 up:standby 2022-09-07T19:41:33.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:33 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2022-09-07T19:41:33.894 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:33 smithi154 ceph-mon[96967]: Deploying daemon mds.j on smithi080 2022-09-07T19:41:33.895 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:33 smithi154 ceph-mon[96967]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:33.895 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:33 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.154:6832/788391399,v1:172.21.15.154:6833/788391399] up:boot 2022-09-07T19:41:33.896 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:33 smithi154 ceph-mon[96967]: fsmap 2 up:standby 2022-09-07T19:41:33.896 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:33 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2022-09-07T19:41:33.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:33 smithi155 ceph-mon[97606]: Deploying daemon mds.j on smithi080 2022-09-07T19:41:33.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:33 smithi155 ceph-mon[97606]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:33.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:33 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.154:6832/788391399,v1:172.21.15.154:6833/788391399] up:boot 2022-09-07T19:41:33.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:33 smithi155 ceph-mon[97606]: fsmap 2 up:standby 2022-09-07T19:41:33.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:33 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2022-09-07T19:41:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 -- 172.21.15.80:0/1079871117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c101750 msgr2=0x7ff71c101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:34.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1079871117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c101750 0x7ff71c101bc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff714009bb0 tx=0x7ff714009ec0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 -- 172.21.15.80:0/1079871117 shutdown_connections 2022-09-07T19:41:34.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1079871117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fc430 0x7ff71c0fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1079871117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c101750 0x7ff71c101bc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1079871117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff71c0fed90 0x7ff71c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.101+0000 7ff71b59e700 1 -- 172.21.15.80:0/1079871117 >> 172.21.15.80:0/1079871117 conn(0x7ff71c0f8160 msgr2=0x7ff71c0fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:34.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.102+0000 7ff71b59e700 1 -- 172.21.15.80:0/1079871117 shutdown_connections 2022-09-07T19:41:34.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.102+0000 7ff71b59e700 1 -- 172.21.15.80:0/1079871117 wait complete. 2022-09-07T19:41:34.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.104+0000 7ff71b59e700 1 Processor -- start 2022-09-07T19:41:34.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.104+0000 7ff71b59e700 1 -- start start 2022-09-07T19:41:34.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.105+0000 7ff71b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c0fc430 0x7ff71c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:34.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.105+0000 7ff71b59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 0x7ff71c069040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:34.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.105+0000 7ff71b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff71c101750 0x7ff71c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:34.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.105+0000 7ff71b59e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c070680 con 0x7ff71c0fed90 2022-09-07T19:41:34.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.105+0000 7ff71b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0707f0 con 0x7ff71c101750 2022-09-07T19:41:34.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.105+0000 7ff71b59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0709b0 con 0x7ff71c0fc430 2022-09-07T19:41:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.106+0000 7ff71ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff71c101750 0x7ff71c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.106+0000 7ff71a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c0fc430 0x7ff71c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:34.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.106+0000 7ff719d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 0x7ff71c069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:34.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.106+0000 7ff719d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 0x7ff71c069040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39290/0 (socket says 172.21.15.80:39290) 2022-09-07T19:41:34.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.106+0000 7ff719d9b700 1 -- 172.21.15.80:0/1221230884 learned_addr learned my addr 172.21.15.80:0/1221230884 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.107+0000 7ff719d9b700 1 -- 172.21.15.80:0/1221230884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c0fc430 msgr2=0x7ff71c068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:34.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.107+0000 7ff719d9b700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c0fc430 0x7ff71c068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.107+0000 7ff719d9b700 1 -- 172.21.15.80:0/1221230884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff71c101750 msgr2=0x7ff71c0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:34.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.107+0000 7ff719d9b700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff71c101750 0x7ff71c0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.107+0000 7ff719d9b700 1 -- 172.21.15.80:0/1221230884 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140097e0 con 0x7ff71c0fed90 2022-09-07T19:41:34.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.108+0000 7ff719d9b700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 0x7ff71c069040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00b3c0 tx=0x7ff70c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.115+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c011830 con 0x7ff71c0fed90 2022-09-07T19:41:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.115+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff70c011e30 con 0x7ff71c0fed90 2022-09-07T19:41:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.115+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00f2e0 con 0x7ff71c0fed90 2022-09-07T19:41:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.120+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c070c90 con 0x7ff71c0fed90 2022-09-07T19:41:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.120+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c1aad50 con 0x7ff71c0fed90 2022-09-07T19:41:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.126+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ff70c00f050 con 0x7ff71c0fed90 2022-09-07T19:41:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.128+0000 7ff70b7fe700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff704099210 0x7ff70409b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.129+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7ff70c0c1760 con 0x7ff71c0fed90 2022-09-07T19:41:34.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.130+0000 7ff71a59c700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff704099210 0x7ff70409b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.131+0000 7ff71a59c700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff704099210 0x7ff70409b6c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff71000a730 tx=0x7ff710008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:34.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.132+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c10f9d0 con 0x7ff71c0fed90 2022-09-07T19:41:34.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.140+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff70c08e250 con 0x7ff71c0fed90 2022-09-07T19:41:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.385+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff71c05f8f0 con 0x7ff71c0fed90 2022-09-07T19:41:34.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.386+0000 7ff70b7fe700 1 -- 172.21.15.80:0/1221230884 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7ff70c015090 con 0x7ff71c0fed90 2022-09-07T19:41:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:34.412 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-09-07T19:41:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff704099210 msgr2=0x7ff70409b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff704099210 0x7ff70409b6c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff71000a730 tx=0x7ff710008040 comp rx=0 tx=0).stop 2022-09-07T19:41:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 msgr2=0x7ff71c069040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 0x7ff71c069040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00b3c0 tx=0x7ff70c00b780 comp rx=0 tx=0).stop 2022-09-07T19:41:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 shutdown_connections 2022-09-07T19:41:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff704099210 0x7ff70409b6c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff71c101750 0x7ff71c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff71c0fc430 0x7ff71c068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 --2- 172.21.15.80:0/1221230884 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff71c0fed90 0x7ff71c069040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.388+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 >> 172.21.15.80:0/1221230884 conn(0x7ff71c0f8160 msgr2=0x7ff71c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.389+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 shutdown_connections 2022-09-07T19:41:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:34.389+0000 7ff71b59e700 1 -- 172.21.15.80:0/1221230884 wait complete. 2022-09-07T19:41:34.418 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2022-09-07T19:41:34.869 INFO:journalctl@ceph.mds.j.smithi080.stdout:Sep 07 19:41:34 smithi080 systemd[1]: Starting Ceph mds.j for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:35.256 INFO:journalctl@ceph.mds.j.smithi080.stdout:Sep 07 19:41:34 smithi080 podman[124248]: 2022-09-07T19:41:35.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:35 smithi080 ceph-mon[90124]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:35.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:35 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1221230884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:35.561 INFO:journalctl@ceph.mds.j.smithi080.stdout:Sep 07 19:41:35 smithi080 bash[124248]: 7f3b1f53fd540db68cafcde7cb90ff3cfaf35fa7cd66409dc18c1f0d3e2afa23 2022-09-07T19:41:35.561 INFO:journalctl@ceph.mds.j.smithi080.stdout:Sep 07 19:41:35 smithi080 ceph-mds[124288]: -- 172.21.15.80:0/319755743 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555566acc820 con 0x555566aa0800 2022-09-07T19:41:35.561 INFO:journalctl@ceph.mds.j.smithi080.stdout:Sep 07 19:41:35 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-j[124264]: starting mds.j at 2022-09-07T19:41:35.562 INFO:journalctl@ceph.mds.j.smithi080.stdout:Sep 07 19:41:35 smithi080 systemd[1]: Started Ceph mds.j for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:35 smithi154 ceph-mon[96967]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:35 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1221230884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:35 smithi155 ceph-mon[97606]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:35 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1221230884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:36.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 -- 172.21.15.80:0/1892251089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114100dd0 msgr2=0x7ff114103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/1892251089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114100dd0 0x7ff114103230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff108009750 tx=0x7ff108009a60 comp rx=0 tx=0).stop 2022-09-07T19:41:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 -- 172.21.15.80:0/1892251089 shutdown_connections 2022-09-07T19:41:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/1892251089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1141038c0 0x7ff114105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/1892251089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114066bf0 0x7ff114100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/1892251089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114100dd0 0x7ff114103230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 -- 172.21.15.80:0/1892251089 >> 172.21.15.80:0/1892251089 conn(0x7ff1140f82a0 msgr2=0x7ff1140fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:36.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 -- 172.21.15.80:0/1892251089 shutdown_connections 2022-09-07T19:41:36.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.655+0000 7ff11a9ff700 1 -- 172.21.15.80:0/1892251089 wait complete. 2022-09-07T19:41:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.656+0000 7ff11a9ff700 1 Processor -- start 2022-09-07T19:41:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 -- start start 2022-09-07T19:41:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 0x7ff114195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:36.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff114100dd0 0x7ff114196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:36.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1141038c0 0x7ff11419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:36.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11419d6d0 con 0x7ff114066bf0 2022-09-07T19:41:36.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11419d840 con 0x7ff114100dd0 2022-09-07T19:41:36.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff11a9ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11419da00 con 0x7ff1141038c0 2022-09-07T19:41:36.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff113fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 0x7ff114195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:36.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff113fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 0x7ff114195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39326/0 (socket says 172.21.15.80:39326) 2022-09-07T19:41:36.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff113fff700 1 -- 172.21.15.80:0/2671717830 learned_addr learned my addr 172.21.15.80:0/2671717830 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:36.664 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff118f9c700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1141038c0 0x7ff11419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:36.664 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.657+0000 7ff1137fe700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff114100dd0 0x7ff114196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:36.665 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff113fff700 1 -- 172.21.15.80:0/2671717830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1141038c0 msgr2=0x7ff11419d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:36.665 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff113fff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1141038c0 0x7ff11419d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff113fff700 1 -- 172.21.15.80:0/2671717830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff114100dd0 msgr2=0x7ff114196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff113fff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff114100dd0 0x7ff114196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.667 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff113fff700 1 -- 172.21.15.80:0/2671717830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0097e0 con 0x7ff114066bf0 2022-09-07T19:41:36.667 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff113fff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 0x7ff114195b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff10400e6e0 tx=0x7ff10400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:36.667 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104009500 con 0x7ff114066bf0 2022-09-07T19:41:36.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1080093b0 con 0x7ff114066bf0 2022-09-07T19:41:36.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff104010da0 con 0x7ff114066bf0 2022-09-07T19:41:36.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040173d0 con 0x7ff114066bf0 2022-09-07T19:41:36.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.658+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11419e060 con 0x7ff114066bf0 2022-09-07T19:41:36.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.659+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1141094d0 con 0x7ff114066bf0 2022-09-07T19:41:36.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.661+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ff10400c040 con 0x7ff114066bf0 2022-09-07T19:41:36.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.662+0000 7ff1117fa700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff0fc099010 0x7ff0fc09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:36.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.663+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7ff104014070 con 0x7ff114066bf0 2022-09-07T19:41:36.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.663+0000 7ff1137fe700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff0fc099010 0x7ff0fc09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:36.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.663+0000 7ff1137fe700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff0fc099010 0x7ff0fc09b4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff10800f500 tx=0x7ff108005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:36.672 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.670+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff10404fc80 con 0x7ff114066bf0 2022-09-07T19:41:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:36.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:36.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: Deploying daemon mds.d on smithi080 2022-09-07T19:41:36.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.80:6834/1459419816,v1:172.21.15.80:6835/1459419816] up:boot 2022-09-07T19:41:36.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: fsmap 3 up:standby 2022-09-07T19:41:36.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:36 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2022-09-07T19:41:36.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:36.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:36.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:36.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:36.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:36.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: Deploying daemon mds.d on smithi080 2022-09-07T19:41:36.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.80:6834/1459419816,v1:172.21.15.80:6835/1459419816] up:boot 2022-09-07T19:41:36.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: fsmap 3 up:standby 2022-09-07T19:41:36.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:36 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2022-09-07T19:41:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:36.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:36.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:36.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: Deploying daemon mds.d on smithi080 2022-09-07T19:41:36.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.80:6834/1459419816,v1:172.21.15.80:6835/1459419816] up:boot 2022-09-07T19:41:36.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: fsmap 3 up:standby 2022-09-07T19:41:36.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:36 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2022-09-07T19:41:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.927+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1140fdc90 con 0x7ff114066bf0 2022-09-07T19:41:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.928+0000 7ff1117fa700 1 -- 172.21.15.80:0/2671717830 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7ff10408ebc0 con 0x7ff114066bf0 2022-09-07T19:41:36.927 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:36.928 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-09-07T19:41:36.929 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff0fc099010 msgr2=0x7ff0fc09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:36.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff0fc099010 0x7ff0fc09b4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff10800f500 tx=0x7ff108005f90 comp rx=0 tx=0).stop 2022-09-07T19:41:36.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 msgr2=0x7ff114195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:36.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 0x7ff114195b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff10400e6e0 tx=0x7ff10400e9f0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 shutdown_connections 2022-09-07T19:41:36.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114066bf0 0x7ff114195b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff0fc099010 0x7ff0fc09b4c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1141038c0 0x7ff11419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 --2- 172.21.15.80:0/2671717830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff114100dd0 0x7ff114196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.930+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 >> 172.21.15.80:0/2671717830 conn(0x7ff1140f82a0 msgr2=0x7ff1140fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:36.933 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.931+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 shutdown_connections 2022-09-07T19:41:36.933 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:36.931+0000 7ff11a9ff700 1 -- 172.21.15.80:0/2671717830 wait complete. 2022-09-07T19:41:36.933 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 4 2022-09-07T19:41:37.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:37 smithi080 ceph-mon[90124]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:37.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:37 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2671717830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:37 smithi154 ceph-mon[96967]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:37.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:37 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2671717830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:37.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:37 smithi155 ceph-mon[97606]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:37 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2671717830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:38.619 INFO:journalctl@ceph.mds.d.smithi080.stdout:Sep 07 19:41:38 smithi080 systemd[1]: Starting Ceph mds.d for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:38.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:38.997 INFO:journalctl@ceph.mds.d.smithi080.stdout:Sep 07 19:41:38 smithi080 podman[124642]: 2022-09-07T19:41:39.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 -- 172.21.15.80:0/1860098451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 msgr2=0x7f6b28108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:39.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/1860098451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b28108400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009bb0 tx=0x7f6b20009ec0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 -- 172.21.15.80:0/1860098451 shutdown_connections 2022-09-07T19:41:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/1860098451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/1860098451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b28108400 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/1860098451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b281011b0 0x7f6b28101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 -- 172.21.15.80:0/1860098451 >> 172.21.15.80:0/1860098451 conn(0x7f6b280fb6b0 msgr2=0x7f6b280fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 -- 172.21.15.80:0/1860098451 shutdown_connections 2022-09-07T19:41:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.209+0000 7f6b2fdff700 1 -- 172.21.15.80:0/1860098451 wait complete. 2022-09-07T19:41:39.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.210+0000 7f6b2fdff700 1 Processor -- start 2022-09-07T19:41:39.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.210+0000 7f6b2fdff700 1 -- start start 2022-09-07T19:41:39.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.210+0000 7f6b2fdff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2fdff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b281011b0 0x7f6b28196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2fdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b2819d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2fdff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2819d660 con 0x7f6b280fff30 2022-09-07T19:41:39.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2fdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2819d7d0 con 0x7f6b28101b40 2022-09-07T19:41:39.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2fdff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2819d990 con 0x7f6b281011b0 2022-09-07T19:41:39.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:39.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39364/0 (socket says 172.21.15.80:39364) 2022-09-07T19:41:39.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 -- 172.21.15.80:0/4018213739 learned_addr learned my addr 172.21.15.80:0/4018213739 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:39.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2e39c700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b2819d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:39.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2d39a700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b281011b0 0x7f6b28196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:39.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 -- 172.21.15.80:0/4018213739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b281011b0 msgr2=0x7f6b28196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:39.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b281011b0 0x7f6b28196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 -- 172.21.15.80:0/4018213739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 msgr2=0x7f6b2819d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:39.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b2819d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2db9b700 1 -- 172.21.15.80:0/4018213739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200097e0 con 0x7f6b280fff30 2022-09-07T19:41:39.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.211+0000 7f6b2e39c700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b2819d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:41:39.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.212+0000 7f6b2db9b700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28195ae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400e710 tx=0x7f6b2400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:39.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.212+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24004220 con 0x7f6b280fff30 2022-09-07T19:41:39.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.212+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2819dc70 con 0x7f6b280fff30 2022-09-07T19:41:39.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.212+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6b24004380 con 0x7f6b280fff30 2022-09-07T19:41:39.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.212+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24003cf0 con 0x7f6b280fff30 2022-09-07T19:41:39.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.212+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2819e1d0 con 0x7f6b280fff30 2022-09-07T19:41:39.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.213+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2810b6f0 con 0x7f6b280fff30 2022-09-07T19:41:39.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.215+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f6b2401e020 con 0x7f6b280fff30 2022-09-07T19:41:39.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.216+0000 7f6b1effd700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6b14099010 0x7f6b1409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:39.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.216+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f6b24014070 con 0x7f6b280fff30 2022-09-07T19:41:39.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.216+0000 7f6b2d39a700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6b14099010 0x7f6b1409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:39.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.217+0000 7f6b2d39a700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6b14099010 0x7f6b1409b4c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6b18005fd0 tx=0x7f6b18005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:39.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.220+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f6b2408eca0 con 0x7f6b280fff30 2022-09-07T19:41:39.368 INFO:journalctl@ceph.mds.d.smithi080.stdout:Sep 07 19:41:38 smithi080 bash[124642]: d17ea1c6854d8d34088c955bb86b33dd76e6785caa400ea2afa788a15f46739c 2022-09-07T19:41:39.369 INFO:journalctl@ceph.mds.d.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mds[124682]: -- 172.21.15.80:0/4053679737 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55990b78e820 con 0x55990b763000 2022-09-07T19:41:39.369 INFO:journalctl@ceph.mds.d.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-d[124658]: starting mds.d at 2022-09-07T19:41:39.369 INFO:journalctl@ceph.mds.d.smithi080.stdout:Sep 07 19:41:39 smithi080 systemd[1]: Started Ceph mds.d for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:39.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.459+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b2819ea80 con 0x7f6b280fff30 2022-09-07T19:41:39.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.459+0000 7f6b1effd700 1 -- 172.21.15.80:0/4018213739 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f6b240922c0 con 0x7f6b280fff30 2022-09-07T19:41:39.464 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:39.464 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-09-07T19:41:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.461+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6b14099010 msgr2=0x7f6b1409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.461+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6b14099010 0x7f6b1409b4c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6b18005fd0 tx=0x7f6b18005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 msgr2=0x7f6b28195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28195ae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400e710 tx=0x7f6b2400ea20 comp rx=0 tx=0).stop 2022-09-07T19:41:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 shutdown_connections 2022-09-07T19:41:39.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b280fff30 0x7f6b28195ae0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6b14099010 0x7f6b1409b4c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b28101b40 0x7f6b2819d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 --2- 172.21.15.80:0/4018213739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b281011b0 0x7f6b28196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 >> 172.21.15.80:0/4018213739 conn(0x7f6b280fb6b0 msgr2=0x7f6b280fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 shutdown_connections 2022-09-07T19:41:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:39.462+0000 7f6b2fdff700 1 -- 172.21.15.80:0/4018213739 wait complete. 2022-09-07T19:41:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 4 2022-09-07T19:41:39.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:39.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:39.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:39.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:39.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:39.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:39.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:39 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4018213739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:39.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:39.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:39.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:39.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:39.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:39.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:39.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:39 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4018213739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:39.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:39.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:39.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:39 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4018213739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:40 smithi154 ceph-mon[96967]: Deploying daemon mds.e on smithi154 2022-09-07T19:41:40.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:40 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.80:6836/1565389450,v1:172.21.15.80:6837/1565389450] up:boot 2022-09-07T19:41:40.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:40 smithi154 ceph-mon[96967]: fsmap 4 up:standby 2022-09-07T19:41:40.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:40 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2022-09-07T19:41:40.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:40 smithi080 ceph-mon[90124]: Deploying daemon mds.e on smithi154 2022-09-07T19:41:40.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:40 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.80:6836/1565389450,v1:172.21.15.80:6837/1565389450] up:boot 2022-09-07T19:41:40.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:40 smithi080 ceph-mon[90124]: fsmap 4 up:standby 2022-09-07T19:41:40.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:40 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2022-09-07T19:41:40.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:40 smithi155 ceph-mon[97606]: Deploying daemon mds.e on smithi154 2022-09-07T19:41:40.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:40 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.80:6836/1565389450,v1:172.21.15.80:6837/1565389450] up:boot 2022-09-07T19:41:40.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:40 smithi155 ceph-mon[97606]: fsmap 4 up:standby 2022-09-07T19:41:40.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:40 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2022-09-07T19:41:41.123 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 07 19:41:40 smithi154 systemd[1]: Starting Ceph mds.e for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:41.457 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 07 19:41:41 smithi154 podman[123042]: 2022-09-07T19:41:41.457 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 07 19:41:41 smithi154 bash[123042]: 61e0a479db134938f8c80a51e2bb68cc351881c0c0ed7c56d827a35ad27d5a81 2022-09-07T19:41:41.457 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mds[123082]: -- 172.21.15.154:0/2887184809 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55613d4d2820 con 0x55613d4a7000 2022-09-07T19:41:41.458 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-e[123058]: starting mds.e at 2022-09-07T19:41:41.490 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.730+0000 7f397dbff700 1 -- 172.21.15.80:0/1304638037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780fdd40 msgr2=0x7f39780fe150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.730+0000 7f397dbff700 1 --2- 172.21.15.80:0/1304638037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780fdd40 0x7f39780fe150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3968009810 tx=0x7f3968009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 -- 172.21.15.80:0/1304638037 shutdown_connections 2022-09-07T19:41:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 --2- 172.21.15.80:0/1304638037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39780ff950 0x7f3978106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 --2- 172.21.15.80:0/1304638037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780fdd40 0x7f39780fe150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 --2- 172.21.15.80:0/1304638037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fefc0 0x7f39780ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 -- 172.21.15.80:0/1304638037 >> 172.21.15.80:0/1304638037 conn(0x7f39780f9430 msgr2=0x7f39780fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 -- 172.21.15.80:0/1304638037 shutdown_connections 2022-09-07T19:41:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.731+0000 7f397dbff700 1 -- 172.21.15.80:0/1304638037 wait complete. 2022-09-07T19:41:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 Processor -- start 2022-09-07T19:41:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 -- start start 2022-09-07T19:41:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 0x7f3978103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39780fefc0 0x7f3978104090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780ff950 0x7f3978100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978100ee0 con 0x7f39780fefc0 2022-09-07T19:41:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978101050 con 0x7f39780ff950 2022-09-07T19:41:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.732+0000 7f397dbff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978101210 con 0x7f39780fdd40 2022-09-07T19:41:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 0x7f3978103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 0x7f3978103b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:58250/0 (socket says 172.21.15.80:58250) 2022-09-07T19:41:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 -- 172.21.15.80:0/3210128963 learned_addr learned my addr 172.21.15.80:0/3210128963 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f3977fff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780ff950 0x7f3978100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:41.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f3976ffd700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39780fefc0 0x7f3978104090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:41.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 -- 172.21.15.80:0/3210128963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780ff950 msgr2=0x7f3978100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780ff950 0x7f3978100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 -- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39780fefc0 msgr2=0x7f3978104090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:41.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39780fefc0 0x7f3978104090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 -- 172.21.15.80:0/3210128963 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009470 con 0x7f39780fdd40 2022-09-07T19:41:41.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f39777fe700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 0x7f3978103b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3968006010 tx=0x7f396800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:41.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.733+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396801d070 con 0x7f39780fdd40 2022-09-07T19:41:41.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.734+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39781a2080 con 0x7f39780fdd40 2022-09-07T19:41:41.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.734+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f396800f8b0 con 0x7f39780fdd40 2022-09-07T19:41:41.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.734+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39680047f0 con 0x7f39780fdd40 2022-09-07T19:41:41.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.734+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39781a24d0 con 0x7f39780fdd40 2022-09-07T19:41:41.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.735+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39781094f0 con 0x7f39780fdd40 2022-09-07T19:41:41.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.736+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f3968028030 con 0x7f39780fdd40 2022-09-07T19:41:41.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.737+0000 7f3974ff9700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3960099010 0x7f396009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:41.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.738+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f39680c2c10 con 0x7f39780fdd40 2022-09-07T19:41:41.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.738+0000 7f3976ffd700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3960099010 0x7f396009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:41.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.738+0000 7f3976ffd700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3960099010 0x7f396009b4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f396c005fd0 tx=0x7f396c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:41.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.741+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f396808f700 con 0x7f39780fdd40 2022-09-07T19:41:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:41 smithi080 ceph-mon[90124]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:41 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:41.873 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 07 19:41:41 smithi154 systemd[1]: Started Ceph mds.e for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mon[96967]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:41 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:41.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:41 smithi155 ceph-mon[97606]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:41.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:41.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:41.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:41.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:41.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:41 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.982+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f397805f120 con 0x7f39780fdd40 2022-09-07T19:41:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.983+0000 7f3974ff9700 1 -- 172.21.15.80:0/3210128963 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4291 (secure 0 0 0) 0x7f3968092d20 con 0x7f39780fdd40 2022-09-07T19:41:41.983 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:41.983 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2022-09-07T19:41:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3960099010 msgr2=0x7f396009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3960099010 0x7f396009b4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f396c005fd0 tx=0x7f396c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 msgr2=0x7f3978103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 0x7f3978103b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3968006010 tx=0x7f396800f690 comp rx=0 tx=0).stop 2022-09-07T19:41:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 shutdown_connections 2022-09-07T19:41:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3960099010 0x7f396009b4c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39780ff950 0x7f3978100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39780fdd40 0x7f3978103b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.988 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 --2- 172.21.15.80:0/3210128963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39780fefc0 0x7f3978104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:41.988 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 >> 172.21.15.80:0/3210128963 conn(0x7f39780f9430 msgr2=0x7f3978104940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:41.988 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 shutdown_connections 2022-09-07T19:41:41.988 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:41.986+0000 7f397dbff700 1 -- 172.21.15.80:0/3210128963 wait complete. 2022-09-07T19:41:41.989 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2022-09-07T19:41:42.756 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: Deploying daemon mds.f on smithi155 2022-09-07T19:41:42.756 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.154:6834/1088711156,v1:172.21.15.154:6835/1088711156] up:boot 2022-09-07T19:41:42.757 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: fsmap 5 up:standby 2022-09-07T19:41:42.757 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2022-09-07T19:41:42.758 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:41:42.758 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:41:42.759 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:42 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3210128963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: Deploying daemon mds.f on smithi155 2022-09-07T19:41:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.154:6834/1088711156,v1:172.21.15.154:6835/1088711156] up:boot 2022-09-07T19:41:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: fsmap 5 up:standby 2022-09-07T19:41:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2022-09-07T19:41:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:41:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:41:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:42 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3210128963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: Deploying daemon mds.f on smithi155 2022-09-07T19:41:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.154:6834/1088711156,v1:172.21.15.154:6835/1088711156] up:boot 2022-09-07T19:41:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: fsmap 5 up:standby 2022-09-07T19:41:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2022-09-07T19:41:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:41:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:41:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:42 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3210128963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:43.197 INFO:journalctl@ceph.mds.f.smithi155.stdout:Sep 07 19:41:42 smithi155 systemd[1]: Starting Ceph mds.f for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:43.576 INFO:journalctl@ceph.mds.f.smithi155.stdout:Sep 07 19:41:43 smithi155 podman[124684]: 2022-09-07T19:41:43.576 INFO:journalctl@ceph.mds.f.smithi155.stdout:Sep 07 19:41:43 smithi155 bash[124684]: 65f9ef623a941b90957da727038ac45976179a58d57a27c1f49aba491340ee3c 2022-09-07T19:41:43.577 INFO:journalctl@ceph.mds.f.smithi155.stdout:Sep 07 19:41:43 smithi155 ceph-mds[124723]: -- 172.21.15.155:0/4215804438 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d136b3e820 con 0x55d136b12800 2022-09-07T19:41:43.577 INFO:journalctl@ceph.mds.f.smithi155.stdout:Sep 07 19:41:43 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-f[124700]: starting mds.f at 2022-09-07T19:41:43.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:43 smithi080 ceph-mon[90124]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:43 smithi154 ceph-mon[96967]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:43.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:43 smithi155 ceph-mon[97606]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:43.947 INFO:journalctl@ceph.mds.f.smithi155.stdout:Sep 07 19:41:43 smithi155 systemd[1]: Started Ceph mds.f for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:44.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:44.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 -- 172.21.15.80:0/428987644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 msgr2=0x7f613c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:44.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 --2- 172.21.15.80:0/428987644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c100890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6138009810 tx=0x7f6138009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:44.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 -- 172.21.15.80:0/428987644 shutdown_connections 2022-09-07T19:41:44.252 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 --2- 172.21.15.80:0/428987644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c100890 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.252 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 --2- 172.21.15.80:0/428987644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c1038c0 0x7f613c105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.252 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 --2- 172.21.15.80:0/428987644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c100dd0 0x7f613c103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.253 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 -- 172.21.15.80:0/428987644 >> 172.21.15.80:0/428987644 conn(0x7f613c0f82a0 msgr2=0x7f613c0fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:44.253 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 -- 172.21.15.80:0/428987644 shutdown_connections 2022-09-07T19:41:44.253 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.246+0000 7f61447ff700 1 -- 172.21.15.80:0/428987644 wait complete. 2022-09-07T19:41:44.253 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.247+0000 7f61447ff700 1 Processor -- start 2022-09-07T19:41:44.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 -- start start 2022-09-07T19:41:44.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:44.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c100dd0 0x7f613c1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:44.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c1038c0 0x7f613c19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:44.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c19d6e0 con 0x7f613c066bf0 2022-09-07T19:41:44.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c19d850 con 0x7f613c100dd0 2022-09-07T19:41:44.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f61447ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c19da10 con 0x7f613c1038c0 2022-09-07T19:41:44.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f614259b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:44.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f614259b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52822/0 (socket says 172.21.15.80:52822) 2022-09-07T19:41:44.256 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f614259b700 1 -- 172.21.15.80:0/872425954 learned_addr learned my addr 172.21.15.80:0/872425954 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:44.256 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f6142d9c700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c1038c0 0x7f613c19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:44.256 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.248+0000 7f6141d9a700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c100dd0 0x7f613c1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:44.256 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f6142d9c700 1 -- 172.21.15.80:0/872425954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c100dd0 msgr2=0x7f613c1960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:44.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f6142d9c700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c100dd0 0x7f613c1960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f6142d9c700 1 -- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 msgr2=0x7f613c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:44.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f6142d9c700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f6142d9c700 1 -- 172.21.15.80:0/872425954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138009470 con 0x7f613c1038c0 2022-09-07T19:41:44.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f614259b700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:41:44.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f6142d9c700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c1038c0 0x7f613c19d110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f613400eab0 tx=0x7f613400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:44.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340098c0 con 0x7f613c1038c0 2022-09-07T19:41:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c19dcf0 con 0x7f613c1038c0 2022-09-07T19:41:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f613400ce10 con 0x7f613c1038c0 2022-09-07T19:41:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.249+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134004280 con 0x7f613c1038c0 2022-09-07T19:41:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.250+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c19e1b0 con 0x7f613c1038c0 2022-09-07T19:41:44.260 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.250+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c109490 con 0x7f613c1038c0 2022-09-07T19:41:44.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.252+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f613400c040 con 0x7f613c1038c0 2022-09-07T19:41:44.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.253+0000 7f61337fe700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6128099010 0x7f612809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:44.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.254+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f6134014070 con 0x7f613c1038c0 2022-09-07T19:41:44.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.254+0000 7f614259b700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6128099010 0x7f612809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:44.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.254+0000 7f614259b700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6128099010 0x7f612809b4c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f613800b4f0 tx=0x7f6138009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:44.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.256+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f613408f330 con 0x7f613c1038c0 2022-09-07T19:41:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.495+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613c0fdc70 con 0x7f613c1038c0 2022-09-07T19:41:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.495+0000 7f61337fe700 1 -- 172.21.15.80:0/872425954 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f6134092950 con 0x7f613c1038c0 2022-09-07T19:41:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:44.496 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2022-09-07T19:41:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6128099010 msgr2=0x7f612809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6128099010 0x7f612809b4c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f613800b4f0 tx=0x7f6138009eb0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c1038c0 msgr2=0x7f613c19d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c1038c0 0x7f613c19d110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f613400eab0 tx=0x7f613400edc0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 shutdown_connections 2022-09-07T19:41:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f613c066bf0 0x7f613c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6128099010 0x7f612809b4c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f613c1038c0 0x7f613c19d110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 --2- 172.21.15.80:0/872425954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c100dd0 0x7f613c1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 >> 172.21.15.80:0/872425954 conn(0x7f613c0f82a0 msgr2=0x7f613c0fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 shutdown_connections 2022-09-07T19:41:44.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:44.498+0000 7f61447ff700 1 -- 172.21.15.80:0/872425954 wait complete. 2022-09-07T19:41:44.501 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2022-09-07T19:41:44.863 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.155:6834/1281093891,v1:172.21.15.155:6835/1281093891] up:boot 2022-09-07T19:41:44.864 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: fsmap 6 up:standby 2022-09-07T19:41:44.864 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2022-09-07T19:41:44.864 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:44.865 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:44.865 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:44.866 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:44.866 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:44.866 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: Deploying daemon mds.c on smithi155 2022-09-07T19:41:44.867 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:44.867 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:44 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/872425954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.155:6834/1281093891,v1:172.21.15.155:6835/1281093891] up:boot 2022-09-07T19:41:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: fsmap 6 up:standby 2022-09-07T19:41:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2022-09-07T19:41:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:44.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:44.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:44.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:44.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: Deploying daemon mds.c on smithi155 2022-09-07T19:41:44.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:44.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:44 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/872425954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.155:6834/1281093891,v1:172.21.15.155:6835/1281093891] up:boot 2022-09-07T19:41:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: fsmap 6 up:standby 2022-09-07T19:41:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2022-09-07T19:41:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:44.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:44.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:44.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:44.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:44.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: Deploying daemon mds.c on smithi155 2022-09-07T19:41:44.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:44.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:44 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/872425954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:45.113 INFO:journalctl@ceph.mds.c.smithi155.stdout:Sep 07 19:41:45 smithi155 systemd[1]: Starting Ceph mds.c for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:45.640 INFO:journalctl@ceph.mds.c.smithi155.stdout:Sep 07 19:41:45 smithi155 podman[125027]: 2022-09-07T19:41:45.946 INFO:journalctl@ceph.mds.c.smithi155.stdout:Sep 07 19:41:45 smithi155 bash[125027]: 953077ae56b5a237463c002de8fe5e291f4c641977f007d3a5c0463b04c54277 2022-09-07T19:41:45.946 INFO:journalctl@ceph.mds.c.smithi155.stdout:Sep 07 19:41:45 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-c[125043]: starting mds.c at 2022-09-07T19:41:45.947 INFO:journalctl@ceph.mds.c.smithi155.stdout:Sep 07 19:41:45 smithi155 systemd[1]: Started Ceph mds.c for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:46.526 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 -- 172.21.15.80:0/3040064231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800073570 msgr2=0x7fb800073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 --2- 172.21.15.80:0/3040064231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800073570 0x7fb800073980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009810 tx=0x7fb7f0009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:46.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 -- 172.21.15.80:0/3040064231 shutdown_connections 2022-09-07T19:41:46.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 --2- 172.21.15.80:0/3040064231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800073570 0x7fb800073980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:46.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 --2- 172.21.15.80:0/3040064231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800074f50 0x7fb800075b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:46.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 --2- 172.21.15.80:0/3040064231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb8000748e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:46.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 -- 172.21.15.80:0/3040064231 >> 172.21.15.80:0/3040064231 conn(0x7fb8000fb4d0 msgr2=0x7fb8000fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:46.764 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 -- 172.21.15.80:0/3040064231 shutdown_connections 2022-09-07T19:41:46.764 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.762+0000 7fb804b9d700 1 -- 172.21.15.80:0/3040064231 wait complete. 2022-09-07T19:41:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 Processor -- start 2022-09-07T19:41:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 -- start start 2022-09-07T19:41:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800073570 0x7fb800199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:46.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb80019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:46.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800074f50 0x7fb8001a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:46.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001a18c0 con 0x7fb800074f50 2022-09-07T19:41:46.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001a1a30 con 0x7fb800073ec0 2022-09-07T19:41:46.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb804b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001a1bf0 con 0x7fb800073570 2022-09-07T19:41:46.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb7feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb80019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:46.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800074f50 0x7fb8001a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:46.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb7ff7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800073570 0x7fb800199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:46.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb7feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb80019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:59838/0 (socket says 172.21.15.80:59838) 2022-09-07T19:41:46.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.764+0000 7fb7feffd700 1 -- 172.21.15.80:0/2581914660 learned_addr learned my addr 172.21.15.80:0/2581914660 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:46.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7feffd700 1 -- 172.21.15.80:0/2581914660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800073570 msgr2=0x7fb800199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:46.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7feffd700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800073570 0x7fb800199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:46.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7feffd700 1 -- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800074f50 msgr2=0x7fb8001a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:46.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7feffd700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800074f50 0x7fb8001a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:46.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7feffd700 1 -- 172.21.15.80:0/2581914660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009470 con 0x7fb800073ec0 2022-09-07T19:41:46.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7fffff700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800074f50 0x7fb8001a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:41:46.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7feffd700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb80019a280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400e740 tx=0x7fb7f400ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:46.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4005220 con 0x7fb800073ec0 2022-09-07T19:41:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb7f4005380 con 0x7fb800073ec0 2022-09-07T19:41:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8001a1ed0 con 0x7fb800073ec0 2022-09-07T19:41:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.765+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4004b70 con 0x7fb800073ec0 2022-09-07T19:41:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.766+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8001a23a0 con 0x7fb800073ec0 2022-09-07T19:41:46.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.767+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80010f9b0 con 0x7fb800073ec0 2022-09-07T19:41:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.768+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fb7f401e020 con 0x7fb800073ec0 2022-09-07T19:41:46.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.769+0000 7fb7fcff9700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7e8099090 0x7fb7e809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.770+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7fb7f4014070 con 0x7fb800073ec0 2022-09-07T19:41:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.770+0000 7fb7ff7fe700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7e8099090 0x7fb7e809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.770+0000 7fb7ff7fe700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7e8099090 0x7fb7e809b540 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0000c00 tx=0x7fb7f0009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:46.773+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb7f408eb80 con 0x7fb800073ec0 2022-09-07T19:41:46.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.155:6836/415293574,v1:172.21.15.155:6837/415293574] up:boot 2022-09-07T19:41:46.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: fsmap 7 up:standby 2022-09-07T19:41:46.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2022-09-07T19:41:46.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:46.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:46.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:46.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:46.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:46.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: Deploying daemon mds.h on smithi154 2022-09-07T19:41:46.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:46 smithi080 ceph-mon[90124]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:46.997 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.155:6836/415293574,v1:172.21.15.155:6837/415293574] up:boot 2022-09-07T19:41:46.998 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: fsmap 7 up:standby 2022-09-07T19:41:46.998 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2022-09-07T19:41:46.999 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:46.999 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:46.999 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:46.999 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:47.000 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:47.000 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: Deploying daemon mds.h on smithi154 2022-09-07T19:41:47.000 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:46 smithi154 ceph-mon[96967]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.011+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb80005f120 con 0x7fb800073ec0 2022-09-07T19:41:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.012+0000 7fb7fcff9700 1 -- 172.21.15.80:0/2581914660 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7fb7f40921a0 con 0x7fb800073ec0 2022-09-07T19:41:47.011 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:47.012 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2022-09-07T19:41:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7e8099090 msgr2=0x7fb7e809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7e8099090 0x7fb7e809b540 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0000c00 tx=0x7fb7f0009e70 comp rx=0 tx=0).stop 2022-09-07T19:41:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 msgr2=0x7fb80019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb80019a280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400e740 tx=0x7fb7f400ea50 comp rx=0 tx=0).stop 2022-09-07T19:41:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 shutdown_connections 2022-09-07T19:41:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb800074f50 0x7fb8001a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7e8099090 0x7fb7e809b540 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:47.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800073570 0x7fb800199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:47.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 --2- 172.21.15.80:0/2581914660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb800073ec0 0x7fb80019a280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:47.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.014+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 >> 172.21.15.80:0/2581914660 conn(0x7fb8000fb4d0 msgr2=0x7fb8000fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:47.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.015+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 shutdown_connections 2022-09-07T19:41:47.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:47.015+0000 7fb804b9d700 1 -- 172.21.15.80:0/2581914660 wait complete. 2022-09-07T19:41:47.017 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2022-09-07T19:41:47.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.155:6836/415293574,v1:172.21.15.155:6837/415293574] up:boot 2022-09-07T19:41:47.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: fsmap 7 up:standby 2022-09-07T19:41:47.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2022-09-07T19:41:47.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:47.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:47.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:47.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:47.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:47.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: Deploying daemon mds.h on smithi154 2022-09-07T19:41:47.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:46 smithi155 ceph-mon[97606]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:47.248 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 07 19:41:47 smithi154 systemd[1]: Starting Ceph mds.h for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:47 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2581914660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:47.873 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 07 19:41:47 smithi154 podman[123388]: 2022-09-07T19:41:47.874 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 07 19:41:47 smithi154 bash[123388]: 07b04eac17ae487ea99a1562880975755601a7472b7a49696791d998508c16f4 2022-09-07T19:41:47.874 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 07 19:41:47 smithi154 ceph-mds[123428]: -- 172.21.15.154:0/2130585254 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561818936820 con 0x56181890ac00 2022-09-07T19:41:47.874 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 07 19:41:47 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-h[123404]: starting mds.h at 2022-09-07T19:41:47.875 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 07 19:41:47 smithi154 systemd[1]: Started Ceph mds.h for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:48.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:47 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2581914660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:48.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:47 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2581914660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:49.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:49.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:49.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:49.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:49.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:49.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:49.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: Deploying daemon mds.i on smithi155 2022-09-07T19:41:49.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:49.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] up:boot 2022-09-07T19:41:49.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: fsmap 8 up:standby 2022-09-07T19:41:49.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:48 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2022-09-07T19:41:49.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:49.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:49.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:49.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:49.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:49.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: Deploying daemon mds.i on smithi155 2022-09-07T19:41:49.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:49.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] up:boot 2022-09-07T19:41:49.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: fsmap 8 up:standby 2022-09-07T19:41:49.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:48 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2022-09-07T19:41:49.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.276+0000 7f3b58fff700 1 -- 172.21.15.80:0/670292109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 msgr2=0x7f3b54074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:49.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.276+0000 7f3b58fff700 1 --2- 172.21.15.80:0/670292109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 0x7f3b54074d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009810 tx=0x7f3b48009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:49.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 -- 172.21.15.80:0/670292109 shutdown_connections 2022-09-07T19:41:49.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 --2- 172.21.15.80:0/670292109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 --2- 172.21.15.80:0/670292109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b54075290 0x7f3b54075b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 --2- 172.21.15.80:0/670292109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 0x7f3b54074d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 -- 172.21.15.80:0/670292109 >> 172.21.15.80:0/670292109 conn(0x7f3b540fb6b0 msgr2=0x7f3b540fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:49.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 -- 172.21.15.80:0/670292109 shutdown_connections 2022-09-07T19:41:49.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.277+0000 7f3b58fff700 1 -- 172.21.15.80:0/670292109 wait complete. 2022-09-07T19:41:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 Processor -- start 2022-09-07T19:41:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 -- start start 2022-09-07T19:41:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:49.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 0x7f3b5419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b54075290 0x7f3b541a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541a1a70 con 0x7f3b54073610 2022-09-07T19:41:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541a1be0 con 0x7f3b54075290 2022-09-07T19:41:49.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.278+0000 7f3b58fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541a1da0 con 0x7f3b540748e0 2022-09-07T19:41:49.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:49.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52854/0 (socket says 172.21.15.80:52854) 2022-09-07T19:41:49.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 -- 172.21.15.80:0/3643197588 learned_addr learned my addr 172.21.15.80:0/3643197588 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:49.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b52d9d700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b54075290 0x7f3b541a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:49.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 -- 172.21.15.80:0/3643197588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 msgr2=0x7f3b5419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:49.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 0x7f3b5419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 -- 172.21.15.80:0/3643197588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b54075290 msgr2=0x7f3b541a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:49.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b54075290 0x7f3b541a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 -- 172.21.15.80:0/3643197588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440093b0 con 0x7f3b54073610 2022-09-07T19:41:49.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b5259c700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54199ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400e9c0 tx=0x7f3b4400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:49.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440097b0 con 0x7f3b54073610 2022-09-07T19:41:49.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b48009470 con 0x7f3b54073610 2022-09-07T19:41:49.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.279+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3b4400ce70 con 0x7f3b54073610 2022-09-07T19:41:49.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.280+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44003ea0 con 0x7f3b54073610 2022-09-07T19:41:49.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.280+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b541a2450 con 0x7f3b54073610 2022-09-07T19:41:49.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.281+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5410fb50 con 0x7f3b54073610 2022-09-07T19:41:49.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.282+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f3b4401e020 con 0x7f3b54073610 2022-09-07T19:41:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.284+0000 7f3b437fe700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3b3c099010 0x7f3b3c09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.284+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f3b44014070 con 0x7f3b54073610 2022-09-07T19:41:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.284+0000 7f3b51d9b700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3b3c099010 0x7f3b3c09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.284+0000 7f3b51d9b700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3b3c099010 0x7f3b3c09b4c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3b480056d0 tx=0x7f3b48000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.287+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f3b4408f000 con 0x7f3b54073610 2022-09-07T19:41:49.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:49.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:49.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:49.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:49.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:49.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: Deploying daemon mds.i on smithi155 2022-09-07T19:41:49.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:49.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] up:boot 2022-09-07T19:41:49.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: fsmap 8 up:standby 2022-09-07T19:41:49.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:48 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2022-09-07T19:41:49.523 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.524+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b5405fa30 con 0x7f3b54073610 2022-09-07T19:41:49.524 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.524+0000 7f3b437fe700 1 -- 172.21.15.80:0/3643197588 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6568 (secure 0 0 0) 0x7f3b44092620 con 0x7f3b54073610 2022-09-07T19:41:49.525 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:49.525 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2022-09-07T19:41:49.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3b3c099010 msgr2=0x7f3b3c09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:49.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3b3c099010 0x7f3b3c09b4c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3b480056d0 tx=0x7f3b48000bc0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 msgr2=0x7f3b54199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:49.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54199ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400e9c0 tx=0x7f3b4400ed80 comp rx=0 tx=0).stop 2022-09-07T19:41:49.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 shutdown_connections 2022-09-07T19:41:49.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b54073610 0x7f3b54199ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3b3c099010 0x7f3b3c09b4c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b54075290 0x7f3b541a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 --2- 172.21.15.80:0/3643197588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b540748e0 0x7f3b5419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:49.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 >> 172.21.15.80:0/3643197588 conn(0x7f3b540fb6b0 msgr2=0x7f3b540fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:49.530 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 shutdown_connections 2022-09-07T19:41:49.530 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:49.527+0000 7f3b58fff700 1 -- 172.21.15.80:0/3643197588 wait complete. 2022-09-07T19:41:49.531 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2022-09-07T19:41:49.658 INFO:journalctl@ceph.mds.i.smithi155.stdout:Sep 07 19:41:49 smithi155 systemd[1]: Starting Ceph mds.i for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:49.946 INFO:journalctl@ceph.mds.i.smithi155.stdout:Sep 07 19:41:49 smithi155 podman[125371]: 2022-09-07T19:41:49.947 INFO:journalctl@ceph.mds.i.smithi155.stdout:Sep 07 19:41:49 smithi155 bash[125371]: de839a81617b91a08f96ac1a4067685a9eeebc2f08aa6fd40017971d6dba51a0 2022-09-07T19:41:49.947 INFO:journalctl@ceph.mds.i.smithi155.stdout:Sep 07 19:41:49 smithi155 ceph-mds[125411]: -- 172.21.15.155:0/3717334368 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5586d0336820 con 0x5586d030b000 2022-09-07T19:41:49.948 INFO:journalctl@ceph.mds.i.smithi155.stdout:Sep 07 19:41:49 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-i[125387]: starting mds.i at 2022-09-07T19:41:50.355 INFO:journalctl@ceph.mds.i.smithi155.stdout:Sep 07 19:41:49 smithi155 systemd[1]: Started Ceph mds.i for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:50.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:50 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3643197588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:50.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:50.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:50.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:50.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:50.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:50 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:50 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3643197588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:50.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:50.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:50 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:50.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:50 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3643197588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:50.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:50.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:50.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:50.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:50.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:50 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:51.555 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:51.582 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:51 smithi080 ceph-mon[90124]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:51.582 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:51 smithi080 ceph-mon[90124]: Deploying daemon mds.g on smithi080 2022-09-07T19:41:51.582 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:51 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.155:6838/560140413,v1:172.21.15.155:6839/560140413] up:boot 2022-09-07T19:41:51.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:51 smithi080 ceph-mon[90124]: fsmap 9 up:standby 2022-09-07T19:41:51.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:51 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2022-09-07T19:41:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:51 smithi154 ceph-mon[96967]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:51 smithi154 ceph-mon[96967]: Deploying daemon mds.g on smithi080 2022-09-07T19:41:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:51 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.155:6838/560140413,v1:172.21.15.155:6839/560140413] up:boot 2022-09-07T19:41:51.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:51 smithi154 ceph-mon[96967]: fsmap 9 up:standby 2022-09-07T19:41:51.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:51 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2022-09-07T19:41:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:51 smithi155 ceph-mon[97606]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:51 smithi155 ceph-mon[97606]: Deploying daemon mds.g on smithi080 2022-09-07T19:41:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:51 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.155:6838/560140413,v1:172.21.15.155:6839/560140413] up:boot 2022-09-07T19:41:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:51 smithi155 ceph-mon[97606]: fsmap 9 up:standby 2022-09-07T19:41:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:51 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2022-09-07T19:41:51.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 -- 172.21.15.80:0/2300219573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080ff900 msgr2=0x7f02081061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2300219573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080ff900 0x7f02081061c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0200009bb0 tx=0x7f0200009ec0 comp rx=0 tx=0).stop 2022-09-07T19:41:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 -- 172.21.15.80:0/2300219573 shutdown_connections 2022-09-07T19:41:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2300219573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080ff900 0x7f02081061c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2300219573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02080fdcf0 0x7f02080fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2300219573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02080fef70 0x7f02080ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 -- 172.21.15.80:0/2300219573 >> 172.21.15.80:0/2300219573 conn(0x7f02080f93c0 msgr2=0x7f02080fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 -- 172.21.15.80:0/2300219573 shutdown_connections 2022-09-07T19:41:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.795+0000 7f020e3ff700 1 -- 172.21.15.80:0/2300219573 wait complete. 2022-09-07T19:41:51.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.796+0000 7f020e3ff700 1 Processor -- start 2022-09-07T19:41:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.796+0000 7f020e3ff700 1 -- start start 2022-09-07T19:41:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.796+0000 7f020e3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02080fdcf0 0x7f0208195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f020e3ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 0x7f0208196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:51.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f020e3ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02080ff900 0x7f020819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:51.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f020e3ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020819d690 con 0x7f02080fef70 2022-09-07T19:41:51.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f020e3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020819d800 con 0x7f02080fdcf0 2022-09-07T19:41:51.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f020e3ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020819d9c0 con 0x7f02080ff900 2022-09-07T19:41:51.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 0x7f0208196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:51.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 0x7f0208196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52876/0 (socket says 172.21.15.80:52876) 2022-09-07T19:41:51.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 -- 172.21.15.80:0/2763273505 learned_addr learned my addr 172.21.15.80:0/2763273505 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:51.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f0207fff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02080fdcf0 0x7f0208195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:51.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f020c99c700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02080ff900 0x7f020819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 -- 172.21.15.80:0/2763273505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02080ff900 msgr2=0x7f020819d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02080ff900 0x7f020819d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:51.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 -- 172.21.15.80:0/2763273505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02080fdcf0 msgr2=0x7f0208195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:51.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02080fdcf0 0x7f0208195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:51.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.797+0000 7f02077fe700 1 -- 172.21.15.80:0/2763273505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000097e0 con 0x7f02080fef70 2022-09-07T19:41:51.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.798+0000 7f02077fe700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 0x7f0208196050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00e740 tx=0x7f01fc00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:51.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.798+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc005220 con 0x7f02080fef70 2022-09-07T19:41:51.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.798+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f01fc005380 con 0x7f02080fef70 2022-09-07T19:41:51.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.798+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc004b70 con 0x7f02080fef70 2022-09-07T19:41:51.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.798+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020819dca0 con 0x7f02080fef70 2022-09-07T19:41:51.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.798+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020819e160 con 0x7f02080fef70 2022-09-07T19:41:51.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.799+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02081094b0 con 0x7f02080fef70 2022-09-07T19:41:51.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.801+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f01fc01e020 con 0x7f02080fef70 2022-09-07T19:41:51.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.802+0000 7f02057fa700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01f0099090 0x7f01f009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:51.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.802+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f01fc014070 con 0x7f02080fef70 2022-09-07T19:41:51.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.803+0000 7f0207fff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01f0099090 0x7f01f009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:51.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.803+0000 7f0207fff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01f0099090 0x7f01f009b540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02080fedd0 tx=0x7f01f8005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:51.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:51.806+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f01fc08eb80 con 0x7f02080fef70 2022-09-07T19:41:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.077+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f020819eb40 con 0x7f02080fef70 2022-09-07T19:41:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.077+0000 7f02057fa700 1 -- 172.21.15.80:0/2763273505 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7327 (secure 0 0 0) 0x7f01fc0921a0 con 0x7f02080fef70 2022-09-07T19:41:52.077 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:52.078 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2022-09-07T19:41:52.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01f0099090 msgr2=0x7f01f009b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01f0099090 0x7f01f009b540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02080fedd0 tx=0x7f01f8005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 msgr2=0x7f0208196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 0x7f0208196050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00e740 tx=0x7f01fc00ea50 comp rx=0 tx=0).stop 2022-09-07T19:41:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 shutdown_connections 2022-09-07T19:41:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01f0099090 0x7f01f009b540 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02080ff900 0x7f020819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02080fdcf0 0x7f0208195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 --2- 172.21.15.80:0/2763273505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080fef70 0x7f0208196050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 >> 172.21.15.80:0/2763273505 conn(0x7f02080f93c0 msgr2=0x7f02080fb680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 shutdown_connections 2022-09-07T19:41:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:52.080+0000 7f020e3ff700 1 -- 172.21.15.80:0/2763273505 wait complete. 2022-09-07T19:41:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2022-09-07T19:41:52.613 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:52 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2763273505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:52.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:52 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2763273505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:52.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:52 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2763273505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:53.119 INFO:journalctl@ceph.mds.g.smithi080.stdout:Sep 07 19:41:52 smithi080 systemd[1]: Starting Ceph mds.g for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:53.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:53 smithi080 ceph-mon[90124]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:53.523 INFO:journalctl@ceph.mds.g.smithi080.stdout:Sep 07 19:41:53 smithi080 podman[125257]: 2022-09-07T19:41:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:53 smithi154 ceph-mon[96967]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:53 smithi155 ceph-mon[97606]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:53.868 INFO:journalctl@ceph.mds.g.smithi080.stdout:Sep 07 19:41:53 smithi080 ceph-mds[125297]: -- 172.21.15.80:0/2264402976 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561615498820 con 0x56161546cc00 2022-09-07T19:41:53.869 INFO:journalctl@ceph.mds.g.smithi080.stdout:Sep 07 19:41:53 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-g[125273]: starting mds.g at 2022-09-07T19:41:53.869 INFO:journalctl@ceph.mds.g.smithi080.stdout:Sep 07 19:41:53 smithi080 bash[125257]: f8c029d139e573b4d0f6370c224dd51140faf981786f97d3811e44199dafa35e 2022-09-07T19:41:53.869 INFO:journalctl@ceph.mds.g.smithi080.stdout:Sep 07 19:41:53 smithi080 systemd[1]: Started Ceph mds.g for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:54.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 -- 172.21.15.80:0/1554833483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0fdcf0 msgr2=0x7fb7ac0fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/1554833483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac0fe100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009810 tx=0x7fb7a8009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 -- 172.21.15.80:0/1554833483 shutdown_connections 2022-09-07T19:41:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/1554833483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac0fe100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/1554833483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ac0ff900 0x7fb7ac1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/1554833483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fef70 0x7fb7ac0ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 -- 172.21.15.80:0/1554833483 >> 172.21.15.80:0/1554833483 conn(0x7fb7ac0f93c0 msgr2=0x7fb7ac0fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:54.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 -- 172.21.15.80:0/1554833483 shutdown_connections 2022-09-07T19:41:54.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.353+0000 7fb7b35ff700 1 -- 172.21.15.80:0/1554833483 wait complete. 2022-09-07T19:41:54.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 Processor -- start 2022-09-07T19:41:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 -- start start 2022-09-07T19:41:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ac0fef70 0x7fb7ac0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0ff900 0x7fb7ac071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:54.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac071e10 con 0x7fb7ac0ff900 2022-09-07T19:41:54.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac071f80 con 0x7fb7ac0fef70 2022-09-07T19:41:54.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b35ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac19d9e0 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b139b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:54.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b139b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:43562/0 (socket says 172.21.15.80:43562) 2022-09-07T19:41:54.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b139b700 1 -- 172.21.15.80:0/174789752 learned_addr learned my addr 172.21.15.80:0/174789752 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:54.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.355+0000 7fb7b0b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ac0fef70 0x7fb7ac0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:54.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b1b9c700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0ff900 0x7fb7ac071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:54.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b139b700 1 -- 172.21.15.80:0/174789752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ac0fef70 msgr2=0x7fb7ac0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:54.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b139b700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ac0fef70 0x7fb7ac0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b139b700 1 -- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0ff900 msgr2=0x7fb7ac071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b139b700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0ff900 0x7fb7ac071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b139b700 1 -- 172.21.15.80:0/174789752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009470 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7b139b700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac072a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80059c0 tx=0x7fb7a800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:54.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.356+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a801d070 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.357+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac19dc60 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.357+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb7a800f880 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.357+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80047f0 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.357+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac19e160 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.358+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac1094a0 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.360+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fb7a8028030 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.361+0000 7fb7a27fc700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb798099010 0x7fb79809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.361+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7fb7a80c2d00 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.361+0000 7fb7b0b9a700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb798099010 0x7fb79809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.362+0000 7fb7b0b9a700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb798099010 0x7fb79809b4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb79c005fd0 tx=0x7fb79c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.363+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb7a808f7f0 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.621+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7ac104b80 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.622+0000 7fb7a27fc700 1 -- 172.21.15.80:0/174789752 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8085 (secure 0 0 0) 0x7fb7a8092e10 con 0x7fb7ac0fdcf0 2022-09-07T19:41:54.621 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:54.621 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2022-09-07T19:41:54.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb798099010 msgr2=0x7fb79809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:54.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb798099010 0x7fb79809b4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb79c005fd0 tx=0x7fb79c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 msgr2=0x7fb7ac072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:54.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac072a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80059c0 tx=0x7fb7a800f690 comp rx=0 tx=0).stop 2022-09-07T19:41:54.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 shutdown_connections 2022-09-07T19:41:54.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ac0ff900 0x7fb7ac071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb798099010 0x7fb79809b4c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ac0fdcf0 0x7fb7ac072a90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 --2- 172.21.15.80:0/174789752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ac0fef70 0x7fb7ac0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:54.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 >> 172.21.15.80:0/174789752 conn(0x7fb7ac0f93c0 msgr2=0x7fb7ac0fb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:54.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 shutdown_connections 2022-09-07T19:41:54.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:54.624+0000 7fb7b35ff700 1 -- 172.21.15.80:0/174789752 wait complete. 2022-09-07T19:41:54.627 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2022-09-07T19:41:54.929 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:54.929 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:54.930 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:54.930 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:54.931 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:54.931 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: Deploying daemon mds.a on smithi080 2022-09-07T19:41:54.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:54.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.80:6838/4122966657,v1:172.21.15.80:6839/4122966657] up:boot 2022-09-07T19:41:54.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: fsmap 10 up:standby 2022-09-07T19:41:54.933 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:41:54.933 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:54 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/174789752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:54.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:54.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:54.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:54.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:54.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:54.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: Deploying daemon mds.a on smithi080 2022-09-07T19:41:54.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:54.950 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.80:6838/4122966657,v1:172.21.15.80:6839/4122966657] up:boot 2022-09-07T19:41:54.951 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: fsmap 10 up:standby 2022-09-07T19:41:54.951 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:41:54.951 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:54 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/174789752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:55.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:55.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:55.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:55.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:55.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:55.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: Deploying daemon mds.a on smithi080 2022-09-07T19:41:55.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:55.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.80:6838/4122966657,v1:172.21.15.80:6839/4122966657] up:boot 2022-09-07T19:41:55.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: fsmap 10 up:standby 2022-09-07T19:41:55.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:41:55.126 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:54 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/174789752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:56.619 INFO:journalctl@ceph.mds.a.smithi080.stdout:Sep 07 19:41:56 smithi080 systemd[1]: Starting Ceph mds.a for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:56.653 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 -- 172.21.15.80:0/3766594911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0ff900 msgr2=0x7f0b0c1061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 --2- 172.21.15.80:0/3766594911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c1061c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009b00 tx=0x7f0b04009e10 comp rx=0 tx=0).stop 2022-09-07T19:41:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 -- 172.21.15.80:0/3766594911 shutdown_connections 2022-09-07T19:41:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 --2- 172.21.15.80:0/3766594911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c1061c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 --2- 172.21.15.80:0/3766594911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0fdcf0 0x7f0b0c0fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 --2- 172.21.15.80:0/3766594911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 -- 172.21.15.80:0/3766594911 >> 172.21.15.80:0/3766594911 conn(0x7f0b0c0f93c0 msgr2=0x7f0b0c0fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 -- 172.21.15.80:0/3766594911 shutdown_connections 2022-09-07T19:41:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.910+0000 7f0b12dff700 1 -- 172.21.15.80:0/3766594911 wait complete. 2022-09-07T19:41:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.912+0000 7f0b12dff700 1 Processor -- start 2022-09-07T19:41:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.912+0000 7f0b12dff700 1 -- start start 2022-09-07T19:41:56.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.912+0000 7f0b12dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0fdcf0 0x7f0b0c072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:56.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.912+0000 7f0b12dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:56.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b12dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:56.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b12dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c071e10 con 0x7f0b0c0fef70 2022-09-07T19:41:56.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b12dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c071f80 con 0x7f0b0c0ff900 2022-09-07T19:41:56.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b12dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c19d9d0 con 0x7f0b0c0fdcf0 2022-09-07T19:41:56.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b0bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:56.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b0bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54498/0 (socket says 172.21.15.80:54498) 2022-09-07T19:41:56.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b0bfff700 1 -- 172.21.15.80:0/80555416 learned_addr learned my addr 172.21.15.80:0/80555416 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:56.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b1139c700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:56.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b10b9b700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0fdcf0 0x7f0b0c072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:56.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b1139c700 1 -- 172.21.15.80:0/80555416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0fdcf0 msgr2=0x7f0b0c072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:56.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b1139c700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0fdcf0 0x7f0b0c072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:56.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b1139c700 1 -- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 msgr2=0x7f0b0c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:56.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b1139c700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:56.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b1139c700 1 -- 172.21.15.80:0/80555416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04009730 con 0x7f0b0c0ff900 2022-09-07T19:41:56.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.913+0000 7f0b0bfff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:41:56.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.914+0000 7f0b1139c700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c071670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009a20 tx=0x7f0b0400f870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:56.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.914+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400b9e0 con 0x7f0b0c0ff900 2022-09-07T19:41:56.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.914+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0c19dc50 con 0x7f0b0c0ff900 2022-09-07T19:41:56.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.914+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f0b04005040 con 0x7f0b0c0ff900 2022-09-07T19:41:56.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.914+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04017660 con 0x7f0b0c0ff900 2022-09-07T19:41:56.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.914+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0c19e0d0 con 0x7f0b0c0ff900 2022-09-07T19:41:56.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.915+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0c1094b0 con 0x7f0b0c0ff900 2022-09-07T19:41:56.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.919+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f0b04027020 con 0x7f0b0c0ff900 2022-09-07T19:41:56.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.922+0000 7f0b09ffb700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0afc099090 0x7f0afc09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:56.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.922+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f0b040c3870 con 0x7f0b0c0ff900 2022-09-07T19:41:56.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.922+0000 7f0b10b9b700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0afc099090 0x7f0afc09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:56.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.922+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f0b040edc80 con 0x7f0b0c0ff900 2022-09-07T19:41:56.925 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:56.923+0000 7f0b10b9b700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0afc099090 0x7f0afc09b540 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0fedd0 tx=0x7f0b00005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:57.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:56 smithi080 ceph-mon[90124]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:57.077 INFO:journalctl@ceph.mds.a.smithi080.stdout:Sep 07 19:41:56 smithi080 podman[125654]: 2022-09-07T19:41:57.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.172+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b0c1051e0 con 0x7f0b0c0ff900 2022-09-07T19:41:57.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.173+0000 7f0b09ffb700 1 -- 172.21.15.80:0/80555416 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8085 (secure 0 0 0) 0x7f0b04090360 con 0x7f0b0c0ff900 2022-09-07T19:41:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:57.173 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2022-09-07T19:41:57.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0afc099090 msgr2=0x7f0afc09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0afc099090 0x7f0afc09b540 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0fedd0 tx=0x7f0b00005f60 comp rx=0 tx=0).stop 2022-09-07T19:41:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0ff900 msgr2=0x7f0b0c071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c071670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009a20 tx=0x7f0b0400f870 comp rx=0 tx=0).stop 2022-09-07T19:41:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 shutdown_connections 2022-09-07T19:41:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0afc099090 0x7f0afc09b540 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c0ff900 0x7f0b0c071670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b0c0fdcf0 0x7f0b0c072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 --2- 172.21.15.80:0/80555416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c0fef70 0x7f0b0c0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 >> 172.21.15.80:0/80555416 conn(0x7f0b0c0f93c0 msgr2=0x7f0b0c1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 shutdown_connections 2022-09-07T19:41:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:57.176+0000 7f0b12dff700 1 -- 172.21.15.80:0/80555416 wait complete. 2022-09-07T19:41:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2022-09-07T19:41:57.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:56 smithi154 ceph-mon[96967]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:57.368 INFO:journalctl@ceph.mds.a.smithi080.stdout:Sep 07 19:41:57 smithi080 bash[125654]: e78375c903ec47990cf9fb2091f838fc52f9495b28d6919f0ca108e3140ff034 2022-09-07T19:41:57.368 INFO:journalctl@ceph.mds.a.smithi080.stdout:Sep 07 19:41:57 smithi080 ceph-mds[125741]: -- 172.21.15.80:0/3404426957 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e316d20820 con 0x55e316cf4c00 2022-09-07T19:41:57.369 INFO:journalctl@ceph.mds.a.smithi080.stdout:Sep 07 19:41:57 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-a[125698]: starting mds.a at 2022-09-07T19:41:57.369 INFO:journalctl@ceph.mds.a.smithi080.stdout:Sep 07 19:41:57 smithi080 systemd[1]: Started Ceph mds.a for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:57.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:56 smithi155 ceph-mon[97606]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:58.315 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/80555416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:58.316 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:58.316 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:58.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:58.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:58.318 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:58.318 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: Deploying daemon mds.b on smithi154 2022-09-07T19:41:58.318 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] up:boot 2022-09-07T19:41:58.319 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: fsmap 11 up:standby 2022-09-07T19:41:58.319 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:58 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2022-09-07T19:41:58.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/80555416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:58.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:58.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:58.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:58.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:58.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:58.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: Deploying daemon mds.b on smithi154 2022-09-07T19:41:58.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] up:boot 2022-09-07T19:41:58.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: fsmap 11 up:standby 2022-09-07T19:41:58.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:58 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2022-09-07T19:41:58.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/80555416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:41:58.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:58.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:41:58.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-09-07T19:41:58.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-09-07T19:41:58.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:41:58.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: Deploying daemon mds.b on smithi154 2022-09-07T19:41:58.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] up:boot 2022-09-07T19:41:58.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: fsmap 11 up:standby 2022-09-07T19:41:58.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:58 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2022-09-07T19:41:59.102 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:41:58 smithi154 systemd[1]: Starting Ceph mds.b for cc599a0c-2ee3-11ed-8431-001a4aab830c... 2022-09-07T19:41:59.208 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:41:59.352 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:41:59 smithi154 ceph-mon[96967]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:59.353 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:41:59 smithi154 podman[123732]: 2022-09-07T19:41:59.354 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:41:59 smithi154 bash[123732]: 8e0aabdbe339522d19fa946860ff7f93d5e214a82a171f9b583e220a2d07a109 2022-09-07T19:41:59.354 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:41:59 smithi154 ceph-mds[123771]: -- 172.21.15.154:0/2658133832 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560a890c6820 con 0x560a8909b000 2022-09-07T19:41:59.354 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:41:59 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-b[123748]: starting mds.b at 2022-09-07T19:41:59.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.471+0000 7f07e9fff700 1 -- 172.21.15.80:0/2382838525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fdcf0 msgr2=0x7f07e40fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:59.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.471+0000 7f07e9fff700 1 --2- 172.21.15.80:0/2382838525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fdcf0 0x7f07e40fe100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009810 tx=0x7f07d4009b20 comp rx=0 tx=0).stop 2022-09-07T19:41:59.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 -- 172.21.15.80:0/2382838525 shutdown_connections 2022-09-07T19:41:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 --2- 172.21.15.80:0/2382838525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fdcf0 0x7f07e40fe100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 --2- 172.21.15.80:0/2382838525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e40ff900 0x7f07e41061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 --2- 172.21.15.80:0/2382838525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fef70 0x7f07e40ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 -- 172.21.15.80:0/2382838525 >> 172.21.15.80:0/2382838525 conn(0x7f07e40f93c0 msgr2=0x7f07e40fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:59.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 -- 172.21.15.80:0/2382838525 shutdown_connections 2022-09-07T19:41:59.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.472+0000 7f07e9fff700 1 -- 172.21.15.80:0/2382838525 wait complete. 2022-09-07T19:41:59.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.473+0000 7f07e9fff700 1 Processor -- start 2022-09-07T19:41:59.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.473+0000 7f07e9fff700 1 -- start start 2022-09-07T19:41:59.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e9fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 0x7f07e4195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:59.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e9fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fef70 0x7f07e4196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:59.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e9fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e40ff900 0x7f07e419d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:59.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e9fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e419d680 con 0x7f07e40fef70 2022-09-07T19:41:59.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e9fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e419d7f0 con 0x7f07e40ff900 2022-09-07T19:41:59.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e9fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e419d9b0 con 0x7f07e40fdcf0 2022-09-07T19:41:59.486 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fef70 0x7f07e4196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:59.487 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 0x7f07e4195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:59.487 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 0x7f07e4195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:43606/0 (socket says 172.21.15.80:43606) 2022-09-07T19:41:59.487 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 -- 172.21.15.80:0/4053871048 learned_addr learned my addr 172.21.15.80:0/4053871048 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:41:59.487 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e3fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e40ff900 0x7f07e419d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:59.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 -- 172.21.15.80:0/4053871048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e40ff900 msgr2=0x7f07e419d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:59.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e40ff900 0x7f07e419d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 -- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fef70 msgr2=0x7f07e4196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:59.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fef70 0x7f07e4196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.474+0000 7f07e37fe700 1 -- 172.21.15.80:0/4053871048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80093b0 con 0x7f07e40fdcf0 2022-09-07T19:41:59.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.475+0000 7f07e37fe700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 0x7f07e4195b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07d40059c0 tx=0x7f07d400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:59.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.475+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d401d070 con 0x7f07e40fdcf0 2022-09-07T19:41:59.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.475+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f07d400f880 con 0x7f07e40fdcf0 2022-09-07T19:41:59.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.475+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc009730 con 0x7f07e40fdcf0 2022-09-07T19:41:59.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.475+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40047f0 con 0x7f07e40fdcf0 2022-09-07T19:41:59.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.475+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d4009470 con 0x7f07e40fdcf0 2022-09-07T19:41:59.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.476+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e41094a0 con 0x7f07e40fdcf0 2022-09-07T19:41:59.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.478+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f07d4028030 con 0x7f07e40fdcf0 2022-09-07T19:41:59.491 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.479+0000 7f07e0ff9700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07cc099010 0x7f07cc09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:41:59.491 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.480+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f07d40c2d10 con 0x7f07e40fdcf0 2022-09-07T19:41:59.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.480+0000 7f07e2ffd700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07cc099010 0x7f07cc09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:41:59.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.480+0000 7f07e2ffd700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07cc099010 0x7f07cc09b4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d8005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:41:59.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.483+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f07d40c8020 con 0x7f07e40fdcf0 2022-09-07T19:41:59.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:41:59 smithi080 ceph-mon[90124]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:59.619 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:41:59 smithi155 ceph-mon[97606]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:41:59.623 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:41:59 smithi154 systemd[1]: Started Ceph mds.b for cc599a0c-2ee3-11ed-8431-001a4aab830c. 2022-09-07T19:41:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.759+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07e419e610 con 0x7f07e40fdcf0 2022-09-07T19:41:59.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.760+0000 7f07e0ff9700 1 -- 172.21.15.80:0/4053871048 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8843 (secure 0 0 0) 0x7f07d408f800 con 0x7f07e40fdcf0 2022-09-07T19:41:59.764 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:41:59.765 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[]} 2022-09-07T19:41:59.766 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.762+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07cc099010 msgr2=0x7f07cc09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:59.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07cc099010 0x7f07cc09b4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d8005ea0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 msgr2=0x7f07e4195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:41:59.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 0x7f07e4195b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07d40059c0 tx=0x7f07d400f690 comp rx=0 tx=0).stop 2022-09-07T19:41:59.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 shutdown_connections 2022-09-07T19:41:59.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07cc099010 0x7f07cc09b4c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e40ff900 0x7f07e419d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e40fdcf0 0x7f07e4195b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 --2- 172.21.15.80:0/4053871048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e40fef70 0x7f07e4196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:41:59.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 >> 172.21.15.80:0/4053871048 conn(0x7f07e40f93c0 msgr2=0x7f07e40fb680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:41:59.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 shutdown_connections 2022-09-07T19:41:59.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:41:59.763+0000 7f07e9fff700 1 -- 172.21.15.80:0/4053871048 wait complete. 2022-09-07T19:41:59.774 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 12 2022-09-07T19:42:00.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:00.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:00.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:42:00.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:42:00.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:42:00.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4053871048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:00.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] up:boot 2022-09-07T19:42:00.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: fsmap 12 up:standby 2022-09-07T19:42:00.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:00 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2022-09-07T19:42:00.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:42:00.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:42:00.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:42:00.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4053871048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:00.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] up:boot 2022-09-07T19:42:00.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: fsmap 12 up:standby 2022-09-07T19:42:00.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:00 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2022-09-07T19:42:00.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:00.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:00.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:42:00.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:42:00.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:42:00.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4053871048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:00.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] up:boot 2022-09-07T19:42:00.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: fsmap 12 up:standby 2022-09-07T19:42:00.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:00 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2022-09-07T19:42:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:01 smithi155 ceph-mon[97606]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:01.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:42:01.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:01 smithi080 ceph-mon[90124]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:01 smithi154 ceph-mon[96967]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.043+0000 7f4d18bff700 1 -- 172.21.15.80:0/2797319737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 msgr2=0x7f4d14108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.043+0000 7f4d18bff700 1 --2- 172.21.15.80:0/2797319737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d14108400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009bb0 tx=0x7f4d0c009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 -- 172.21.15.80:0/2797319737 shutdown_connections 2022-09-07T19:42:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 --2- 172.21.15.80:0/2797319737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d14108400 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 --2- 172.21.15.80:0/2797319737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d140fff30 0x7f4d14100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 --2- 172.21.15.80:0/2797319737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d141011b0 0x7f4d14101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 -- 172.21.15.80:0/2797319737 >> 172.21.15.80:0/2797319737 conn(0x7f4d140fb6b0 msgr2=0x7f4d140fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 -- 172.21.15.80:0/2797319737 shutdown_connections 2022-09-07T19:42:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.044+0000 7f4d18bff700 1 -- 172.21.15.80:0/2797319737 wait complete. 2022-09-07T19:42:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 Processor -- start 2022-09-07T19:42:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 -- start start 2022-09-07T19:42:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d140fff30 0x7f4d14195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d141011b0 0x7f4d14196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d1419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1419d660 con 0x7f4d140fff30 2022-09-07T19:42:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1419d7d0 con 0x7f4d141011b0 2022-09-07T19:42:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.045+0000 7f4d18bff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1419d990 con 0x7f4d14101b40 2022-09-07T19:42:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d1259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d140fff30 0x7f4d14195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d1419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d1259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d140fff30 0x7f4d14195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54566/0 (socket says 172.21.15.80:54566) 2022-09-07T19:42:02.053 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d1259c700 1 -- 172.21.15.80:0/1818386221 learned_addr learned my addr 172.21.15.80:0/1818386221 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:02.053 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d11d9b700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d141011b0 0x7f4d14196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.054 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 -- 172.21.15.80:0/1818386221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d141011b0 msgr2=0x7f4d14196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.054 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d141011b0 0x7f4d14196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.054 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 -- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d140fff30 msgr2=0x7f4d14195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d140fff30 0x7f4d14195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 -- 172.21.15.80:0/1818386221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0097e0 con 0x7f4d14101b40 2022-09-07T19:42:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d11d9b700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d141011b0 0x7f4d14196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.046+0000 7f4d12d9d700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d1419d090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009fd0 tx=0x7f4d0c00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.047+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00f870 con 0x7f4d14101b40 2022-09-07T19:42:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.047+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f4d0c00f9d0 con 0x7f4d14101b40 2022-09-07T19:42:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.047+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0176f0 con 0x7f4d14101b40 2022-09-07T19:42:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.047+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1419dc10 con 0x7f4d14101b40 2022-09-07T19:42:02.057 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.047+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1419e070 con 0x7f4d14101b40 2022-09-07T19:42:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.048+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1410b6f0 con 0x7f4d14101b40 2022-09-07T19:42:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.050+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f4d0c029070 con 0x7f4d14101b40 2022-09-07T19:42:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.051+0000 7f4d037fe700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4cfc099090 0x7f4cfc09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.051+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f4d0c0c2f90 con 0x7f4d14101b40 2022-09-07T19:42:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.052+0000 7f4d1259c700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4cfc099090 0x7f4cfc09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.052+0000 7f4d1259c700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4cfc099090 0x7f4cfc09b540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009b70 tx=0x7f4d04005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:02.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.055+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f4d0c08fa80 con 0x7f4d14101b40 2022-09-07T19:42:02.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.299+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d1419e620 con 0x7f4d14101b40 2022-09-07T19:42:02.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.300+0000 7f4d037fe700 1 -- 172.21.15.80:0/1818386221 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9601 (secure 0 0 0) 0x7f4d0c027090 con 0x7f4d14101b40 2022-09-07T19:42:02.299 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:02.300 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24575,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2022-09-07T19:42:02.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4cfc099090 msgr2=0x7f4cfc09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4cfc099090 0x7f4cfc09b540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009b70 tx=0x7f4d04005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 msgr2=0x7f4d1419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d1419d090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009fd0 tx=0x7f4d0c00b890 comp rx=0 tx=0).stop 2022-09-07T19:42:02.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 shutdown_connections 2022-09-07T19:42:02.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d140fff30 0x7f4d14195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4cfc099090 0x7f4cfc09b540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d14101b40 0x7f4d1419d090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 --2- 172.21.15.80:0/1818386221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d141011b0 0x7f4d14196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 >> 172.21.15.80:0/1818386221 conn(0x7f4d140fb6b0 msgr2=0x7f4d140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 shutdown_connections 2022-09-07T19:42:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.303+0000 7f4d18bff700 1 -- 172.21.15.80:0/1818386221 wait complete. 2022-09-07T19:42:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 13 2022-09-07T19:42:02.334 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:02.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 -- 172.21.15.80:0/2498312806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c0066bf0 msgr2=0x7f48c0100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2498312806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c0066bf0 0x7f48c0100890 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009810 tx=0x7f48b0009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:02.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 -- 172.21.15.80:0/2498312806 shutdown_connections 2022-09-07T19:42:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2498312806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c0066bf0 0x7f48c0100890 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2498312806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c01038c0 0x7f48c0105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2498312806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 -- 172.21.15.80:0/2498312806 >> 172.21.15.80:0/2498312806 conn(0x7f48c00f82a0 msgr2=0x7f48c00fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:02.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 -- 172.21.15.80:0/2498312806 shutdown_connections 2022-09-07T19:42:02.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.572+0000 7f48c49ff700 1 -- 172.21.15.80:0/2498312806 wait complete. 2022-09-07T19:42:02.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.573+0000 7f48c49ff700 1 Processor -- start 2022-09-07T19:42:02.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.573+0000 7f48c49ff700 1 -- start start 2022-09-07T19:42:02.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.573+0000 7f48c49ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c0066bf0 0x7f48c0195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.573+0000 7f48c49ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48c49ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c01038c0 0x7f48c019d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48c49ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019d6d0 con 0x7f48c01038c0 2022-09-07T19:42:02.579 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48c49ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019d840 con 0x7f48c0100dd0 2022-09-07T19:42:02.579 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48c49ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019da00 con 0x7f48c0066bf0 2022-09-07T19:42:02.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:37930/0 (socket says 172.21.15.80:37930) 2022-09-07T19:42:02.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 -- 172.21.15.80:0/2454859496 learned_addr learned my addr 172.21.15.80:0/2454859496 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:02.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bed9d700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c01038c0 0x7f48c019d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48be59c700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c0066bf0 0x7f48c0195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 -- 172.21.15.80:0/2454859496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c0066bf0 msgr2=0x7f48c0195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c0066bf0 0x7f48c0195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 -- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c01038c0 msgr2=0x7f48c019d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c01038c0 0x7f48c019d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48bdd9b700 1 -- 172.21.15.80:0/2454859496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8009730 con 0x7f48c0100dd0 2022-09-07T19:42:02.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.574+0000 7f48be59c700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c0066bf0 0x7f48c0195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:02.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.575+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0196090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e740 tx=0x7f48b400eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:02.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.575+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4005220 con 0x7f48c0100dd0 2022-09-07T19:42:02.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.575+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f48b4005380 con 0x7f48c0100dd0 2022-09-07T19:42:02.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.575+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b0009470 con 0x7f48c0100dd0 2022-09-07T19:42:02.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.575+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400cb60 con 0x7f48c0100dd0 2022-09-07T19:42:02.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.575+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c019e060 con 0x7f48c0100dd0 2022-09-07T19:42:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.576+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c0109490 con 0x7f48c0100dd0 2022-09-07T19:42:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.578+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f48b401e020 con 0x7f48c0100dd0 2022-09-07T19:42:02.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.579+0000 7f48af7fe700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f48a8099010 0x7f48a809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:02.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.579+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f48b4014070 con 0x7f48c0100dd0 2022-09-07T19:42:02.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.579+0000 7f48be59c700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f48a8099010 0x7f48a809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:02.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.580+0000 7f48be59c700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f48a8099010 0x7f48a809b4c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009760 tx=0x7f48b0009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:02.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.583+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f48b408ed90 con 0x7f48c0100dd0 2022-09-07T19:42:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.784+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c005fb40 con 0x7f48c0100dd0 2022-09-07T19:42:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.785+0000 7f48af7fe700 1 -- 172.21.15.80:0/2454859496 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18123 (secure 0 0 0) 0x7f48b40923b0 con 0x7f48c0100dd0 2022-09-07T19:42:02.785 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:02.786 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:41:19.282385+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:02.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f48a8099010 msgr2=0x7f48a809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f48a8099010 0x7f48a809b4c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009760 tx=0x7f48b0009e70 comp rx=0 tx=0).stop 2022-09-07T19:42:02.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 msgr2=0x7f48c0196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:02.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0196090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e740 tx=0x7f48b400eb00 comp rx=0 tx=0).stop 2022-09-07T19:42:02.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 shutdown_connections 2022-09-07T19:42:02.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c01038c0 0x7f48c019d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f48a8099010 0x7f48a809b4c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c0066bf0 0x7f48c0195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 --2- 172.21.15.80:0/2454859496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0100dd0 0x7f48c0196090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:02.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 >> 172.21.15.80:0/2454859496 conn(0x7f48c00f82a0 msgr2=0x7f48c00ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:02.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 shutdown_connections 2022-09-07T19:42:02.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:02.788+0000 7f48c49ff700 1 -- 172.21.15.80:0/2454859496 wait complete. 2022-09-07T19:42:02.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-09-07T19:42:02.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:42:03.058 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 -- 172.21.15.80:0/22403851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c0fffa0 msgr2=0x7fa93c1003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 --2- 172.21.15.80:0/22403851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c0fffa0 0x7fa93c1003b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa938009810 tx=0x7fa938009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:03.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 -- 172.21.15.80:0/22403851 shutdown_connections 2022-09-07T19:42:03.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 --2- 172.21.15.80:0/22403851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c0fffa0 0x7fa93c1003b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 --2- 172.21.15.80:0/22403851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa93c101bb0 0x7fa93c108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 --2- 172.21.15.80:0/22403851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c101220 0x7fa93c101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 -- 172.21.15.80:0/22403851 >> 172.21.15.80:0/22403851 conn(0x7fa93c0fb6b0 msgr2=0x7fa93c0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 -- 172.21.15.80:0/22403851 shutdown_connections 2022-09-07T19:42:03.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.059+0000 7fa9447ff700 1 -- 172.21.15.80:0/22403851 wait complete. 2022-09-07T19:42:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.060+0000 7fa9447ff700 1 Processor -- start 2022-09-07T19:42:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.060+0000 7fa9447ff700 1 -- start start 2022-09-07T19:42:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa9447ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 0x7fa93c195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa9447ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c101220 0x7fa93c1960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa9447ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa93c101bb0 0x7fa93c19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa9447ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c19d720 con 0x7fa93c101220 2022-09-07T19:42:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa9447ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c19d890 con 0x7fa93c0fffa0 2022-09-07T19:42:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa9447ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c19da50 con 0x7fa93c101bb0 2022-09-07T19:42:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 0x7fa93c195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa941d9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c101220 0x7fa93c1960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 0x7fa93c195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:37938/0 (socket says 172.21.15.80:37938) 2022-09-07T19:42:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 -- 172.21.15.80:0/639218265 learned_addr learned my addr 172.21.15.80:0/639218265 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa942d9c700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa93c101bb0 0x7fa93c19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 -- 172.21.15.80:0/639218265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa93c101bb0 msgr2=0x7fa93c19d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa93c101bb0 0x7fa93c19d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 -- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c101220 msgr2=0x7fa93c1960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c101220 0x7fa93c1960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.061+0000 7fa94259b700 1 -- 172.21.15.80:0/639218265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0093b0 con 0x7fa93c0fffa0 2022-09-07T19:42:03.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa941d9a700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c101220 0x7fa93c1960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:03.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa94259b700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 0x7fa93c195ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa938006010 tx=0x7fa93800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:03.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93801d070 con 0x7fa93c0fffa0 2022-09-07T19:42:03.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fa93800f8b0 con 0x7fa93c0fffa0 2022-09-07T19:42:03.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380047f0 con 0x7fa93c0fffa0 2022-09-07T19:42:03.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa938009470 con 0x7fa93c0fffa0 2022-09-07T19:42:03.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.062+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c19dfa0 con 0x7fa93c0fffa0 2022-09-07T19:42:03.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.063+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93c10b750 con 0x7fa93c0fffa0 2022-09-07T19:42:03.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.065+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fa938028030 con 0x7fa93c0fffa0 2022-09-07T19:42:03.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.066+0000 7fa9337fe700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa928099010 0x7fa92809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.066+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7fa9380c2bf0 con 0x7fa93c0fffa0 2022-09-07T19:42:03.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.066+0000 7fa941d9a700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa928099010 0x7fa92809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.067+0000 7fa941d9a700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa928099010 0x7fa92809b4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa92c005fd0 tx=0x7fa92c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:03.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.070+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa93808f6e0 con 0x7fa93c0fffa0 2022-09-07T19:42:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:03.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1818386221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:03.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:02 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2454859496' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:03.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:03.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1818386221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:03.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:02 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2454859496' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:03.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.283+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa93c19e850 con 0x7fa93c0fffa0 2022-09-07T19:42:03.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.284+0000 7fa9337fe700 1 -- 172.21.15.80:0/639218265 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa938092d00 con 0x7fa93c0fffa0 2022-09-07T19:42:03.284 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:42:03.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa928099010 msgr2=0x7fa92809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa928099010 0x7fa92809b4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa92c005fd0 tx=0x7fa92c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 msgr2=0x7fa93c195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 0x7fa93c195ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa938006010 tx=0x7fa93800f690 comp rx=0 tx=0).stop 2022-09-07T19:42:03.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 shutdown_connections 2022-09-07T19:42:03.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa928099010 0x7fa92809b4c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa93c101bb0 0x7fa93c19d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa93c0fffa0 0x7fa93c195ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 --2- 172.21.15.80:0/639218265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa93c101220 0x7fa93c1960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 >> 172.21.15.80:0/639218265 conn(0x7fa93c0fb6b0 msgr2=0x7fa93c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:03.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 shutdown_connections 2022-09-07T19:42:03.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.287+0000 7fa9447ff700 1 -- 172.21.15.80:0/639218265 wait complete. 2022-09-07T19:42:03.313 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-09-07T19:42:03.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:03.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1818386221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:03.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:03.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:02 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2454859496' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:03.557 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 -- 172.21.15.80:0/3878008485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05381011b0 msgr2=0x7f0538101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.558 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 --2- 172.21.15.80:0/3878008485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05381011b0 0x7f0538101600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0528009810 tx=0x7f0528009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:03.558 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 -- 172.21.15.80:0/3878008485 shutdown_connections 2022-09-07T19:42:03.559 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 --2- 172.21.15.80:0/3878008485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0538101b40 0x7f0538108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.559 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 --2- 172.21.15.80:0/3878008485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.560 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 --2- 172.21.15.80:0/3878008485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05381011b0 0x7f0538101600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.560 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 -- 172.21.15.80:0/3878008485 >> 172.21.15.80:0/3878008485 conn(0x7f05380fb6b0 msgr2=0x7f05380fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 -- 172.21.15.80:0/3878008485 shutdown_connections 2022-09-07T19:42:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.553+0000 7f05403ff700 1 -- 172.21.15.80:0/3878008485 wait complete. 2022-09-07T19:42:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 Processor -- start 2022-09-07T19:42:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 -- start start 2022-09-07T19:42:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05381011b0 0x7f0538196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0538101b40 0x7f053819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053819d650 con 0x7f0538101b40 2022-09-07T19:42:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053819d7c0 con 0x7f05381011b0 2022-09-07T19:42:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f05403ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053819d980 con 0x7f05380fff30 2022-09-07T19:42:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f053e19b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f053d99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05381011b0 0x7f0538196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f053e99c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0538101b40 0x7f053819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f053e19b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51804/0 (socket says 172.21.15.80:51804) 2022-09-07T19:42:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.555+0000 7f053e19b700 1 -- 172.21.15.80:0/1634399105 learned_addr learned my addr 172.21.15.80:0/1634399105 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053d99a700 1 -- 172.21.15.80:0/1634399105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 msgr2=0x7f0538195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053d99a700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053d99a700 1 -- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0538101b40 msgr2=0x7f053819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053d99a700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0538101b40 0x7f053819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053d99a700 1 -- 172.21.15.80:0/1634399105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009470 con 0x7f05381011b0 2022-09-07T19:42:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053e19b700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:03.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f053d99a700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05381011b0 0x7f0538196010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0528006010 tx=0x7f052800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:03.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052801d070 con 0x7f05381011b0 2022-09-07T19:42:03.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f052800f880 con 0x7f05381011b0 2022-09-07T19:42:03.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053819dc00 con 0x7f05381011b0 2022-09-07T19:42:03.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.556+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528004860 con 0x7f05381011b0 2022-09-07T19:42:03.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.557+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053819e0b0 con 0x7f05381011b0 2022-09-07T19:42:03.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.558+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053810b6e0 con 0x7f05381011b0 2022-09-07T19:42:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.559+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f0528028030 con 0x7f05381011b0 2022-09-07T19:42:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.561+0000 7f052f7fe700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0524099010 0x7f052409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.561+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f05280c2ff0 con 0x7f05381011b0 2022-09-07T19:42:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.561+0000 7f053e19b700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0524099010 0x7f052409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.562+0000 7f053e19b700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0524099010 0x7f052409b4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0534009f60 tx=0x7f0534005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.563+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f052808fae0 con 0x7f05381011b0 2022-09-07T19:42:03.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.781+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f05381073c0 con 0x7f05381011b0 2022-09-07T19:42:03.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.782+0000 7f052f7fe700 1 -- 172.21.15.80:0/1634399105 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0528026060 con 0x7f05381011b0 2022-09-07T19:42:03.782 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:03.782 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2022-09-07T19:42:03.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2022-09-07T19:42:03.783 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2022-09-07T19:42:03.783 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2022-09-07T19:42:03.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2022-09-07T19:42:03.783 INFO:teuthology.orchestra.run.smithi080.stdout:] 2022-09-07T19:42:03.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0524099010 msgr2=0x7f052409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0524099010 0x7f052409b4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0534009f60 tx=0x7f0534005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05381011b0 msgr2=0x7f0538196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:03.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05381011b0 0x7f0538196010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0528006010 tx=0x7f052800f690 comp rx=0 tx=0).stop 2022-09-07T19:42:03.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 shutdown_connections 2022-09-07T19:42:03.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0538101b40 0x7f053819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0524099010 0x7f052409b4c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05380fff30 0x7f0538195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 --2- 172.21.15.80:0/1634399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05381011b0 0x7f0538196010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:03.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 >> 172.21.15.80:0/1634399105 conn(0x7f05380fb6b0 msgr2=0x7f0538104680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:03.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 shutdown_connections 2022-09-07T19:42:03.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:03.785+0000 7f05403ff700 1 -- 172.21.15.80:0/1634399105 wait complete. 2022-09-07T19:42:03.810 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-09-07T19:42:03.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-09-07T19:42:04.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.059+0000 7f09083ff700 1 -- 172.21.15.80:0/3788792960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 msgr2=0x7f09001055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:04.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 --2- 172.21.15.80:0/3788792960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 0x7f09001055d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009750 tx=0x7f08f0009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 -- 172.21.15.80:0/3788792960 shutdown_connections 2022-09-07T19:42:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 --2- 172.21.15.80:0/3788792960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:04.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 --2- 172.21.15.80:0/3788792960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0900105b10 0x7f0900107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:04.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 --2- 172.21.15.80:0/3788792960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 0x7f09001055d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:04.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 -- 172.21.15.80:0/3788792960 >> 172.21.15.80:0/3788792960 conn(0x7f09000f82e0 msgr2=0x7f09000fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:04.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 -- 172.21.15.80:0/3788792960 shutdown_connections 2022-09-07T19:42:04.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.060+0000 7f09083ff700 1 -- 172.21.15.80:0/3788792960 wait complete. 2022-09-07T19:42:04.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.061+0000 7f09083ff700 1 Processor -- start 2022-09-07T19:42:04.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.061+0000 7f09083ff700 1 -- start start 2022-09-07T19:42:04.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.061+0000 7f09083ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:04.072 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.061+0000 7f09083ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 0x7f0900196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:04.072 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.061+0000 7f09083ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0900105b10 0x7f090019d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:04.073 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.061+0000 7f09083ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090019d910 con 0x7f0900066bf0 2022-09-07T19:42:04.073 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f09083ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090019da80 con 0x7f0900105b10 2022-09-07T19:42:04.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f09083ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090019dc40 con 0x7f09001031f0 2022-09-07T19:42:04.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:04.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51982/0 (socket says 172.21.15.80:51982) 2022-09-07T19:42:04.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 -- 172.21.15.80:0/2060328232 learned_addr learned my addr 172.21.15.80:0/2060328232 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:04.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090599a700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 0x7f0900196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:04.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090699c700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0900105b10 0x7f090019d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:04.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 -- 172.21.15.80:0/2060328232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 msgr2=0x7f0900196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:04.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 0x7f0900196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:04.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 -- 172.21.15.80:0/2060328232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0900105b10 msgr2=0x7f090019d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:04.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0900105b10 0x7f090019d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:04.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.062+0000 7f090619b700 1 -- 172.21.15.80:0/2060328232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc009470 con 0x7f0900066bf0 2022-09-07T19:42:04.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.063+0000 7f090619b700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900195d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0057d0 tx=0x7f08fc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:04.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.063+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc004230 con 0x7f0900066bf0 2022-09-07T19:42:04.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.063+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f00093b0 con 0x7f0900066bf0 2022-09-07T19:42:04.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.063+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f08fc004390 con 0x7f0900066bf0 2022-09-07T19:42:04.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.063+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc003bd0 con 0x7f0900066bf0 2022-09-07T19:42:04.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.063+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090019e200 con 0x7f0900066bf0 2022-09-07T19:42:04.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.064+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090010b720 con 0x7f0900066bf0 2022-09-07T19:42:04.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.066+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f08fc01e020 con 0x7f0900066bf0 2022-09-07T19:42:04.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.067+0000 7f08f77fe700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f08ec099010 0x7f08ec09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:04.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.067+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f08fc014070 con 0x7f0900066bf0 2022-09-07T19:42:04.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.068+0000 7f090599a700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f08ec099010 0x7f08ec09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:04.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.068+0000 7f090599a700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f08ec099010 0x7f08ec09b4c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08f000f500 tx=0x7f08f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.072+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f08fc08edb0 con 0x7f0900066bf0 2022-09-07T19:42:04.093 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:03 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/639218265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:04.093 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:03 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1634399105' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2022-09-07T19:42:04.094 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:04.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:03 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:04.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:03 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/639218265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:04.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:03 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1634399105' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2022-09-07T19:42:04.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:03 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:04.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:03 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:04.279+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f090010b8b0 con 0x7f0900066bf0 2022-09-07T19:42:04.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:03 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/639218265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:04.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:03 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1634399105' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2022-09-07T19:42:04.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:03 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:04.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:03 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:05.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.081+0000 7f08f77fe700 1 -- 172.21.15.80:0/2060328232 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f090010b8b0 con 0x7f0900066bf0 2022-09-07T19:42:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.086+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f08ec099010 msgr2=0x7f08ec09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.086+0000 7f09083ff700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f08ec099010 0x7f08ec09b4c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08f000f500 tx=0x7f08f0005f90 comp rx=0 tx=0).stop 2022-09-07T19:42:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.086+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 msgr2=0x7f0900195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.086+0000 7f09083ff700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900195d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0057d0 tx=0x7f08fc00eca0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 shutdown_connections 2022-09-07T19:42:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0900066bf0 0x7f0900195d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f08ec099010 0x7f08ec09b4c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0900105b10 0x7f090019d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 --2- 172.21.15.80:0/2060328232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09001031f0 0x7f0900196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 >> 172.21.15.80:0/2060328232 conn(0x7f09000f82e0 msgr2=0x7f0900103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 shutdown_connections 2022-09-07T19:42:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.089+0000 7f09083ff700 1 -- 172.21.15.80:0/2060328232 wait complete. 2022-09-07T19:42:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2022-09-07T19:42:05.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2022-09-07T19:42:05.361 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:05 smithi080 ceph-mon[90124]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:05.361 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:05 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2060328232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2022-09-07T19:42:05.362 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:05 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:05.370 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:05 smithi155 ceph-mon[97606]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:05.370 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:05 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2060328232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2022-09-07T19:42:05.370 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:05 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:05.371 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:05 smithi154 ceph-mon[96967]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:05.372 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:05 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2060328232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2022-09-07T19:42:05.372 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:05 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:05.379 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 -- 172.21.15.80:0/2723943756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71941011f0 msgr2=0x7f7194101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:05.379 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 --2- 172.21.15.80:0/2723943756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71941011f0 0x7f7194101640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7180009810 tx=0x7f7180009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:05.379 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 -- 172.21.15.80:0/2723943756 shutdown_connections 2022-09-07T19:42:05.380 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 --2- 172.21.15.80:0/2723943756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7194101b80 0x7f7194108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.380 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 --2- 172.21.15.80:0/2723943756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71940fff70 0x7f7194100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.380 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 --2- 172.21.15.80:0/2723943756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71941011f0 0x7f7194101640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.380 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.379+0000 7f719abff700 1 -- 172.21.15.80:0/2723943756 >> 172.21.15.80:0/2723943756 conn(0x7f71940fb6b0 msgr2=0x7f71940fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:05.381 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.380+0000 7f719abff700 1 -- 172.21.15.80:0/2723943756 shutdown_connections 2022-09-07T19:42:05.381 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.380+0000 7f719abff700 1 -- 172.21.15.80:0/2723943756 wait complete. 2022-09-07T19:42:05.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.381+0000 7f719abff700 1 Processor -- start 2022-09-07T19:42:05.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.381+0000 7f719abff700 1 -- start start 2022-09-07T19:42:05.384 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719abff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 0x7f7194195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:05.386 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719abff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71941011f0 0x7f7194196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:05.386 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719abff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7194101b80 0x7f719419d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:05.386 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719abff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719419d8d0 con 0x7f7194101b80 2022-09-07T19:42:05.387 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719abff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719419da40 con 0x7f71941011f0 2022-09-07T19:42:05.388 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719abff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719419dc00 con 0x7f71940fff70 2022-09-07T19:42:05.388 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f7193fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71941011f0 0x7f7194196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:05.388 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719899b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 0x7f7194195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:05.389 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719899b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 0x7f7194195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51832/0 (socket says 172.21.15.80:51832) 2022-09-07T19:42:05.389 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719899b700 1 -- 172.21.15.80:0/2275149707 learned_addr learned my addr 172.21.15.80:0/2275149707 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f7193fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71941011f0 0x7f7194196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:37994/0 (socket says 172.21.15.80:37994) 2022-09-07T19:42:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.382+0000 7f719919c700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7194101b80 0x7f719419d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719899b700 1 -- 172.21.15.80:0/2275149707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71941011f0 msgr2=0x7f7194196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719899b700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71941011f0 0x7f7194196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719899b700 1 -- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7194101b80 msgr2=0x7f719419d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719899b700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7194101b80 0x7f719419d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719899b700 1 -- 172.21.15.80:0/2275149707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009470 con 0x7f71940fff70 2022-09-07T19:42:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719919c700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7194101b80 0x7f719419d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719899b700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 0x7f7194195d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f718800e710 tx=0x7f718800ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188004220 con 0x7f71940fff70 2022-09-07T19:42:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f7188004380 con 0x7f71940fff70 2022-09-07T19:42:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188003be0 con 0x7f71940fff70 2022-09-07T19:42:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.383+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719419dee0 con 0x7f71940fff70 2022-09-07T19:42:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.384+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719419e2b0 con 0x7f71940fff70 2022-09-07T19:42:05.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.385+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719410b720 con 0x7f71940fff70 2022-09-07T19:42:05.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.387+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f718801e020 con 0x7f71940fff70 2022-09-07T19:42:05.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.388+0000 7f7191ffb700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7184099010 0x7f718409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:05.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.388+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7493+0+0 (secure 0 0 0) 0x7f7188014070 con 0x7f71940fff70 2022-09-07T19:42:05.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.388+0000 7f7193fff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7184099010 0x7f718409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.389+0000 7f7193fff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7184099010 0x7f718409b4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f718000b4f0 tx=0x7f7180009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.392+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f718808ed80 con 0x7f71940fff70 2022-09-07T19:42:05.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:05.608+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f719410b8b0 con 0x7f71940fff70 2022-09-07T19:42:06.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.354+0000 7f7191ffb700 1 -- 172.21.15.80:0/2275149707 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) v1 ==== 171+0+0 (secure 0 0 0) 0x7f719410b8b0 con 0x7f71940fff70 2022-09-07T19:42:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7184099010 msgr2=0x7f718409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7184099010 0x7f718409b4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f718000b4f0 tx=0x7f7180009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 msgr2=0x7f7194195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 0x7f7194195d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f718800e710 tx=0x7f718800ea20 comp rx=0 tx=0).stop 2022-09-07T19:42:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 shutdown_connections 2022-09-07T19:42:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7194101b80 0x7f719419d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7184099010 0x7f718409b4c0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f718000b4f0 tx=0x7f7180009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71940fff70 0x7f7194195d50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 --2- 172.21.15.80:0/2275149707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71941011f0 0x7f7194196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.365+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 >> 172.21.15.80:0/2275149707 conn(0x7f71940fb6b0 msgr2=0x7f7194104420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:06.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.370+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 shutdown_connections 2022-09-07T19:42:06.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.370+0000 7f719abff700 1 -- 172.21.15.80:0/2275149707 wait complete. 2022-09-07T19:42:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2022-09-07T19:42:06.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-09-07T19:42:06.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:06 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2060328232' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2022-09-07T19:42:06.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:06 smithi080 ceph-mon[90124]: osdmap e82: 12 total, 12 up, 12 in 2022-09-07T19:42:06.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:42:06.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:42:06.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:06 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:42:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:06 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2060328232' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2022-09-07T19:42:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:06 smithi154 ceph-mon[96967]: osdmap e82: 12 total, 12 up, 12 in 2022-09-07T19:42:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:42:06.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:42:06.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:06 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:42:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 -- 172.21.15.80:0/2434688808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fca30 msgr2=0x7fac880fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 --2- 172.21.15.80:0/2434688808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fca30 0x7fac880fce40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac78009810 tx=0x7fac78009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 -- 172.21.15.80:0/2434688808 shutdown_connections 2022-09-07T19:42:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 --2- 172.21.15.80:0/2434688808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fe640 0x7fac88104f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 --2- 172.21.15.80:0/2434688808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fca30 0x7fac880fce40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 --2- 172.21.15.80:0/2434688808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fdcb0 0x7fac880fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 -- 172.21.15.80:0/2434688808 >> 172.21.15.80:0/2434688808 conn(0x7fac880f8160 msgr2=0x7fac880fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 -- 172.21.15.80:0/2434688808 shutdown_connections 2022-09-07T19:42:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.647+0000 7fac8d59d700 1 -- 172.21.15.80:0/2434688808 wait complete. 2022-09-07T19:42:06.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 Processor -- start 2022-09-07T19:42:06.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 -- start start 2022-09-07T19:42:06.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fca30 0x7fac88195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:06.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fdcb0 0x7fac88195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:06.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fe640 0x7fac8819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:06.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8819d4f0 con 0x7fac880fdcb0 2022-09-07T19:42:06.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8819d660 con 0x7fac880fe640 2022-09-07T19:42:06.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.649+0000 7fac8d59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8819d820 con 0x7fac880fca30 2022-09-07T19:42:06.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac8cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fe640 0x7fac8819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac87fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fca30 0x7fac88195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac8cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fe640 0x7fac8819cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:38002/0 (socket says 172.21.15.80:38002) 2022-09-07T19:42:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fdcb0 0x7fac88195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac87fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fca30 0x7fac88195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51850/0 (socket says 172.21.15.80:51850) 2022-09-07T19:42:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac8cd9c700 1 -- 172.21.15.80:0/4180432182 learned_addr learned my addr 172.21.15.80:0/4180432182 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac877fe700 1 -- 172.21.15.80:0/4180432182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fca30 msgr2=0x7fac88195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac877fe700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fca30 0x7fac88195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac877fe700 1 -- 172.21.15.80:0/4180432182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fe640 msgr2=0x7fac8819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac877fe700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fe640 0x7fac8819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.650+0000 7fac877fe700 1 -- 172.21.15.80:0/4180432182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac78009470 con 0x7fac880fdcb0 2022-09-07T19:42:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.651+0000 7fac877fe700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fdcb0 0x7fac88195eb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00e6c0 tx=0x7fac7c00e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.651+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c010900 con 0x7fac880fdcb0 2022-09-07T19:42:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.651+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8819db00 con 0x7fac880fdcb0 2022-09-07T19:42:06.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.651+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fac7c018420 con 0x7fac880fdcb0 2022-09-07T19:42:06.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.651+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c017610 con 0x7fac880fdcb0 2022-09-07T19:42:06.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.651+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8819e010 con 0x7fac880fdcb0 2022-09-07T19:42:06.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.652+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac881081e0 con 0x7fac880fdcb0 2022-09-07T19:42:06.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.654+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fac7c00c040 con 0x7fac880fdcb0 2022-09-07T19:42:06.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.655+0000 7fac857fa700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fac70099010 0x7fac7009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:06.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.656+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7875+0+0 (secure 0 0 0) 0x7fac7c014070 con 0x7fac880fdcb0 2022-09-07T19:42:06.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.656+0000 7fac87fff700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fac70099010 0x7fac7009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:06.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.657+0000 7fac87fff700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fac70099010 0x7fac7009b4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac7800b4f0 tx=0x7fac78009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:06.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.660+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fac7c04fc80 con 0x7fac880fdcb0 2022-09-07T19:42:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:06 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2060328232' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2022-09-07T19:42:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:06 smithi155 ceph-mon[97606]: osdmap e82: 12 total, 12 up, 12 in 2022-09-07T19:42:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:42:06.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:42:06.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:06 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:42:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.914+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fac8819eb80 con 0x7fac880fdcb0 2022-09-07T19:42:06.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.921+0000 7fac857fa700 1 -- 172.21.15.80:0/4180432182 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fac7c08eaf0 con 0x7fac880fdcb0 2022-09-07T19:42:06.929 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.928+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fac70099010 msgr2=0x7fac7009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.929 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.928+0000 7fac8d59d700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fac70099010 0x7fac7009b4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac7800b4f0 tx=0x7fac78009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.929 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.928+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fdcb0 msgr2=0x7fac88195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:06.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.928+0000 7fac8d59d700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fdcb0 0x7fac88195eb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00e6c0 tx=0x7fac7c00e9d0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.930+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 shutdown_connections 2022-09-07T19:42:06.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.930+0000 7fac8d59d700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fac70099010 0x7fac7009b4c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.930+0000 7fac8d59d700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880fe640 0x7fac8819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.930+0000 7fac8d59d700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac880fca30 0x7fac88195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.930+0000 7fac8d59d700 1 --2- 172.21.15.80:0/4180432182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac880fdcb0 0x7fac88195eb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:06.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.930+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 >> 172.21.15.80:0/4180432182 conn(0x7fac880f8160 msgr2=0x7fac88065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:06.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.939+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 shutdown_connections 2022-09-07T19:42:06.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:06.939+0000 7fac8d59d700 1 -- 172.21.15.80:0/4180432182 wait complete. 2022-09-07T19:42:06.948 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2022-09-07T19:42:06.979 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2022-09-07T19:42:06.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2022-09-07T19:42:07.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1419719018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580ff510 msgr2=0x7fab581060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1419719018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580ff510 0x7fab581060b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab50009bb0 tx=0x7fab50009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1419719018 shutdown_connections 2022-09-07T19:42:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1419719018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580ff510 0x7fab581060b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1419719018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab580fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1419719018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580fe490 0x7fab580fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1419719018 >> 172.21.15.80:0/1419719018 conn(0x7fab580f9230 msgr2=0x7fab580fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.229+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1419719018 shutdown_connections 2022-09-07T19:42:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.230+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1419719018 wait complete. 2022-09-07T19:42:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 Processor -- start 2022-09-07T19:42:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 -- start start 2022-09-07T19:42:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab581958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580fe490 0x7fab58195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580ff510 0x7fab5819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819d450 con 0x7fab580ff510 2022-09-07T19:42:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819d5c0 con 0x7fab580fdb40 2022-09-07T19:42:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab5cd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819d780 con 0x7fab580fe490 2022-09-07T19:42:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab57fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580ff510 0x7fab5819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.231+0000 7fab56ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580fe490 0x7fab58195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab581958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab57fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580ff510 0x7fab5819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52016/0 (socket says 172.21.15.80:52016) 2022-09-07T19:42:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab57fff700 1 -- 172.21.15.80:0/1123297241 learned_addr learned my addr 172.21.15.80:0/1123297241 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:07.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab581958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:38012/0 (socket says 172.21.15.80:38012) 2022-09-07T19:42:07.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 -- 172.21.15.80:0/1123297241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580fe490 msgr2=0x7fab58195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:07.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580fe490 0x7fab58195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 -- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580ff510 msgr2=0x7fab5819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:07.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580ff510 0x7fab5819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 -- 172.21.15.80:0/1123297241 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480093b0 con 0x7fab580fdb40 2022-09-07T19:42:07.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab577fe700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab581958d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab4800e9c0 tx=0x7fab4800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:07.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.232+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48004220 con 0x7fab580fdb40 2022-09-07T19:42:07.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.233+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fab48004380 con 0x7fab580fdb40 2022-09-07T19:42:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.233+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab500097e0 con 0x7fab580fdb40 2022-09-07T19:42:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.233+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48003cf0 con 0x7fab580fdb40 2022-09-07T19:42:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.233+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5819dde0 con 0x7fab580fdb40 2022-09-07T19:42:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.234+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab58109330 con 0x7fab580fdb40 2022-09-07T19:42:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.235+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fab4801e020 con 0x7fab580fdb40 2022-09-07T19:42:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.237+0000 7fab54ff9700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fab40099010 0x7fab4009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.237+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7975+0+0 (secure 0 0 0) 0x7fab48014070 con 0x7fab580fdb40 2022-09-07T19:42:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.237+0000 7fab56ffd700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fab40099010 0x7fab4009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:07.245 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.237+0000 7fab56ffd700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fab40099010 0x7fab4009b4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab580fe860 tx=0x7fab4c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:07.245 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.240+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fab4808ee80 con 0x7fab580fdb40 2022-09-07T19:42:07.453 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.453+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fab5805fae0 con 0x7fab580fdb40 2022-09-07T19:42:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2275149707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2022-09-07T19:42:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2022-09-07T19:42:07.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: pgmap v294: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:07.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2022-09-07T19:42:07.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: osdmap e83: 12 total, 12 up, 12 in 2022-09-07T19:42:07.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4180432182' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2022-09-07T19:42:07.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: daemon mds.b assigned to filesystem cephfs as rank 0 2022-09-07T19:42:07.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: osdmap e84: 12 total, 12 up, 12 in 2022-09-07T19:42:07.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4180432182' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2022-09-07T19:42:07.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2022-09-07T19:42:07.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:07 smithi080 ceph-mon[90124]: daemon mds.b is now active in filesystem cephfs as rank 0 2022-09-07T19:42:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2275149707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2022-09-07T19:42:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2022-09-07T19:42:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: pgmap v294: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:07.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2022-09-07T19:42:07.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: osdmap e83: 12 total, 12 up, 12 in 2022-09-07T19:42:07.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4180432182' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2022-09-07T19:42:07.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: daemon mds.b assigned to filesystem cephfs as rank 0 2022-09-07T19:42:07.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: osdmap e84: 12 total, 12 up, 12 in 2022-09-07T19:42:07.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4180432182' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2022-09-07T19:42:07.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2022-09-07T19:42:07.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:07 smithi154 ceph-mon[96967]: daemon mds.b is now active in filesystem cephfs as rank 0 2022-09-07T19:42:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2275149707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2022-09-07T19:42:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2022-09-07T19:42:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: pgmap v294: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2022-09-07T19:42:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: osdmap e83: 12 total, 12 up, 12 in 2022-09-07T19:42:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4180432182' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2022-09-07T19:42:07.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: daemon mds.b assigned to filesystem cephfs as rank 0 2022-09-07T19:42:07.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: osdmap e84: 12 total, 12 up, 12 in 2022-09-07T19:42:07.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4180432182' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2022-09-07T19:42:07.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2022-09-07T19:42:07.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:07 smithi155 ceph-mon[97606]: daemon mds.b is now active in filesystem cephfs as rank 0 2022-09-07T19:42:07.927 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.927+0000 7fab54ff9700 1 -- 172.21.15.80:0/1123297241 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) v1 ==== 157+0+0 (secure 0 0 0) 0x7fab480924a0 con 0x7fab580fdb40 2022-09-07T19:42:07.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fab40099010 msgr2=0x7fab4009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:07.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fab40099010 0x7fab4009b4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab580fe860 tx=0x7fab4c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 msgr2=0x7fab581958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab581958d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab4800e9c0 tx=0x7fab4800ecd0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.933 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 shutdown_connections 2022-09-07T19:42:07.933 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab580ff510 0x7fab5819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.933 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fab40099010 0x7fab4009b4c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.934 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab580fdb40 0x7fab581958d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.934 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 --2- 172.21.15.80:0/1123297241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab580fe490 0x7fab58195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:07.935 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 >> 172.21.15.80:0/1123297241 conn(0x7fab580f9230 msgr2=0x7fab58104760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:07.935 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 shutdown_connections 2022-09-07T19:42:07.936 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:07.930+0000 7fab5cd9d700 1 -- 172.21.15.80:0/1123297241 wait complete. 2022-09-07T19:42:07.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2022-09-07T19:42:08.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 -- 172.21.15.80:0/85195982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 msgr2=0x7ffb20071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/85195982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 0x7ffb20071170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009810 tx=0x7ffb10009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 -- 172.21.15.80:0/85195982 shutdown_connections 2022-09-07T19:42:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/85195982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 0x7ffb20071170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/85195982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb20105a20 0x7ffb20107e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/85195982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb200716b0 0x7ffb20071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 -- 172.21.15.80:0/85195982 >> 172.21.15.80:0/85195982 conn(0x7ffb200f9220 msgr2=0x7ffb200fb630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 -- 172.21.15.80:0/85195982 shutdown_connections 2022-09-07T19:42:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.225+0000 7ffb1ffff700 1 -- 172.21.15.80:0/85195982 wait complete. 2022-09-07T19:42:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.226+0000 7ffb1ffff700 1 Processor -- start 2022-09-07T19:42:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.226+0000 7ffb1ffff700 1 -- start start 2022-09-07T19:42:08.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 0x7ffb201959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:08.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 0x7ffb20195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:08.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb20105a20 0x7ffb2019cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:08.231 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2019d530 con 0x7ffb20072bf0 2022-09-07T19:42:08.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2019d6a0 con 0x7ffb200716b0 2022-09-07T19:42:08.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2019d860 con 0x7ffb20105a20 2022-09-07T19:42:08.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 0x7ffb201959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:08.232 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 0x7ffb201959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:38028/0 (socket says 172.21.15.80:38028) 2022-09-07T19:42:08.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 -- 172.21.15.80:0/3448779430 learned_addr learned my addr 172.21.15.80:0/3448779430 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:08.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 0x7ffb20195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1f7fe700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb20105a20 0x7ffb2019cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 -- 172.21.15.80:0/3448779430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb20105a20 msgr2=0x7ffb2019cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:08.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb20105a20 0x7ffb2019cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:08.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 -- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 msgr2=0x7ffb20195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:08.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 0x7ffb20195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:08.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1effd700 1 -- 172.21.15.80:0/3448779430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009470 con 0x7ffb200716b0 2022-09-07T19:42:08.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.227+0000 7ffb1f7fe700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb20105a20 0x7ffb2019cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:08.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.228+0000 7ffb1effd700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 0x7ffb201959b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006010 tx=0x7ffb1000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:08.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.228+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1001d070 con 0x7ffb200716b0 2022-09-07T19:42:08.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.228+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ffb100054f0 con 0x7ffb200716b0 2022-09-07T19:42:08.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.228+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2019dae0 con 0x7ffb200716b0 2022-09-07T19:42:08.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.228+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100048b0 con 0x7ffb200716b0 2022-09-07T19:42:08.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.228+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2019dfe0 con 0x7ffb200716b0 2022-09-07T19:42:08.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.229+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2010b4d0 con 0x7ffb200716b0 2022-09-07T19:42:08.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.231+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ffb10028030 con 0x7ffb200716b0 2022-09-07T19:42:08.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.232+0000 7ffb03fff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb08099090 0x7ffb0809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:08.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.232+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8201+0+0 (secure 0 0 0) 0x7ffb100c3140 con 0x7ffb200716b0 2022-09-07T19:42:08.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.233+0000 7ffb1e7fc700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb08099090 0x7ffb0809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:08.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.233+0000 7ffb1e7fc700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb08099090 0x7ffb0809b540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb14005fd0 tx=0x7ffb14005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:08.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.236+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ffb1008f7f0 con 0x7ffb200716b0 2022-09-07T19:42:08.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:08.444+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffb2005fae0 con 0x7ffb200716b0 2022-09-07T19:42:08.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1123297241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2022-09-07T19:42:08.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2022-09-07T19:42:08.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] up:active 2022-09-07T19:42:08.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:08.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2022-09-07T19:42:08.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: osdmap e85: 12 total, 12 up, 12 in 2022-09-07T19:42:08.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:08.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:08 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1123297241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2022-09-07T19:42:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2022-09-07T19:42:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] up:active 2022-09-07T19:42:08.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:08.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2022-09-07T19:42:08.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: osdmap e85: 12 total, 12 up, 12 in 2022-09-07T19:42:08.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:08.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:08 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1123297241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2022-09-07T19:42:08.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2022-09-07T19:42:08.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] up:active 2022-09-07T19:42:08.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:08.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2022-09-07T19:42:08.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: osdmap e85: 12 total, 12 up, 12 in 2022-09-07T19:42:08.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:08.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:08.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:08 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:09.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:09 smithi080 ceph-mon[90124]: pgmap v297: 97 pgs: 9 creating+peering, 29 active+clean, 59 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2022-09-07T19:42:09.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:09 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3448779430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2022-09-07T19:42:09.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:09 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2022-09-07T19:42:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:09 smithi154 ceph-mon[96967]: pgmap v297: 97 pgs: 9 creating+peering, 29 active+clean, 59 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2022-09-07T19:42:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:09 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3448779430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2022-09-07T19:42:09.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:09 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2022-09-07T19:42:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:09 smithi155 ceph-mon[97606]: pgmap v297: 97 pgs: 9 creating+peering, 29 active+clean, 59 unknown; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2022-09-07T19:42:09.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:09 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3448779430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2022-09-07T19:42:09.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:09 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2022-09-07T19:42:10.385 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.386+0000 7ffb03fff700 1 -- 172.21.15.80:0/3448779430 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) v1 ==== 228+0+0 (secure 0 0 0) 0x7ffb10092e10 con 0x7ffb200716b0 2022-09-07T19:42:10.394 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb08099090 msgr2=0x7ffb0809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:10.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb08099090 0x7ffb0809b540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb14005fd0 tx=0x7ffb14005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 msgr2=0x7ffb201959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:10.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 0x7ffb201959b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006010 tx=0x7ffb1000f690 comp rx=0 tx=0).stop 2022-09-07T19:42:10.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 shutdown_connections 2022-09-07T19:42:10.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ffb08099090 0x7ffb0809b540 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb20105a20 0x7ffb2019cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb200716b0 0x7ffb201959b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 --2- 172.21.15.80:0/3448779430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb20072bf0 0x7ffb20195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 >> 172.21.15.80:0/3448779430 conn(0x7ffb200f9220 msgr2=0x7ffb200fb600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:10.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 shutdown_connections 2022-09-07T19:42:10.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.394+0000 7ffb1ffff700 1 -- 172.21.15.80:0/3448779430 wait complete. 2022-09-07T19:42:10.398 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' created 2022-09-07T19:42:10.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2022-09-07T19:42:10.497 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:10 smithi080 ceph-mon[90124]: osdmap e86: 12 total, 12 up, 12 in 2022-09-07T19:42:10.498 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.498 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.498 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:10 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.624 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:42:10 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-b[123748]: 2022-09-07T19:42:10.293+0000 7f0656a61700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-09-07T19:42:10.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:10 smithi154 ceph-mon[96967]: osdmap e86: 12 total, 12 up, 12 in 2022-09-07T19:42:10.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:10 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 -- 172.21.15.80:0/2993587969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fdd00 msgr2=0x7f31080fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:10.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 --2- 172.21.15.80:0/2993587969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fdd00 0x7f31080fe110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009810 tx=0x7f30fc009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:10.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 -- 172.21.15.80:0/2993587969 shutdown_connections 2022-09-07T19:42:10.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 --2- 172.21.15.80:0/2993587969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31080ff910 0x7f31081061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.654 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 --2- 172.21.15.80:0/2993587969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fdd00 0x7f31080fe110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 --2- 172.21.15.80:0/2993587969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080fef80 0x7f31080ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 -- 172.21.15.80:0/2993587969 >> 172.21.15.80:0/2993587969 conn(0x7f31080f93f0 msgr2=0x7f31080fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:10.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 -- 172.21.15.80:0/2993587969 shutdown_connections 2022-09-07T19:42:10.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.653+0000 7f310ebff700 1 -- 172.21.15.80:0/2993587969 wait complete. 2022-09-07T19:42:10.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.654+0000 7f310ebff700 1 Processor -- start 2022-09-07T19:42:10.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.654+0000 7f310ebff700 1 -- start start 2022-09-07T19:42:10.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310ebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31080fdd00 0x7f3108193970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:10.659 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310ebff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fef80 0x7f3108193eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310ebff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 0x7f310819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310ebff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819b4f0 con 0x7f31080ff910 2022-09-07T19:42:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310ebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819b660 con 0x7f31080fdd00 2022-09-07T19:42:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310ebff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819b820 con 0x7f31080fef80 2022-09-07T19:42:10.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310d19c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 0x7f310819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:10.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310d19c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 0x7f310819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52046/0 (socket says 172.21.15.80:52046) 2022-09-07T19:42:10.661 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310c99b700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31080fdd00 0x7f3108193970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:10.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f3107fff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fef80 0x7f3108193eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:10.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.655+0000 7f310d19c700 1 -- 172.21.15.80:0/3748937340 learned_addr learned my addr 172.21.15.80:0/3748937340 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:10.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310d19c700 1 -- 172.21.15.80:0/3748937340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fef80 msgr2=0x7f3108193eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:10.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310d19c700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fef80 0x7f3108193eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310d19c700 1 -- 172.21.15.80:0/3748937340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31080fdd00 msgr2=0x7f3108193970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:10.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310d19c700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31080fdd00 0x7f3108193970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:10.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310d19c700 1 -- 172.21.15.80:0/3748937340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc009470 con 0x7f31080ff910 2022-09-07T19:42:10.663 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f3107fff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fef80 0x7f3108193eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:10.664 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310d19c700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 0x7f310819af20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f310000eaf0 tx=0x7f310000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:10.664 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100009960 con 0x7f31080ff910 2022-09-07T19:42:10.664 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310819bb00 con 0x7f31080ff910 2022-09-07T19:42:10.665 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f310000ce70 con 0x7f31080ff910 2022-09-07T19:42:10.665 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000058b0 con 0x7f31080ff910 2022-09-07T19:42:10.665 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.656+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310819c010 con 0x7f31080ff910 2022-09-07T19:42:10.666 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.657+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31081094b0 con 0x7f31080ff910 2022-09-07T19:42:10.666 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.659+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f310001e020 con 0x7f31080ff910 2022-09-07T19:42:10.667 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.661+0000 7f3105ffb700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f30f8099010 0x7f30f809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:10.667 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.661+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8694+0+0 (secure 0 0 0) 0x7f3100014070 con 0x7f31080ff910 2022-09-07T19:42:10.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.661+0000 7f310c99b700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f30f8099010 0x7f30f809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:10.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.662+0000 7f310c99b700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f30f8099010 0x7f30f809b4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30fc000c00 tx=0x7f30fc009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:10.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.665+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f310008f000 con 0x7f31080ff910 2022-09-07T19:42:10.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:10 smithi155 ceph-mon[97606]: osdmap e86: 12 total, 12 up, 12 in 2022-09-07T19:42:10.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:10 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:42:10.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:10.856+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f310805fb20 con 0x7f31080ff910 2022-09-07T19:42:11.387 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.387+0000 7f3105ffb700 1 -- 172.21.15.80:0/3748937340 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3100092620 con 0x7f31080ff910 2022-09-07T19:42:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.399+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f30f8099010 msgr2=0x7f30f809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.399+0000 7f310ebff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f30f8099010 0x7f30f809b4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30fc000c00 tx=0x7f30fc009e70 comp rx=0 tx=0).stop 2022-09-07T19:42:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.399+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 msgr2=0x7f310819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.399+0000 7f310ebff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 0x7f310819af20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f310000eaf0 tx=0x7f310000ee00 comp rx=0 tx=0).stop 2022-09-07T19:42:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.404+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 shutdown_connections 2022-09-07T19:42:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.404+0000 7f310ebff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31080ff910 0x7f310819af20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.404+0000 7f310ebff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f30f8099010 0x7f30f809b4c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.404+0000 7f310ebff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31080fdd00 0x7f3108193970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.404+0000 7f310ebff700 1 --2- 172.21.15.80:0/3748937340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31080fef80 0x7f3108193eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.404+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 >> 172.21.15.80:0/3748937340 conn(0x7f31080f93f0 msgr2=0x7f31080fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.406+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 shutdown_connections 2022-09-07T19:42:11.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.406+0000 7f310ebff700 1 -- 172.21.15.80:0/3748937340 wait complete. 2022-09-07T19:42:11.412 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 4 allow_ec_overwrites to true 2022-09-07T19:42:11.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2022-09-07T19:42:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.669+0000 7efbfd9ff700 1 -- 172.21.15.80:0/468800021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf81038e0 msgr2=0x7efbf8105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.669+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/468800021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf81038e0 0x7efbf8105d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009bb0 tx=0x7efbf0009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 -- 172.21.15.80:0/468800021 shutdown_connections 2022-09-07T19:42:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/468800021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf81038e0 0x7efbf8105d60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/468800021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf8066bf0 0x7efbf81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/468800021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf8100df0 0x7efbf8103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 -- 172.21.15.80:0/468800021 >> 172.21.15.80:0/468800021 conn(0x7efbf80f82e0 msgr2=0x7efbf80fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 -- 172.21.15.80:0/468800021 shutdown_connections 2022-09-07T19:42:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.670+0000 7efbfd9ff700 1 -- 172.21.15.80:0/468800021 wait complete. 2022-09-07T19:42:11.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 Processor -- start 2022-09-07T19:42:11.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 -- start start 2022-09-07T19:42:11.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf8066bf0 0x7efbf8195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:11.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 0x7efbf8196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf81038e0 0x7efbf819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf819d6d0 con 0x7efbf8100df0 2022-09-07T19:42:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf819d840 con 0x7efbf81038e0 2022-09-07T19:42:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.671+0000 7efbfd9ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf819da00 con 0x7efbf8066bf0 2022-09-07T19:42:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 0x7efbf8196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf81038e0 0x7efbf819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 0x7efbf8196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52068/0 (socket says 172.21.15.80:52068) 2022-09-07T19:42:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 -- 172.21.15.80:0/2913469865 learned_addr learned my addr 172.21.15.80:0/2913469865 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf6ffd700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf8066bf0 0x7efbf8195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 -- 172.21.15.80:0/2913469865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf8066bf0 msgr2=0x7efbf8195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf8066bf0 0x7efbf8195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 -- 172.21.15.80:0/2913469865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf81038e0 msgr2=0x7efbf819d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf81038e0 0x7efbf819d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 -- 172.21.15.80:0/2913469865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00097e0 con 0x7efbf8100df0 2022-09-07T19:42:11.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf77fe700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf81038e0 0x7efbf819d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:11.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.672+0000 7efbf67fc700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 0x7efbf8196090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efbec00e740 tx=0x7efbec00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:11.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.673+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec005220 con 0x7efbf8100df0 2022-09-07T19:42:11.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.673+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efbec005380 con 0x7efbf8100df0 2022-09-07T19:42:11.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.673+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec004b70 con 0x7efbf8100df0 2022-09-07T19:42:11.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.673+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf819dce0 con 0x7efbf8100df0 2022-09-07T19:42:11.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.673+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf819e1a0 con 0x7efbf8100df0 2022-09-07T19:42:11.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.674+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf81094f0 con 0x7efbf8100df0 2022-09-07T19:42:11.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.676+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7efbec01e020 con 0x7efbf8100df0 2022-09-07T19:42:11.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.677+0000 7efbfc9fd700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe0099090 0x7efbe009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:11.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.677+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8694+0+0 (secure 0 0 0) 0x7efbec014070 con 0x7efbf8100df0 2022-09-07T19:42:11.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.677+0000 7efbf6ffd700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe0099090 0x7efbe009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:11.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.678+0000 7efbf6ffd700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe0099090 0x7efbe009b540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efbf8066fc0 tx=0x7efbe8005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:11.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.679+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7efbec08ef70 con 0x7efbf8100df0 2022-09-07T19:42:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:11 smithi155 ceph-mon[97606]: pgmap v300: 97 pgs: 9 creating+peering, 86 active+clean, 2 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 9 op/s 2022-09-07T19:42:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:11 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2022-09-07T19:42:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:11 smithi155 ceph-mon[97606]: osdmap e87: 12 total, 12 up, 12 in 2022-09-07T19:42:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:11 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3748937340' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2022-09-07T19:42:11.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:11 smithi080 ceph-mon[90124]: pgmap v300: 97 pgs: 9 creating+peering, 86 active+clean, 2 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 9 op/s 2022-09-07T19:42:11.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:11 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2022-09-07T19:42:11.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:11 smithi080 ceph-mon[90124]: osdmap e87: 12 total, 12 up, 12 in 2022-09-07T19:42:11.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:11 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3748937340' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2022-09-07T19:42:11.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:11 smithi154 ceph-mon[96967]: pgmap v300: 97 pgs: 9 creating+peering, 86 active+clean, 2 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 9 op/s 2022-09-07T19:42:11.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:11 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2022-09-07T19:42:11.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:11 smithi154 ceph-mon[96967]: osdmap e87: 12 total, 12 up, 12 in 2022-09-07T19:42:11.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:11 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3748937340' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2022-09-07T19:42:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.920+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7efbf81052d0 con 0x7efbf8100df0 2022-09-07T19:42:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.927+0000 7efbfc9fd700 1 -- 172.21.15.80:0/2913469865 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7efbec092590 con 0x7efbf8100df0 2022-09-07T19:42:11.929 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe0099090 msgr2=0x7efbe009b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe0099090 0x7efbe009b540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efbf8066fc0 tx=0x7efbe8005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 msgr2=0x7efbf8196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:11.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 0x7efbf8196090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efbec00e740 tx=0x7efbec00ea50 comp rx=0 tx=0).stop 2022-09-07T19:42:11.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 shutdown_connections 2022-09-07T19:42:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efbe0099090 0x7efbe009b540 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf81038e0 0x7efbf819d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf8066bf0 0x7efbf8195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 --2- 172.21.15.80:0/2913469865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8100df0 0x7efbf8196090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 >> 172.21.15.80:0/2913469865 conn(0x7efbf80f82e0 msgr2=0x7efbf80ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:11.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 shutdown_connections 2022-09-07T19:42:11.932 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:11.930+0000 7efbfd9ff700 1 -- 172.21.15.80:0/2913469865 wait complete. 2022-09-07T19:42:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:added data pool 4 to fsmap 2022-09-07T19:42:11.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:42:12.185 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 -- 172.21.15.80:0/3057277233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c066bf0 msgr2=0x7f065c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.185 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 --2- 172.21.15.80:0/3057277233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c066bf0 0x7f065c100890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f064c009810 tx=0x7f064c009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:12.185 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 -- 172.21.15.80:0/3057277233 shutdown_connections 2022-09-07T19:42:12.186 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 --2- 172.21.15.80:0/3057277233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c066bf0 0x7f065c100890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.186 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 --2- 172.21.15.80:0/3057277233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065c1038c0 0x7f065c105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.186 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 --2- 172.21.15.80:0/3057277233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c100dd0 0x7f065c103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.186 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 -- 172.21.15.80:0/3057277233 >> 172.21.15.80:0/3057277233 conn(0x7f065c0f82a0 msgr2=0x7f065c0fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 -- 172.21.15.80:0/3057277233 shutdown_connections 2022-09-07T19:42:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.185+0000 7f06611ff700 1 -- 172.21.15.80:0/3057277233 wait complete. 2022-09-07T19:42:12.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.186+0000 7f06611ff700 1 Processor -- start 2022-09-07T19:42:12.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 -- start start 2022-09-07T19:42:12.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c066bf0 0x7f065c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 0x7f065c1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065c1038c0 0x7f065c19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c19d6e0 con 0x7f065c100dd0 2022-09-07T19:42:12.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c19d850 con 0x7f065c066bf0 2022-09-07T19:42:12.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f06611ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c19da10 con 0x7f065c1038c0 2022-09-07T19:42:12.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f065a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 0x7f065c1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f065ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c066bf0 0x7f065c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f065a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 0x7f065c1960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52084/0 (socket says 172.21.15.80:52084) 2022-09-07T19:42:12.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f065a59c700 1 -- 172.21.15.80:0/3085981751 learned_addr learned my addr 172.21.15.80:0/3085981751 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:12.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.187+0000 7f065b59e700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065c1038c0 0x7f065c19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065a59c700 1 -- 172.21.15.80:0/3085981751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065c1038c0 msgr2=0x7f065c19d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065a59c700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065c1038c0 0x7f065c19d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065a59c700 1 -- 172.21.15.80:0/3085981751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c066bf0 msgr2=0x7f065c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065a59c700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c066bf0 0x7f065c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065a59c700 1 -- 172.21.15.80:0/3085981751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009470 con 0x7f065c100dd0 2022-09-07T19:42:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065ad9d700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c066bf0 0x7f065c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f065a59c700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 0x7f065c1960a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f065000e740 tx=0x7f065000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650005220 con 0x7f065c100dd0 2022-09-07T19:42:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c19dcf0 con 0x7f065c100dd0 2022-09-07T19:42:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f0650005380 con 0x7f065c100dd0 2022-09-07T19:42:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.188+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650004b70 con 0x7f065c100dd0 2022-09-07T19:42:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.189+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c19e1f0 con 0x7f065c100dd0 2022-09-07T19:42:12.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.190+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c109490 con 0x7f065c100dd0 2022-09-07T19:42:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.191+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f065001e020 con 0x7f065c100dd0 2022-09-07T19:42:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.193+0000 7f063ffff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0644099090 0x7f064409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.193+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f0650014070 con 0x7f065c100dd0 2022-09-07T19:42:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.193+0000 7f065ad9d700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0644099090 0x7f064409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.194+0000 7f065ad9d700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0644099090 0x7f064409b540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f064c000c00 tx=0x7f064c009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.197+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f065008eb30 con 0x7f065c100dd0 2022-09-07T19:42:12.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.434+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f065c05f120 con 0x7f065c100dd0 2022-09-07T19:42:12.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.434+0000 7f063ffff700 1 -- 172.21.15.80:0/3085981751 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10673 (secure 0 0 0) 0x7f0650092150 con 0x7f065c100dd0 2022-09-07T19:42:12.434 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:12.434 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-09-07T19:42:06.917499+0000","modified":"2022-09-07T19:42:11.922580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-09-07T19:42:12.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0644099090 msgr2=0x7f064409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0644099090 0x7f064409b540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f064c000c00 tx=0x7f064c009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 msgr2=0x7f065c1960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 0x7f065c1960a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f065000e740 tx=0x7f065000ea50 comp rx=0 tx=0).stop 2022-09-07T19:42:12.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 shutdown_connections 2022-09-07T19:42:12.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0644099090 0x7f064409b540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065c1038c0 0x7f065c19d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f065c066bf0 0x7f065c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 --2- 172.21.15.80:0/3085981751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c100dd0 0x7f065c1960a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 >> 172.21.15.80:0/3085981751 conn(0x7f065c0f82a0 msgr2=0x7f065c0fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:12.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 shutdown_connections 2022-09-07T19:42:12.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.437+0000 7f06611ff700 1 -- 172.21.15.80:0/3085981751 wait complete. 2022-09-07T19:42:12.440 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 17 2022-09-07T19:42:12.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:12.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 -- 172.21.15.80:0/2707117928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40fdb40 msgr2=0x7f78b40fdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 --2- 172.21.15.80:0/2707117928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40fdb40 0x7f78b40fdf50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009750 tx=0x7f78b0009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:12.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 -- 172.21.15.80:0/2707117928 shutdown_connections 2022-09-07T19:42:12.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 --2- 172.21.15.80:0/2707117928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40ff510 0x7f78b41060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 --2- 172.21.15.80:0/2707117928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40fdb40 0x7f78b40fdf50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 --2- 172.21.15.80:0/2707117928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 0x7f78b40fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.690+0000 7f78ba59d700 1 -- 172.21.15.80:0/2707117928 >> 172.21.15.80:0/2707117928 conn(0x7f78b40f9230 msgr2=0x7f78b40fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:12.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.691+0000 7f78ba59d700 1 -- 172.21.15.80:0/2707117928 shutdown_connections 2022-09-07T19:42:12.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.691+0000 7f78ba59d700 1 -- 172.21.15.80:0/2707117928 wait complete. 2022-09-07T19:42:12.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.692+0000 7f78ba59d700 1 Processor -- start 2022-09-07T19:42:12.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.692+0000 7f78ba59d700 1 -- start start 2022-09-07T19:42:12.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.692+0000 7f78ba59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40fdb40 0x7f78b4195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.692+0000 7f78ba59d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 0x7f78b4195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78ba59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40ff510 0x7f78b419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78ba59d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b419d500 con 0x7f78b40fe490 2022-09-07T19:42:12.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78ba59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b419d670 con 0x7f78b40ff510 2022-09-07T19:42:12.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78ba59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b419d830 con 0x7f78b40fdb40 2022-09-07T19:42:12.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b959b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40fdb40 0x7f78b4195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b8d9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 0x7f78b4195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b9d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40ff510 0x7f78b419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b959b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40fdb40 0x7f78b4195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:58642/0 (socket says 172.21.15.80:58642) 2022-09-07T19:42:12.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b959b700 1 -- 172.21.15.80:0/1873273461 learned_addr learned my addr 172.21.15.80:0/1873273461 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:12.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b8d9a700 1 -- 172.21.15.80:0/1873273461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40fdb40 msgr2=0x7f78b4195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b8d9a700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40fdb40 0x7f78b4195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b8d9a700 1 -- 172.21.15.80:0/1873273461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40ff510 msgr2=0x7f78b419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b8d9a700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40ff510 0x7f78b419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.693+0000 7f78b8d9a700 1 -- 172.21.15.80:0/1873273461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009470 con 0x7f78b40fe490 2022-09-07T19:42:12.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.694+0000 7f78b8d9a700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 0x7f78b4195ec0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f78b40fe860 tx=0x7f78a400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:12.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.694+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004220 con 0x7f78b40fe490 2022-09-07T19:42:12.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.694+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b00093b0 con 0x7f78b40fe490 2022-09-07T19:42:12.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.694+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f78a4004380 con 0x7f78b40fe490 2022-09-07T19:42:12.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.694+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4003cf0 con 0x7f78b40fe490 2022-09-07T19:42:12.701 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.694+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b419dee0 con 0x7f78b40fe490 2022-09-07T19:42:12.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:12 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3748937340' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2022-09-07T19:42:12.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:12 smithi155 ceph-mon[97606]: osdmap e88: 12 total, 12 up, 12 in 2022-09-07T19:42:12.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:12 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2913469865' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2022-09-07T19:42:12.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:12 smithi155 ceph-mon[97606]: osdmap e89: 12 total, 12 up, 12 in 2022-09-07T19:42:12.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:12 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2913469865' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2022-09-07T19:42:12.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:12 smithi155 ceph-mon[97606]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.696+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b4109330 con 0x7f78b40fe490 2022-09-07T19:42:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.698+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f78a401e020 con 0x7f78b40fe490 2022-09-07T19:42:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.699+0000 7f78aa7fc700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f78a0099090 0x7f78a009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.699+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f78a4014070 con 0x7f78b40fe490 2022-09-07T19:42:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.699+0000 7f78b959b700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f78a0099090 0x7f78a009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.700+0000 7f78b959b700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f78a0099090 0x7f78a009b540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009e30 tx=0x7f78b0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.702+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f78a408ec60 con 0x7f78b40fe490 2022-09-07T19:42:12.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:12 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3748937340' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2022-09-07T19:42:12.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:12 smithi080 ceph-mon[90124]: osdmap e88: 12 total, 12 up, 12 in 2022-09-07T19:42:12.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:12 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2913469865' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2022-09-07T19:42:12.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:12 smithi080 ceph-mon[90124]: osdmap e89: 12 total, 12 up, 12 in 2022-09-07T19:42:12.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:12 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2913469865' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2022-09-07T19:42:12.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:12 smithi080 ceph-mon[90124]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:12 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3748937340' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2022-09-07T19:42:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:12 smithi154 ceph-mon[96967]: osdmap e88: 12 total, 12 up, 12 in 2022-09-07T19:42:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:12 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2913469865' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2022-09-07T19:42:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:12 smithi154 ceph-mon[96967]: osdmap e89: 12 total, 12 up, 12 in 2022-09-07T19:42:12.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:12 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2913469865' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2022-09-07T19:42:12.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:12 smithi154 ceph-mon[96967]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.894+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78b419d9f0 con 0x7f78b40fe490 2022-09-07T19:42:12.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.896+0000 7f78aa7fc700 1 -- 172.21.15.80:0/1873273461 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7f78a4092280 con 0x7f78b40fe490 2022-09-07T19:42:12.896 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:12.896 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f78a0099090 msgr2=0x7f78a009b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f78a0099090 0x7f78a009b540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009e30 tx=0x7f78b0005fd0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 msgr2=0x7f78b4195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 0x7f78b4195ec0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f78b40fe860 tx=0x7f78a400eca0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 shutdown_connections 2022-09-07T19:42:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f78a0099090 0x7f78a009b540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b40ff510 0x7f78b419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40fdb40 0x7f78b4195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 --2- 172.21.15.80:0/1873273461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b40fe490 0x7f78b4195ec0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.898+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 >> 172.21.15.80:0/1873273461 conn(0x7f78b40f9230 msgr2=0x7f78b41047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.899+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 shutdown_connections 2022-09-07T19:42:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:12.899+0000 7f78ba59d700 1 -- 172.21.15.80:0/1873273461 wait complete. 2022-09-07T19:42:12.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:13.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1858575060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00ff900 msgr2=0x7fa1a01061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1858575060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00ff900 0x7fa1a01061c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa198009bb0 tx=0x7fa198009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1858575060 shutdown_connections 2022-09-07T19:42:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1858575060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00ff900 0x7fa1a01061c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1858575060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a00fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1858575060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a00fef70 0x7fa1a00ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1858575060 >> 172.21.15.80:0/1858575060 conn(0x7fa1a00f93c0 msgr2=0x7fa1a00fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:13.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.152+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1858575060 shutdown_connections 2022-09-07T19:42:13.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.153+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1858575060 wait complete. 2022-09-07T19:42:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 Processor -- start 2022-09-07T19:42:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 -- start start 2022-09-07T19:42:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a0072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a00fef70 0x7fa1a00710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a00ff900 0x7fa1a0071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0071e10 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0071f80 con 0x7fa1a00fef70 2022-09-07T19:42:13.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a7dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a019d9f0 con 0x7fa1a00ff900 2022-09-07T19:42:13.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a5b9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a0072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a5b9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a0072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55838/0 (socket says 172.21.15.80:55838) 2022-09-07T19:42:13.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a5b9b700 1 -- 172.21.15.80:0/1076579251 learned_addr learned my addr 172.21.15.80:0/1076579251 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:13.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a539a700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a00fef70 0x7fa1a00710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.154+0000 7fa1a639c700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a00ff900 0x7fa1a0071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a5b9b700 1 -- 172.21.15.80:0/1076579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a00ff900 msgr2=0x7fa1a0071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a5b9b700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a00ff900 0x7fa1a0071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a5b9b700 1 -- 172.21.15.80:0/1076579251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a00fef70 msgr2=0x7fa1a00710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a5b9b700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a00fef70 0x7fa1a00710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a5b9b700 1 -- 172.21.15.80:0/1076579251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980097e0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a5b9b700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a0072a90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e710 tx=0x7fa19c00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:13.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c004220 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fa19c004380 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a019dcd0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.155+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c003cf0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.156+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a019e1b0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.157+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a01094b0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.158+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fa19c01e020 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.160+0000 7fa196ffd700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa18c099090 0x7fa18c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.160+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fa19c014070 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.160+0000 7fa1a539a700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa18c099090 0x7fa18c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.160+0000 7fa1a539a700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa18c099090 0x7fa18c09b540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa190005fd0 tx=0x7fa190005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:13.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.163+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa19c08ebf0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.359+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a0104be0 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.360+0000 7fa196ffd700 1 -- 172.21.15.80:0/1076579251 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7fa19c092210 con 0x7fa1a00fdcf0 2022-09-07T19:42:13.361 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:13.361 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.362+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa18c099090 msgr2=0x7fa18c09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.362+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa18c099090 0x7fa18c09b540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa190005fd0 tx=0x7fa190005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 msgr2=0x7fa1a0072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a0072a90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e710 tx=0x7fa19c00ea20 comp rx=0 tx=0).stop 2022-09-07T19:42:13.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 shutdown_connections 2022-09-07T19:42:13.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1a00fdcf0 0x7fa1a0072a90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa18c099090 0x7fa18c09b540 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a00ff900 0x7fa1a0071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 --2- 172.21.15.80:0/1076579251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a00fef70 0x7fa1a00710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 >> 172.21.15.80:0/1076579251 conn(0x7fa1a00f93c0 msgr2=0x7fa1a00fb710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:13.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 shutdown_connections 2022-09-07T19:42:13.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.363+0000 7fa1a7dff700 1 -- 172.21.15.80:0/1076579251 wait complete. 2022-09-07T19:42:13.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:42:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:13 smithi155 ceph-mon[97606]: pgmap v304: 129 pgs: 7 creating+peering, 100 active+clean, 22 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2022-09-07T19:42:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:13 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3085981751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:13 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1873273461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:13 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1076579251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.726 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.726+0000 7f41cedff700 1 -- 172.21.15.80:0/4055150744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8066bf0 msgr2=0x7f41c8100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.727 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.726+0000 7f41cedff700 1 --2- 172.21.15.80:0/4055150744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8066bf0 0x7f41c8100890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009810 tx=0x7f41bc009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:13.727 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 -- 172.21.15.80:0/4055150744 shutdown_connections 2022-09-07T19:42:13.727 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 --2- 172.21.15.80:0/4055150744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c81038c0 0x7f41c8105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.727 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 --2- 172.21.15.80:0/4055150744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8066bf0 0x7f41c8100890 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.728 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 --2- 172.21.15.80:0/4055150744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8100dd0 0x7f41c8103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.728 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 -- 172.21.15.80:0/4055150744 >> 172.21.15.80:0/4055150744 conn(0x7f41c80f82a0 msgr2=0x7f41c80fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:13.728 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 -- 172.21.15.80:0/4055150744 shutdown_connections 2022-09-07T19:42:13.728 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.727+0000 7f41cedff700 1 -- 172.21.15.80:0/4055150744 wait complete. 2022-09-07T19:42:13.731 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 Processor -- start 2022-09-07T19:42:13.731 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 -- start start 2022-09-07T19:42:13.731 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 0x7f41c8195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8100dd0 0x7f41c81960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c81038c0 0x7f41c819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c819d700 con 0x7f41c8066bf0 2022-09-07T19:42:13.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c819d870 con 0x7f41c8100dd0 2022-09-07T19:42:13.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.728+0000 7f41cedff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c819da30 con 0x7f41c81038c0 2022-09-07T19:42:13.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 0x7f41c8195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 0x7f41c8195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55844/0 (socket says 172.21.15.80:55844) 2022-09-07T19:42:13.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 -- 172.21.15.80:0/960198824 learned_addr learned my addr 172.21.15.80:0/960198824 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:13.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41c7fff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8100dd0 0x7f41c81960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41cd39c700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c81038c0 0x7f41c819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 -- 172.21.15.80:0/960198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c81038c0 msgr2=0x7f41c819d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c81038c0 0x7f41c819d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 -- 172.21.15.80:0/960198824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8100dd0 msgr2=0x7f41c81960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8100dd0 0x7f41c81960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 -- 172.21.15.80:0/960198824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40093b0 con 0x7f41c8066bf0 2022-09-07T19:42:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.729+0000 7f41ccb9b700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 0x7f41c8195b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41bc006010 tx=0x7f41bc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.730+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc01d070 con 0x7f41c8066bf0 2022-09-07T19:42:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.730+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f41bc00f930 con 0x7f41c8066bf0 2022-09-07T19:42:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.730+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc009470 con 0x7f41c8066bf0 2022-09-07T19:42:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.730+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0048e0 con 0x7f41c8066bf0 2022-09-07T19:42:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.730+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c819dfd0 con 0x7f41c8066bf0 2022-09-07T19:42:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.731+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c8109490 con 0x7f41c8066bf0 2022-09-07T19:42:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.733+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f41bc028030 con 0x7f41c8066bf0 2022-09-07T19:42:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.734+0000 7f41c5ffb700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41b8099010 0x7f41b809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.734+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f41bc0c3350 con 0x7f41c8066bf0 2022-09-07T19:42:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.734+0000 7f41c7fff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41b8099010 0x7f41b809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.735+0000 7f41c7fff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41b8099010 0x7f41b809b4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41b4005fd0 tx=0x7f41b4005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.738+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f41bc08f7f0 con 0x7f41c8066bf0 2022-09-07T19:42:13.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:13 smithi080 ceph-mon[90124]: pgmap v304: 129 pgs: 7 creating+peering, 100 active+clean, 22 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2022-09-07T19:42:13.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:13 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3085981751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:13 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1873273461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:13 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1076579251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:13 smithi154 ceph-mon[96967]: pgmap v304: 129 pgs: 7 creating+peering, 100 active+clean, 22 unknown; 579 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2022-09-07T19:42:13.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:13 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3085981751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:13 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1873273461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:13 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1076579251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:13.973 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.974+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41c805f9f0 con 0x7f41c8066bf0 2022-09-07T19:42:13.974 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.975+0000 7f41c5ffb700 1 -- 172.21.15.80:0/960198824 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10673 (secure 0 0 0) 0x7f41bc092e10 con 0x7f41c8066bf0 2022-09-07T19:42:13.974 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:13.975 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-09-07T19:42:06.917499+0000","modified":"2022-09-07T19:42:11.922580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-09-07T19:42:13.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41b8099010 msgr2=0x7f41b809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41b8099010 0x7f41b809b4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41b4005fd0 tx=0x7f41b4005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 msgr2=0x7f41c8195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:13.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 0x7f41c8195b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41bc006010 tx=0x7f41bc00f690 comp rx=0 tx=0).stop 2022-09-07T19:42:13.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 shutdown_connections 2022-09-07T19:42:13.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41c8066bf0 0x7f41c8195b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f41b8099010 0x7f41b809b4c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c81038c0 0x7f41c819d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 --2- 172.21.15.80:0/960198824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c8100dd0 0x7f41c81960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:13.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 >> 172.21.15.80:0/960198824 conn(0x7f41c80f82a0 msgr2=0x7f41c80ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:13.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 shutdown_connections 2022-09-07T19:42:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:13.977+0000 7f41cedff700 1 -- 172.21.15.80:0/960198824 wait complete. 2022-09-07T19:42:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 17 2022-09-07T19:42:14.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-09-07T19:42:06.917499+0000', 'modified': '2022-09-07T19:42:11.922580+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24575}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6839/545932828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 545932828}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 545932828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-09-07T19:42:14.006 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-09-07T19:42:14.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-09-07T19:42:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 -- 172.21.15.80:0/2561665612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140fffa0 msgr2=0x7f43141003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 --2- 172.21.15.80:0/2561665612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140fffa0 0x7f43141003b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4304009810 tx=0x7f4304009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 -- 172.21.15.80:0/2561665612 shutdown_connections 2022-09-07T19:42:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 --2- 172.21.15.80:0/2561665612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4314101bb0 0x7f4314108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 --2- 172.21.15.80:0/2561665612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140fffa0 0x7f43141003b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 --2- 172.21.15.80:0/2561665612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101220 0x7f4314101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 -- 172.21.15.80:0/2561665612 >> 172.21.15.80:0/2561665612 conn(0x7f43140fb6b0 msgr2=0x7f43140fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 -- 172.21.15.80:0/2561665612 shutdown_connections 2022-09-07T19:42:14.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.235+0000 7f431a9ff700 1 -- 172.21.15.80:0/2561665612 wait complete. 2022-09-07T19:42:14.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.236+0000 7f431a9ff700 1 Processor -- start 2022-09-07T19:42:14.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 -- start start 2022-09-07T19:42:14.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 0x7f4314195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314101220 0x7f4314196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101bb0 0x7f431419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431419d6b0 con 0x7f43140fffa0 2022-09-07T19:42:14.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431419d820 con 0x7f4314101220 2022-09-07T19:42:14.240 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f431a9ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431419d9e0 con 0x7f4314101bb0 2022-09-07T19:42:14.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f4313fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 0x7f4314195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f4313fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 0x7f4314195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55872/0 (socket says 172.21.15.80:55872) 2022-09-07T19:42:14.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f4313fff700 1 -- 172.21.15.80:0/1813294418 learned_addr learned my addr 172.21.15.80:0/1813294418 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:14.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f4318f9c700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101bb0 0x7f431419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.237+0000 7f43137fe700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314101220 0x7f4314196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4313fff700 1 -- 172.21.15.80:0/1813294418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101bb0 msgr2=0x7f431419d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4313fff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101bb0 0x7f431419d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4313fff700 1 -- 172.21.15.80:0/1813294418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314101220 msgr2=0x7f4314196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4313fff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314101220 0x7f4314196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4313fff700 1 -- 172.21.15.80:0/1813294418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304009470 con 0x7f43140fffa0 2022-09-07T19:42:14.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f43137fe700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314101220 0x7f4314196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:14.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4318f9c700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101bb0 0x7f431419d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:14.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f4313fff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 0x7f4314195b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4304006010 tx=0x7f430400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:14.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f43117fa700 1 -- 172.21.15.80:0/1813294418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430401d070 con 0x7f43140fffa0 2022-09-07T19:42:14.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431419dc60 con 0x7f43140fffa0 2022-09-07T19:42:14.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f43117fa700 1 -- 172.21.15.80:0/1813294418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f43040054f0 con 0x7f43140fffa0 2022-09-07T19:42:14.244 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f43117fa700 1 -- 172.21.15.80:0/1813294418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304004860 con 0x7f43140fffa0 2022-09-07T19:42:14.245 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.238+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431419e110 con 0x7f43140fffa0 2022-09-07T19:42:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.242+0000 7f43117fa700 1 -- 172.21.15.80:0/1813294418 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f4304028030 con 0x7f43140fffa0 2022-09-07T19:42:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.243+0000 7f432df81b80 1 Processor -- start 2022-09-07T19:42:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 -- start start 2022-09-07T19:42:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f43117fa700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f42fc099010 0x7f42fc09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 0x559f416ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f416edc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.252 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.252 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f415d7080 con 0x559f416ee1f0 2022-09-07T19:42:14.253 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416419e0 con 0x559f416ecae0 2022-09-07T19:42:14.253 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f432df81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4163b180 con 0x559f416ed430 2022-09-07T19:42:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.244+0000 7f43117fa700 1 -- 172.21.15.80:0/1813294418 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f43040c3280 con 0x7f43140fffa0 2022-09-07T19:42:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 0x559f416ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4318f9c700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f42fc099010 0x7f42fc09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 0x559f416ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:50314/0 (socket says 172.21.15.80:50314) 2022-09-07T19:42:14.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f43137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f416edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 -- 172.21.15.80:0/3606200159 learned_addr learned my addr 172.21.15.80:0/3606200159 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4318f9c700 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 -- 172.21.15.80:0/3606200159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 msgr2=0x559f416edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f416edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 -- 172.21.15.80:0/3606200159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 msgr2=0x559f416ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 -- 172.21.15.80:0/3606200159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f414c35e0 con 0x559f416ecae0 2022-09-07T19:42:14.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4313fff700 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 0x559f416ecef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4304028000 tx=0x7f430408f800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2214c0daf8b07690 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:14.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f4318f9c700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f42fc099010 0x7f42fc09b4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f430c009fd0 tx=0x7f430c011440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.245+0000 7f42fa7fc700 1 -- 172.21.15.80:0/3606200159 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304092da0 con 0x559f416ecae0 2022-09-07T19:42:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f42fa7fc700 1 -- 172.21.15.80:0/3606200159 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f4304009260 con 0x559f416ecae0 2022-09-07T19:42:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f42fa7fc700 1 -- 172.21.15.80:0/3606200159 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430408fb50 con 0x559f416ecae0 2022-09-07T19:42:14.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 -- 172.21.15.80:0/3606200159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 msgr2=0x559f416ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 0x559f416ecef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4304028000 tx=0x7f430408f800 comp rx=0 tx=0).stop 2022-09-07T19:42:14.263 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 -- 172.21.15.80:0/3606200159 shutdown_connections 2022-09-07T19:42:14.263 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.264 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ecae0 0x559f416ecef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.264 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 --2- 172.21.15.80:0/3606200159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f416edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.265 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 -- 172.21.15.80:0/3606200159 >> 172.21.15.80:0/3606200159 conn(0x559f416e8fa0 msgr2=0x559f416e7370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:14.265 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 -- 172.21.15.80:0/3606200159 shutdown_connections 2022-09-07T19:42:14.265 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.246+0000 7f432df81b80 1 -- 172.21.15.80:0/3606200159 wait complete. 2022-09-07T19:42:14.266 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.247+0000 7f432df81b80 1 -- start start 2022-09-07T19:42:14.266 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.247+0000 7f432df81b80 1 Processor -- start 2022-09-07T19:42:14.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416f6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ee1f0 0x559f416fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f415290c0 con 0x559f416ecae0 2022-09-07T19:42:14.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416fdc00 con 0x559f416ed430 2022-09-07T19:42:14.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416fdd90 con 0x559f416ee1f0 2022-09-07T19:42:14.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f432df81b80 10 client.0 _ll_register_callbacks cb 0x559f415e6370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:42:14.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f4313fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.271 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:50330/0 (socket says 172.21.15.80:50330) 2022-09-07T19:42:14.271 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 -- 172.21.15.80:0/4190363162 learned_addr learned my addr 172.21.15.80:0/4190363162 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:14.272 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f4318f9c700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ee1f0 0x559f416fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.272 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 -- 172.21.15.80:0/4190363162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ee1f0 msgr2=0x559f416fd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.272 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ee1f0 0x559f416fd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.273 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 -- 172.21.15.80:0/4190363162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 msgr2=0x559f416f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f43137fe700 1 -- 172.21.15.80:0/4190363162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431419e110 con 0x559f416ed430 2022-09-07T19:42:14.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.248+0000 7f4313fff700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f43137fe700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f6680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4308012700 tx=0x7f4308012a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd24bc667944f52 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f42ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2022-09-07T19:42:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f42ef7fe700 1 -- 172.21.15.80:0/4190363162 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308017070 con 0x559f416ed430 2022-09-07T19:42:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f416dfaa0 con 0x559f416ed430 2022-09-07T19:42:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f42ef7fe700 1 -- 172.21.15.80:0/4190363162 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f430800f670 con 0x559f416ed430 2022-09-07T19:42:14.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f42ef7fe700 1 -- 172.21.15.80:0/4190363162 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43080096a0 con 0x559f416ed430 2022-09-07T19:42:14.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f432df81b80 10 client.24683 fetch_fsmap learned FSMap version 17 2022-09-07T19:42:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.249+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x559f4146fd90 con 0x559f416ed430 2022-09-07T19:42:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f42ef7fe700 1 -- 172.21.15.80:0/4190363162 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x559f416dfaa0 con 0x559f416ed430 2022-09-07T19:42:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f42ef7fe700 1 -- 172.21.15.80:0/4190363162 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f430801cad0 con 0x559f416ed430 2022-09-07T19:42:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f432df81b80 10 client.24683 fetch_fsmap finished waiting for FSMap version 17 2022-09-07T19:42:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f432df81b80 10 client.24683 resolve_mds: resolved name 'b' to daemon mds.b 2022-09-07T19:42:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f432df81b80 20 client.24683 populate_metadata read hostname 'smithi080' 2022-09-07T19:42:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f432df81b80 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41701520 0x559f41706820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f432df81b80 4 client.24683 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:42:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 --> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f416bc4c0 con 0x559f41701520 2022-09-07T19:42:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.250+0000 7f4313fff700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41701520 0x559f41706820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.251+0000 7f4313fff700 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41701520 0x559f41706820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69106146c084e5e4 server_cookie=18248c3a2e52d2d4 in_seq=0 out_seq=0 2022-09-07T19:42:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.251+0000 7f42ef7fe700 10 client.24683 ms_handle_connect on v2:172.21.15.154:6838/545932828 2022-09-07T19:42:14.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f42ef7fe700 1 -- 172.21.15.80:0/4190363162 <== mds.0 v2:172.21.15.154:6838/545932828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x559f416bc4c0 con 0x559f41701520 2022-09-07T19:42:14.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f42ef7fe700 10 client.24683 handle_command_reply: tid=0 2022-09-07T19:42:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 client.24683 shutdown 2022-09-07T19:42:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 msgr2=0x559f416f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f6680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4308012700 tx=0x7f4308012a10 comp rx=0 tx=0).stop 2022-09-07T19:42:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 shutdown_connections 2022-09-07T19:42:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41701520 0x559f41706820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f42ef7fe700 0 client.24683 ms_handle_reset on v2:172.21.15.154:6838/545932828 2022-09-07T19:42:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ee1f0 0x559f416fd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 --2- 172.21.15.80:0/4190363162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f6680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.252+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 >> 172.21.15.80:0/4190363162 conn(0x559f416e8fa0 msgr2=0x559f416e6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.253+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 shutdown_connections 2022-09-07T19:42:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.253+0000 7f432df81b80 1 -- 172.21.15.80:0/4190363162 wait complete. 2022-09-07T19:42:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.253+0000 7f432df81b80 20 client.24683 trim_cache size 0 max 16384 2022-09-07T19:42:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 Processor -- start 2022-09-07T19:42:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 -- start start 2022-09-07T19:42:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f4170a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ee1f0 0x559f416f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416dfaa0 con 0x559f416ecae0 2022-09-07T19:42:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416f7330 con 0x559f416ee1f0 2022-09-07T19:42:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.270+0000 7f432df81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f415ff050 con 0x559f416ed430 2022-09-07T19:42:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55900/0 (socket says 172.21.15.80:55900) 2022-09-07T19:42:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4318f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ee1f0 0x559f416f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 -- 172.21.15.80:0/102055007 learned_addr learned my addr 172.21.15.80:0/102055007 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f43137fe700 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f4170a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 -- 172.21.15.80:0/102055007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 msgr2=0x559f4170a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f4170a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 -- 172.21.15.80:0/102055007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ee1f0 msgr2=0x559f416f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ee1f0 0x559f416f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 -- 172.21.15.80:0/102055007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4146e260 con 0x559f416ecae0 2022-09-07T19:42:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.271+0000 7f4313fff700 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416e6a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43040933d0 tx=0x7f4304098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225b60a7b0e04d75 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f42faffd700 1 -- 172.21.15.80:0/102055007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304092da0 con 0x559f416ecae0 2022-09-07T19:42:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f42faffd700 1 -- 172.21.15.80:0/102055007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f4304005330 con 0x559f416ecae0 2022-09-07T19:42:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f42faffd700 1 -- 172.21.15.80:0/102055007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040936a0 con 0x559f416ecae0 2022-09-07T19:42:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 -- 172.21.15.80:0/102055007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 msgr2=0x559f416e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416e6a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43040933d0 tx=0x7f4304098040 comp rx=0 tx=0).stop 2022-09-07T19:42:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 -- 172.21.15.80:0/102055007 shutdown_connections 2022-09-07T19:42:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ecae0 0x559f416e6a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ee1f0 0x559f416f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 --2- 172.21.15.80:0/102055007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ed430 0x559f4170a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 -- 172.21.15.80:0/102055007 >> 172.21.15.80:0/102055007 conn(0x559f416e8fa0 msgr2=0x559f416e7340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 -- 172.21.15.80:0/102055007 shutdown_connections 2022-09-07T19:42:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.272+0000 7f432df81b80 1 -- 172.21.15.80:0/102055007 wait complete. 2022-09-07T19:42:14.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.273+0000 7f432df81b80 1 -- start start 2022-09-07T19:42:14.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.273+0000 7f432df81b80 1 Processor -- start 2022-09-07T19:42:14.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.273+0000 7f432df81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 0x559f416fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.273+0000 7f432df81b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.273+0000 7f432df81b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f432df81b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416fa380 con 0x559f416ee1f0 2022-09-07T19:42:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f432df81b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416fa4f0 con 0x559f416ed430 2022-09-07T19:42:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f432df81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f416fa6b0 con 0x559f416ecae0 2022-09-07T19:42:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f432df81b80 10 client.0 _ll_register_callbacks cb 0x559f415e6370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:42:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4318f9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 0x559f416fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f43137fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 0x559f416fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:58758/0 (socket says 172.21.15.80:58758) 2022-09-07T19:42:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4318f9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416f9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55914/0 (socket says 172.21.15.80:55914) 2022-09-07T19:42:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f43137fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:50342/0 (socket says 172.21.15.80:50342) 2022-09-07T19:42:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 -- 172.21.15.80:0/1862677638 learned_addr learned my addr 172.21.15.80:0/1862677638 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 -- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 msgr2=0x559f416f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 -- 172.21.15.80:0/1862677638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 msgr2=0x559f416f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:42:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4313fff700 1 -- 172.21.15.80:0/1862677638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f414c35e0 con 0x559f416ecae0 2022-09-07T19:42:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.274+0000 7f4318f9c700 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f4313fff700 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 0x559f416fb2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f430408f8f0 tx=0x7f4304005950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612bd4c7848f4416 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f42ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2022-09-07T19:42:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f42ef7fe700 1 -- 172.21.15.80:0/1862677638 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304093b40 con 0x559f416ecae0 2022-09-07T19:42:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4304009260 con 0x559f416ecae0 2022-09-07T19:42:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f42ef7fe700 1 -- 172.21.15.80:0/1862677638 <== mon.1 v2:172.21.15.155:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f430409a6e0 con 0x559f416ecae0 2022-09-07T19:42:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f42ef7fe700 1 -- 172.21.15.80:0/1862677638 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4304092930 con 0x559f416ecae0 2022-09-07T19:42:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f432df81b80 10 client.24670 fetch_fsmap learned FSMap version 17 2022-09-07T19:42:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x559f4153ca30 con 0x559f416ecae0 2022-09-07T19:42:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f42ef7fe700 1 -- 172.21.15.80:0/1862677638 <== mon.1 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f4304009260 con 0x559f416ecae0 2022-09-07T19:42:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f42ef7fe700 1 -- 172.21.15.80:0/1862677638 <== mon.1 v2:172.21.15.155:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f430409a250 con 0x559f416ecae0 2022-09-07T19:42:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.275+0000 7f432df81b80 10 client.24670 fetch_fsmap finished waiting for FSMap version 17 2022-09-07T19:42:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.276+0000 7f432df81b80 10 client.24670 resolve_mds: resolved name 'b' to daemon mds.b 2022-09-07T19:42:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.276+0000 7f432df81b80 20 client.24670 populate_metadata read hostname 'smithi080' 2022-09-07T19:42:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.276+0000 7f432df81b80 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41757db0 0x559f41754880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:14.316 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.276+0000 7f432df81b80 4 client.24670 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2022-09-07T19:42:14.316 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.276+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 --> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f416346f0 con 0x559f41757db0 2022-09-07T19:42:14.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.276+0000 7f43137fe700 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41757db0 0x559f41754880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:14.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f43137fe700 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41757db0 0x559f41754880 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f9167c28834e86 server_cookie=f59d9002a040b64c in_seq=0 out_seq=0 2022-09-07T19:42:14.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f42ef7fe700 10 client.24670 ms_handle_connect on v2:172.21.15.154:6838/545932828 2022-09-07T19:42:14.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f42ef7fe700 1 -- 172.21.15.80:0/1862677638 <== mds.0 v2:172.21.15.154:6838/545932828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559f416346f0 con 0x559f41757db0 2022-09-07T19:42:14.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f42ef7fe700 10 client.24670 handle_command_reply: tid=0 2022-09-07T19:42:14.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 client.24670 shutdown 2022-09-07T19:42:14.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 msgr2=0x559f416fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.320 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 0x559f416fb2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f430408f8f0 tx=0x7f4304005950 comp rx=0 tx=0).stop 2022-09-07T19:42:14.320 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 shutdown_connections 2022-09-07T19:42:14.321 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x559f41757db0 0x559f41754880 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.321 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559f416ee1f0 0x559f416f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.321 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f416ecae0 0x559f416fb2b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.322 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 --2- 172.21.15.80:0/1862677638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f416ed430 0x559f416f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.322 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f42ef7fe700 0 client.24670 ms_handle_reset on v2:172.21.15.154:6838/545932828 2022-09-07T19:42:14.323 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 >> 172.21.15.80:0/1862677638 conn(0x559f416e8fa0 msgr2=0x559f416f0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:14.323 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 shutdown_connections 2022-09-07T19:42:14.324 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.277+0000 7f432df81b80 1 -- 172.21.15.80:0/1862677638 wait complete. 2022-09-07T19:42:14.324 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f432df81b80 20 client.24670 trim_cache size 0 max 16384 2022-09-07T19:42:14.325 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:42:14.326 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:42:14.326 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2022-09-07T19:42:14.326 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24575, 2022-09-07T19:42:14.327 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:42:14.327 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:42:14.328 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:42:14.328 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.3573470790000002, 2022-09-07T19:42:14.329 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 17, 2022-09-07T19:42:14.329 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 89, 2022-09-07T19:42:14.330 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 88, 2022-09-07T19:42:14.330 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 14.951559547 2022-09-07T19:42:14.330 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:42:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f42fc099010 msgr2=0x7f42fc09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f42fc099010 0x7f42fc09b4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f430c009fd0 tx=0x7f430c011440 comp rx=0 tx=0).stop 2022-09-07T19:42:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 msgr2=0x7f4314195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 0x7f4314195b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4304006010 tx=0x7f430400f690 comp rx=0 tx=0).stop 2022-09-07T19:42:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 shutdown_connections 2022-09-07T19:42:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43140fffa0 0x7f4314195b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f42fc099010 0x7f42fc09b4c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4314101bb0 0x7f431419d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 --2- 172.21.15.80:0/1813294418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314101220 0x7f4314196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 >> 172.21.15.80:0/1813294418 conn(0x7f43140fb6b0 msgr2=0x7f43140fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 shutdown_connections 2022-09-07T19:42:14.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:14.278+0000 7f431a9ff700 1 -- 172.21.15.80:0/1813294418 wait complete. 2022-09-07T19:42:14.335 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2022-09-07T19:42:14.336 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:14.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph fs ls 2022-09-07T19:42:14.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:14 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/960198824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:14.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:14 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/960198824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:14 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/960198824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:15.204 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:15.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:15 smithi080 ceph-mon[90124]: pgmap v305: 129 pgs: 7 creating+peering, 109 active+clean, 13 unknown; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2022-09-07T19:42:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:15 smithi155 ceph-mon[97606]: pgmap v305: 129 pgs: 7 creating+peering, 109 active+clean, 13 unknown; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2022-09-07T19:42:15.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:15 smithi154 ceph-mon[96967]: pgmap v305: 129 pgs: 7 creating+peering, 109 active+clean, 13 unknown; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2022-09-07T19:42:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/18004778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 msgr2=0x7f8eb40fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/18004778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb40fe4a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009840 tx=0x7f8eb0009b50 comp rx=0 tx=0).stop 2022-09-07T19:42:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/18004778 shutdown_connections 2022-09-07T19:42:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/18004778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb40fe4a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/18004778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb41031d0 0x7f8eb410ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/18004778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb40fea70 0x7f8eb4102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/18004778 >> 172.21.15.80:0/18004778 conn(0x7f8eb40f9a10 msgr2=0x7f8eb40fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.735+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/18004778 shutdown_connections 2022-09-07T19:42:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.736+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/18004778 wait complete. 2022-09-07T19:42:16.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 Processor -- start 2022-09-07T19:42:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 -- start start 2022-09-07T19:42:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb4195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb40fea70 0x7f8eb41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb41031d0 0x7f8eb419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb419aed0 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb419b040 con 0x7f8eb40fea70 2022-09-07T19:42:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.737+0000 7f8ebc7ef700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb419b200 con 0x7f8eb41031d0 2022-09-07T19:42:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb4195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb4195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55942/0 (socket says 172.21.15.80:55942) 2022-09-07T19:42:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 -- 172.21.15.80:0/1128903868 learned_addr learned my addr 172.21.15.80:0/1128903868 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eb9d8a700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb40fea70 0x7f8eb41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8ebad8c700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb41031d0 0x7f8eb419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 -- 172.21.15.80:0/1128903868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb41031d0 msgr2=0x7f8eb419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb41031d0 0x7f8eb419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 -- 172.21.15.80:0/1128903868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb40fea70 msgr2=0x7f8eb41963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb40fea70 0x7f8eb41963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 -- 172.21.15.80:0/1128903868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009470 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.738+0000 7f8eba58b700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb4195ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000f690 tx=0x7f8eb000f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.739+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb001d070 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.739+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb419b480 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.739+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f8eb000b480 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.739+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004980 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.739+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb41a2cd0 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.740+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4064ea0 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.742+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f8eb0028030 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.743+0000 7f8eab7fe700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8ea0099010 0x7f8ea009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.743+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f8eb00c33c0 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.743+0000 7f8eb9d8a700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8ea0099010 0x7f8ea009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.744+0000 7f8eb9d8a700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8ea0099010 0x7f8ea009b4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41974b0 tx=0x7f8ea4005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.747+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f8eb008f860 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:16.999+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8eb41972f0 con 0x7f8eb40fe0d0 2022-09-07T19:42:16.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.000+0000 7f8eab7fe700 1 -- 172.21.15.80:0/1128903868 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8eb0026070 con 0x7f8eb40fe0d0 2022-09-07T19:42:17.000 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2022-09-07T19:42:17.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8ea0099010 msgr2=0x7f8ea009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:17.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8ea0099010 0x7f8ea009b4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41974b0 tx=0x7f8ea4005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:17.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 msgr2=0x7f8eb4195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:17.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb4195ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000f690 tx=0x7f8eb000f770 comp rx=0 tx=0).stop 2022-09-07T19:42:17.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 shutdown_connections 2022-09-07T19:42:17.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eb40fe0d0 0x7f8eb4195ea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:17.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8ea0099010 0x7f8ea009b4c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:17.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb41031d0 0x7f8eb419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:17.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 --2- 172.21.15.80:0/1128903868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb40fea70 0x7f8eb41963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:17.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.002+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 >> 172.21.15.80:0/1128903868 conn(0x7f8eb40f9a10 msgr2=0x7f8eb40fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:17.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.003+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 shutdown_connections 2022-09-07T19:42:17.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:17.003+0000 7f8ebc7ef700 1 -- 172.21.15.80:0/1128903868 wait complete. 2022-09-07T19:42:17.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2022-09-07T19:42:17.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-09-07T19:42:17.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2022-09-07T19:42:17.479 INFO:tasks.cephfs.mount:self.client.name = client.admin 2022-09-07T19:42:17.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:17.480 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2022-09-07T19:42:17.481 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-09-07T19:42:17.481 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-09-07T19:42:17.482 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2022-09-07T19:42:17.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:17.484 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2022-09-07T19:42:17.543 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-09-07T19:42:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-09-07T19:42:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2022-09-07T19:42:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2022-09-07T19:42:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2022-09-07T19:42:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2022-09-07T19:42:17.545 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-07T19:42:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:42:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2022-09-07T19:42:17.546 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-07T19:42:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:42:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2022-09-07T19:42:17.548 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-07T19:42:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:42:17.549 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-09-07T19:42:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:42:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-09-07T19:42:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 41664sec preferred_lft 41664sec 2022-09-07T19:42:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2022-09-07T19:42:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2022-09-07T19:42:17.555 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-09-07T19:42:17.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:17.557 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:42:17.558 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:42:17.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2022-09-07T19:42:17.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2022-09-07T19:42:17.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2022-09-07T19:42:17.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-09-07T19:42:17.560 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:42:17.694 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:17 smithi080 ceph-mon[90124]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:17.694 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:17 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1128903868' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-09-07T19:42:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:17 smithi155 ceph-mon[97606]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:17 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1128903868' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-09-07T19:42:17.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:17 smithi154 ceph-mon[96967]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:17.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:17 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1128903868' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-09-07T19:42:18.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:18.072 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-09-07T19:42:18.160 INFO:teuthology.orchestra.run.smithi080.stdout:1 2022-09-07T19:42:18.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:18.167 DEBUG:teuthology.orchestra.run.smithi080:> route 2022-09-07T19:42:18.248 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2022-09-07T19:42:18.249 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-09-07T19:42:18.249 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-09-07T19:42:18.249 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-09-07T19:42:18.249 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-09-07T19:42:18.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:18.251 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:42:18.252 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:42:18.252 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-09-07T19:42:18.252 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-09-07T19:42:18.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-09-07T19:42:18.253 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:42:18.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:18.991 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2022-09-07T19:42:19.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:19.052 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2022-09-07T19:42:19.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:19.111 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:42:19.112 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:42:19.112 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-09-07T19:42:19.112 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2022-09-07T19:42:19.113 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:42:19.295 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2022-09-07T19:42:19.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:19.297 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:42:19.298 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:42:19.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2022-09-07T19:42:19.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-09-07T19:42:19.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2022-09-07T19:42:19.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2022-09-07T19:42:19.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2022-09-07T19:42:19.302 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:42:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:19 smithi080 ceph-mon[90124]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:19.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:19.648 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:42:19.648 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:42:19.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2022-09-07T19:42:19.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2022-09-07T19:42:19.650 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:42:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:19 smithi155 ceph-mon[97606]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:19.867 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2022-09-07T19:42:19.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-09-07T19:42:19.869 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:19.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:19 smithi154 ceph-mon[96967]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:19.929 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2022-09-07T19:42:19.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-09-07T19:42:19.931 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:19.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2022-09-07T19:42:20.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-09-07T19:42:20.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-09-07T19:42:20.167 INFO:teuthology.orchestra.run.smithi080.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-09-07T19:42:20.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-09-07T19:42:20.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:20.173 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2022-09-07T19:42:20.232 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-09-07T19:42:20.233 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2022-09-07T19:42:20.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2022-09-07T19:42:20.329 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-09-07T19:42:20.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-09-07T19:42:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-09-07T19:42:20.423 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-09-07T19:42:20.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:20.425 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2022-09-07T19:42:20.465 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:2022-09-07T19:42:20.466+0000 7fc319519400 -1 init, newargv = 0x559e7faf57d0 newargc=15 2022-09-07T19:42:20.465 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[128253]: starting ceph client 2022-09-07T19:42:20.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[128253]: starting fuse 2022-09-07T19:42:20.489 INFO:teuthology.orchestra.run.smithi080.stdout:120 2022-09-07T19:42:20.490 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2022-09-07T19:42:20.490 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-09-07T19:42:20.491 DEBUG:teuthology.orchestra.run.smithi080:> import glob 2022-09-07T19:42:20.491 DEBUG:teuthology.orchestra.run.smithi080:> import re 2022-09-07T19:42:20.491 DEBUG:teuthology.orchestra.run.smithi080:> import os 2022-09-07T19:42:20.492 DEBUG:teuthology.orchestra.run.smithi080:> import subprocess 2022-09-07T19:42:20.492 DEBUG:teuthology.orchestra.run.smithi080:> 2022-09-07T19:42:20.493 DEBUG:teuthology.orchestra.run.smithi080:> def _find_admin_socket(client_name): 2022-09-07T19:42:20.493 DEBUG:teuthology.orchestra.run.smithi080:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2022-09-07T19:42:20.493 DEBUG:teuthology.orchestra.run.smithi080:> files = glob.glob(asok_path) 2022-09-07T19:42:20.494 DEBUG:teuthology.orchestra.run.smithi080:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2022-09-07T19:42:20.494 DEBUG:teuthology.orchestra.run.smithi080:> 2022-09-07T19:42:20.495 DEBUG:teuthology.orchestra.run.smithi080:> # Given a non-glob path, it better be there 2022-09-07T19:42:20.495 DEBUG:teuthology.orchestra.run.smithi080:> if "*" not in asok_path: 2022-09-07T19:42:20.496 DEBUG:teuthology.orchestra.run.smithi080:> assert(len(files) == 1) 2022-09-07T19:42:20.496 DEBUG:teuthology.orchestra.run.smithi080:> return files[0] 2022-09-07T19:42:20.496 DEBUG:teuthology.orchestra.run.smithi080:> 2022-09-07T19:42:20.497 DEBUG:teuthology.orchestra.run.smithi080:> for f in files: 2022-09-07T19:42:20.497 DEBUG:teuthology.orchestra.run.smithi080:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-09-07T19:42:20.498 DEBUG:teuthology.orchestra.run.smithi080:> if os.path.exists("/proc/{0}".format(pid)): 2022-09-07T19:42:20.498 DEBUG:teuthology.orchestra.run.smithi080:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-09-07T19:42:20.498 DEBUG:teuthology.orchestra.run.smithi080:> contents = proc_f.read() 2022-09-07T19:42:20.499 DEBUG:teuthology.orchestra.run.smithi080:> if mountpoint in contents: 2022-09-07T19:42:20.499 DEBUG:teuthology.orchestra.run.smithi080:> return f 2022-09-07T19:42:20.499 DEBUG:teuthology.orchestra.run.smithi080:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-09-07T19:42:20.500 DEBUG:teuthology.orchestra.run.smithi080:> 2022-09-07T19:42:20.500 DEBUG:teuthology.orchestra.run.smithi080:> print(_find_admin_socket("client.admin")) 2022-09-07T19:42:20.501 DEBUG:teuthology.orchestra.run.smithi080:> ' 2022-09-07T19:42:20.700 INFO:teuthology.orchestra.run.smithi080.stdout:/var/run/ceph/ceph-client.admin.128253.asok 2022-09-07T19:42:20.879 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.128253.asok 2022-09-07T19:42:20.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:20.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.128253.asok status 2022-09-07T19:42:21.135 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:42:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": { 2022-09-07T19:42:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_sha1": "152194198413033811b31149de909a7ec5852a7f", 2022-09-07T19:42:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 17.0.0-14857-g15219419 (152194198413033811b31149de909a7ec5852a7f) quincy (dev)", 2022-09-07T19:42:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "admin", 2022-09-07T19:42:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2022-09-07T19:42:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2022-09-07T19:42:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "pid": "128253", 2022-09-07T19:42:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2022-09-07T19:42:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2022-09-07T19:42:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_count": 0, 2022-09-07T19:42:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_pinned_count": 0, 2022-09-07T19:42:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 14607, 2022-09-07T19:42:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": { 2022-09-07T19:42:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2022-09-07T19:42:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2022-09-07T19:42:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 14607 2022-09-07T19:42:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2022-09-07T19:42:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2022-09-07T19:42:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2022-09-07T19:42:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2022-09-07T19:42:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2481969036 2022-09-07T19:42:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2022-09-07T19:42:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2022-09-07T19:42:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2022-09-07T19:42:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2022-09-07T19:42:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2022-09-07T19:42:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2481969036 2022-09-07T19:42:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2022-09-07T19:42:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inst_str": "client.14607 172.21.15.80:0/2481969036", 2022-09-07T19:42:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "addr_str": "172.21.15.80:0/2481969036", 2022-09-07T19:42:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inode_count": 1, 2022-09-07T19:42:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_epoch": 17, 2022-09-07T19:42:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch": 89, 2022-09-07T19:42:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch_barrier": 0, 2022-09-07T19:42:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklisted": false, 2022-09-07T19:42:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs" 2022-09-07T19:42:21.147 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:42:21.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:21.153 DEBUG:teuthology.orchestra.run.smithi080:> stat --file-system '--printf=%T 2022-09-07T19:42:21.154 DEBUG:teuthology.orchestra.run.smithi080:> ' -- /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:21.216 INFO:teuthology.orchestra.run.smithi080.stdout:fuseblk 2022-09-07T19:42:21.216 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:21.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:21.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:21.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:21.315 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2022-09-07T19:42:21.486 INFO:teuthology.orchestra.run.smithi080.stdout:# file: . 2022-09-07T19:42:21.487 INFO:teuthology.orchestra.run.smithi080.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2022-09-07T19:42:21.488 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:21.490 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:42:21.492 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2022-09-07T19:42:21.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:21 smithi155 ceph-mon[97606]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 -- 172.21.15.80:0/2296057674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44072b90 msgr2=0x7f1e44071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 --2- 172.21.15.80:0/2296057674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44072b90 0x7f1e44071110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009810 tx=0x7f1e34009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 -- 172.21.15.80:0/2296057674 shutdown_connections 2022-09-07T19:42:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 --2- 172.21.15.80:0/2296057674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44105ae0 0x7f1e44107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 --2- 172.21.15.80:0/2296057674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44072b90 0x7f1e44071110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 --2- 172.21.15.80:0/2296057674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44071650 0x7f1e44071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 -- 172.21.15.80:0/2296057674 >> 172.21.15.80:0/2296057674 conn(0x7f1e440f9260 msgr2=0x7f1e440fb690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 -- 172.21.15.80:0/2296057674 shutdown_connections 2022-09-07T19:42:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.798+0000 7f1e4359e700 1 -- 172.21.15.80:0/2296057674 wait complete. 2022-09-07T19:42:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.799+0000 7f1e4359e700 1 Processor -- start 2022-09-07T19:42:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.799+0000 7f1e4359e700 1 -- start start 2022-09-07T19:42:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.799+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 0x7f1e44195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44072b90 0x7f1e44195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44105ae0 0x7f1e4419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4359e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4419d4e0 con 0x7f1e44072b90 2022-09-07T19:42:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4419d650 con 0x7f1e44105ae0 2022-09-07T19:42:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4419d810 con 0x7f1e44071650 2022-09-07T19:42:21.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e41d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44072b90 0x7f1e44195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:21.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 0x7f1e44195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:21.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 0x7f1e44195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:58806/0 (socket says 172.21.15.80:58806) 2022-09-07T19:42:21.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 -- 172.21.15.80:0/444676729 learned_addr learned my addr 172.21.15.80:0/444676729 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e42d9d700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44105ae0 0x7f1e4419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 -- 172.21.15.80:0/444676729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44105ae0 msgr2=0x7f1e4419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44105ae0 0x7f1e4419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 -- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44072b90 msgr2=0x7f1e44195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44072b90 0x7f1e44195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e4259c700 1 -- 172.21.15.80:0/444676729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009470 con 0x7f1e44071650 2022-09-07T19:42:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e42d9d700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44105ae0 0x7f1e4419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.800+0000 7f1e41d9b700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44072b90 0x7f1e44195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.801+0000 7f1e4259c700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 0x7f1e44195960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e340059c0 tx=0x7f1e3400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:21.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.801+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3401d070 con 0x7f1e44071650 2022-09-07T19:42:21.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.801+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4419da90 con 0x7f1e44071650 2022-09-07T19:42:21.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.801+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f1e3400f930 con 0x7f1e44071650 2022-09-07T19:42:21.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.801+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34004840 con 0x7f1e44071650 2022-09-07T19:42:21.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.801+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4419df40 con 0x7f1e44071650 2022-09-07T19:42:21.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.802+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4410b530 con 0x7f1e44071650 2022-09-07T19:42:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.804+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f1e34028030 con 0x7f1e44071650 2022-09-07T19:42:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.805+0000 7f1e337fe700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1e2c099010 0x7f1e2c09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.806+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f1e340c33a0 con 0x7f1e44071650 2022-09-07T19:42:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.806+0000 7f1e41d9b700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1e2c099010 0x7f1e2c09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.806+0000 7f1e41d9b700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1e2c099010 0x7f1e2c09b4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e38005fd0 tx=0x7f1e38005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:21.808+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f1e3408f840 con 0x7f1e44071650 2022-09-07T19:42:21.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:21 smithi080 ceph-mon[90124]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:21.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:21 smithi154 ceph-mon[96967]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2022-09-07T19:42:22.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.004+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e441040f0 con 0x7f1e44071650 2022-09-07T19:42:22.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.006+0000 7f1e337fe700 1 -- 172.21.15.80:0/444676729 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7f1e34092e60 con 0x7f1e44071650 2022-09-07T19:42:22.006 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:22.006 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:22.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1e2c099010 msgr2=0x7f1e2c09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1e2c099010 0x7f1e2c09b4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e38005fd0 tx=0x7f1e38005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 msgr2=0x7f1e44195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 0x7f1e44195960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e340059c0 tx=0x7f1e3400f690 comp rx=0 tx=0).stop 2022-09-07T19:42:22.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 shutdown_connections 2022-09-07T19:42:22.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1e2c099010 0x7f1e2c09b4c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e44105ae0 0x7f1e4419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44071650 0x7f1e44195960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 --2- 172.21.15.80:0/444676729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e44072b90 0x7f1e44195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 >> 172.21.15.80:0/444676729 conn(0x7f1e440f9260 msgr2=0x7f1e440fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:22.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 shutdown_connections 2022-09-07T19:42:22.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.009+0000 7f1e4359e700 1 -- 172.21.15.80:0/444676729 wait complete. 2022-09-07T19:42:22.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-07T19:42:05.026979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-09-07T19:42:06.340517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-07T19:42:10.116527+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-07T19:42:22.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:42:22.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 -- 172.21.15.80:0/4176403227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fc430 msgr2=0x7f34640fc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 --2- 172.21.15.80:0/4176403227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fc430 0x7f34640fc840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3460009810 tx=0x7f3460009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 -- 172.21.15.80:0/4176403227 shutdown_connections 2022-09-07T19:42:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 --2- 172.21.15.80:0/4176403227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fd730 0x7f34640fdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 --2- 172.21.15.80:0/4176403227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fc430 0x7f34640fc840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 --2- 172.21.15.80:0/4176403227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fcd80 0x7f34640fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 -- 172.21.15.80:0/4176403227 >> 172.21.15.80:0/4176403227 conn(0x7f34640f8160 msgr2=0x7f34640fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 -- 172.21.15.80:0/4176403227 shutdown_connections 2022-09-07T19:42:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.267+0000 7f346b39d700 1 -- 172.21.15.80:0/4176403227 wait complete. 2022-09-07T19:42:22.273 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.268+0000 7f346b39d700 1 Processor -- start 2022-09-07T19:42:22.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 -- start start 2022-09-07T19:42:22.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fc430 0x7f3464195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fcd80 0x7f3464195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 0x7f346419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346419d4b0 con 0x7f34640fd730 2022-09-07T19:42:22.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346419d620 con 0x7f34640fc430 2022-09-07T19:42:22.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346b39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346419d7e0 con 0x7f34640fcd80 2022-09-07T19:42:22.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346ab9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 0x7f346419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346ab9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 0x7f346419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55974/0 (socket says 172.21.15.80:55974) 2022-09-07T19:42:22.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346a39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fc430 0x7f3464195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f346ab9c700 1 -- 172.21.15.80:0/1999930495 learned_addr learned my addr 172.21.15.80:0/1999930495 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.269+0000 7f3469b9a700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fcd80 0x7f3464195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346ab9c700 1 -- 172.21.15.80:0/1999930495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fcd80 msgr2=0x7f3464195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346ab9c700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fcd80 0x7f3464195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346ab9c700 1 -- 172.21.15.80:0/1999930495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fc430 msgr2=0x7f3464195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346ab9c700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fc430 0x7f3464195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346ab9c700 1 -- 172.21.15.80:0/1999930495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009470 con 0x7f34640fd730 2022-09-07T19:42:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346a39b700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fc430 0x7f3464195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346ab9c700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 0x7f346419cee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f345c00eaf0 tx=0x7f345c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c009960 con 0x7f34640fd730 2022-09-07T19:42:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346419dac0 con 0x7f34640fd730 2022-09-07T19:42:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f345c00ce70 con 0x7f34640fd730 2022-09-07T19:42:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.270+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0058b0 con 0x7f34640fd730 2022-09-07T19:42:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.271+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346419dfd0 con 0x7f34640fd730 2022-09-07T19:42:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.272+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346410b4d0 con 0x7f34640fd730 2022-09-07T19:42:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.274+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f345c01e020 con 0x7f34640fd730 2022-09-07T19:42:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.275+0000 7f345b7fe700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3450099010 0x7f345009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.275+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f345c014070 con 0x7f34640fd730 2022-09-07T19:42:22.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.275+0000 7f346a39b700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3450099010 0x7f345009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.276+0000 7f346a39b700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3450099010 0x7f345009b4c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f346000b4f0 tx=0x7f3460009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:22.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.278+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f345c08f1e0 con 0x7f34640fd730 2022-09-07T19:42:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.475+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3464107090 con 0x7f34640fd730 2022-09-07T19:42:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.476+0000 7f345b7fe700 1 -- 172.21.15.80:0/1999930495 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f345c092800 con 0x7f34640fd730 2022-09-07T19:42:22.477 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:42:22.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.478+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3450099010 msgr2=0x7f345009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.478+0000 7f346b39d700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3450099010 0x7f345009b4c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f346000b4f0 tx=0x7f3460009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.478+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 msgr2=0x7f346419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.478+0000 7f346b39d700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 0x7f346419cee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f345c00eaf0 tx=0x7f345c00ee00 comp rx=0 tx=0).stop 2022-09-07T19:42:22.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 shutdown_connections 2022-09-07T19:42:22.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34640fd730 0x7f346419cee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.483 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3450099010 0x7f345009b4c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.483 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34640fc430 0x7f3464195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.484 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 --2- 172.21.15.80:0/1999930495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34640fcd80 0x7f3464195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.484 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 >> 172.21.15.80:0/1999930495 conn(0x7f34640f8160 msgr2=0x7f34640faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:22.485 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 shutdown_connections 2022-09-07T19:42:22.485 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.479+0000 7f346b39d700 1 -- 172.21.15.80:0/1999930495 wait complete. 2022-09-07T19:42:22.505 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-07T19:42:22.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:22 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/444676729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:22.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 -- 172.21.15.80:0/2716035864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390072c90 msgr2=0x7f8390071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 --2- 172.21.15.80:0/2716035864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390072c90 0x7f8390071170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f838c009810 tx=0x7f838c009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:22.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 -- 172.21.15.80:0/2716035864 shutdown_connections 2022-09-07T19:42:22.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 --2- 172.21.15.80:0/2716035864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390072c90 0x7f8390071170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 --2- 172.21.15.80:0/2716035864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 0x7f8390108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 --2- 172.21.15.80:0/2716035864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8390071740 0x7f8390071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 -- 172.21.15.80:0/2716035864 >> 172.21.15.80:0/2716035864 conn(0x7f83900f93f0 msgr2=0x7f83900fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:22.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 -- 172.21.15.80:0/2716035864 shutdown_connections 2022-09-07T19:42:22.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.738+0000 7f8397dff700 1 -- 172.21.15.80:0/2716035864 wait complete. 2022-09-07T19:42:22.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.739+0000 7f8397dff700 1 Processor -- start 2022-09-07T19:42:22.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.739+0000 7f8397dff700 1 -- start start 2022-09-07T19:42:22.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8397dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 0x7f8390195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8397dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8390072c90 0x7f8390196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8397dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 0x7f839019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8397dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019d770 con 0x7f8390071740 2022-09-07T19:42:22.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8397dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019d8e0 con 0x7f8390072c90 2022-09-07T19:42:22.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8397dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019daa0 con 0x7f8390105bc0 2022-09-07T19:42:22.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8395b9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 0x7f8390195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8395b9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 0x7f8390195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58510/0 (socket says 172.21.15.80:58510) 2022-09-07T19:42:22.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f8395b9b700 1 -- 172.21.15.80:0/1813732916 learned_addr learned my addr 172.21.15.80:0/1813732916 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:22.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f839539a700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8390072c90 0x7f8390196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.740+0000 7f839639c700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 0x7f839019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8395b9b700 1 -- 172.21.15.80:0/1813732916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 msgr2=0x7f839019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8395b9b700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 0x7f839019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8395b9b700 1 -- 172.21.15.80:0/1813732916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8390072c90 msgr2=0x7f8390196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8395b9b700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8390072c90 0x7f8390196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8395b9b700 1 -- 172.21.15.80:0/1813732916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c009470 con 0x7f8390071740 2022-09-07T19:42:22.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f839639c700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 0x7f839019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:22.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8395b9b700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 0x7f8390195bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f838c000c00 tx=0x7f838c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:22.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c01d070 con 0x7f8390071740 2022-09-07T19:42:22.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839019dd20 con 0x7f8390071740 2022-09-07T19:42:22.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f838c00f8b0 con 0x7f8390071740 2022-09-07T19:42:22.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.741+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0047f0 con 0x7f8390071740 2022-09-07T19:42:22.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.742+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839019e1d0 con 0x7f8390071740 2022-09-07T19:42:22.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.743+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839010b6b0 con 0x7f8390071740 2022-09-07T19:42:22.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.744+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f838c028030 con 0x7f8390071740 2022-09-07T19:42:22.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.746+0000 7f8386ffd700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f837c099010 0x7f837c09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:22.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.746+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f838c0c3220 con 0x7f8390071740 2022-09-07T19:42:22.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.746+0000 7f839539a700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f837c099010 0x7f837c09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:22.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.747+0000 7f839539a700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f837c099010 0x7f837c09b4c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8380005fd0 tx=0x7f8380005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:22.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.749+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f838c08f6c0 con 0x7f8390071740 2022-09-07T19:42:22.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:22 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/444676729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:22.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:22 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/444676729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:22.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.941+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f839005fae0 con 0x7f8390071740 2022-09-07T19:42:22.941 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.941+0000 7f8386ffd700 1 -- 172.21.15.80:0/1813732916 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f838c092ce0 con 0x7f8390071740 2022-09-07T19:42:22.942 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:42:22.943 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f837c099010 msgr2=0x7f837c09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f837c099010 0x7f837c09b4c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8380005fd0 tx=0x7f8380005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 msgr2=0x7f8390195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:22.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 0x7f8390195bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f838c000c00 tx=0x7f838c00f690 comp rx=0 tx=0).stop 2022-09-07T19:42:22.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 shutdown_connections 2022-09-07T19:42:22.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8390071740 0x7f8390195bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f837c099010 0x7f837c09b4c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.947 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8390105bc0 0x7f839019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.947 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 --2- 172.21.15.80:0/1813732916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8390072c90 0x7f8390196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:22.947 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.944+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 >> 172.21.15.80:0/1813732916 conn(0x7f83900f93f0 msgr2=0x7f83900fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:22.948 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.945+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 shutdown_connections 2022-09-07T19:42:22.948 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:22.945+0000 7f8397dff700 1 -- 172.21.15.80:0/1813732916 wait complete. 2022-09-07T19:42:22.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-07T19:42:23.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 -- 172.21.15.80:0/923413566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 msgr2=0x7f3680103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 --2- 172.21.15.80:0/923413566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 0x7f3680103340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f366c009810 tx=0x7f366c009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 -- 172.21.15.80:0/923413566 shutdown_connections 2022-09-07T19:42:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 --2- 172.21.15.80:0/923413566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3680103880 0x7f3680105c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 --2- 172.21.15.80:0/923413566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36800fe640 0x7f3680100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 --2- 172.21.15.80:0/923413566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 0x7f3680103340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 -- 172.21.15.80:0/923413566 >> 172.21.15.80:0/923413566 conn(0x7f36800f8160 msgr2=0x7f36800fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:23.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 -- 172.21.15.80:0/923413566 shutdown_connections 2022-09-07T19:42:23.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.205+0000 7f3685d9d700 1 -- 172.21.15.80:0/923413566 wait complete. 2022-09-07T19:42:23.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.206+0000 7f3685d9d700 1 Processor -- start 2022-09-07T19:42:23.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.206+0000 7f3685d9d700 1 -- start start 2022-09-07T19:42:23.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.206+0000 7f3685d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 0x7f36801958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3685d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 0x7f3680195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3685d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3680103880 0x7f368019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3685d9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368019d440 con 0x7f36800fe640 2022-09-07T19:42:23.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3685d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368019d5b0 con 0x7f3680100f60 2022-09-07T19:42:23.212 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3685d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368019d770 con 0x7f3680103880 2022-09-07T19:42:23.212 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 0x7f36801958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.212 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 0x7f36801958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58526/0 (socket says 172.21.15.80:58526) 2022-09-07T19:42:23.212 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 -- 172.21.15.80:0/3174453436 learned_addr learned my addr 172.21.15.80:0/3174453436 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:23.213 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f367ffff700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 0x7f3680195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.213 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f368559c700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3680103880 0x7f368019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.213 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 -- 172.21.15.80:0/3174453436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3680103880 msgr2=0x7f368019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.213 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3680103880 0x7f368019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 -- 172.21.15.80:0/3174453436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 msgr2=0x7f3680195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 0x7f3680195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.207+0000 7f3684d9b700 1 -- 172.21.15.80:0/3174453436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c009470 con 0x7f36800fe640 2022-09-07T19:42:23.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.208+0000 7f3684d9b700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 0x7f36801958c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f367400e740 tx=0x7f367400ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:23.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.208+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674005220 con 0x7f36800fe640 2022-09-07T19:42:23.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.208+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368019da50 con 0x7f36800fe640 2022-09-07T19:42:23.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.208+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3674005380 con 0x7f36800fe640 2022-09-07T19:42:23.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.208+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674004b70 con 0x7f36800fe640 2022-09-07T19:42:23.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.208+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368019dfb0 con 0x7f36800fe640 2022-09-07T19:42:23.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.209+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680109270 con 0x7f36800fe640 2022-09-07T19:42:23.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.211+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f367401e020 con 0x7f36800fe640 2022-09-07T19:42:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.212+0000 7f367dffb700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3670099090 0x7f367009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.212+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f3674014070 con 0x7f36800fe640 2022-09-07T19:42:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.213+0000 7f367ffff700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3670099090 0x7f367009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.213+0000 7f367ffff700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3670099090 0x7f367009b540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f366c00b4f0 tx=0x7f366c009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.216+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f367408eb30 con 0x7f36800fe640 2022-09-07T19:42:23.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.409+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f368019eb00 con 0x7f36800fe640 2022-09-07T19:42:23.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.409+0000 7f367dffb700 1 -- 172.21.15.80:0/3174453436 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3674092150 con 0x7f36800fe640 2022-09-07T19:42:23.409 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2022-09-07T19:42:23.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3670099090 msgr2=0x7f367009b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3670099090 0x7f367009b540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f366c00b4f0 tx=0x7f366c009e70 comp rx=0 tx=0).stop 2022-09-07T19:42:23.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 msgr2=0x7f36801958c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 0x7f36801958c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f367400e740 tx=0x7f367400ea50 comp rx=0 tx=0).stop 2022-09-07T19:42:23.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 shutdown_connections 2022-09-07T19:42:23.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36800fe640 0x7f36801958c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3670099090 0x7f367009b540 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3680103880 0x7f368019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 --2- 172.21.15.80:0/3174453436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680100f60 0x7f3680195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 >> 172.21.15.80:0/3174453436 conn(0x7f36800f8160 msgr2=0x7f36800ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:23.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 shutdown_connections 2022-09-07T19:42:23.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.412+0000 7f3685d9d700 1 -- 172.21.15.80:0/3174453436 wait complete. 2022-09-07T19:42:23.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-07T19:42:23.667 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 -- 172.21.15.80:0/4274743825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074073570 msgr2=0x7f8074073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 --2- 172.21.15.80:0/4274743825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074073570 0x7f8074073980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8064009810 tx=0x7f8064009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:23.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 -- 172.21.15.80:0/4274743825 shutdown_connections 2022-09-07T19:42:23.668 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 --2- 172.21.15.80:0/4274743825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074073570 0x7f8074073980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 --2- 172.21.15.80:0/4274743825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074074f50 0x7f8074075b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 --2- 172.21.15.80:0/4274743825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8074073ec0 0x7f80740748e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.667+0000 7f8073fff700 1 -- 172.21.15.80:0/4274743825 >> 172.21.15.80:0/4274743825 conn(0x7f80740fb4d0 msgr2=0x7f80740fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:23.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.668+0000 7f8073fff700 1 -- 172.21.15.80:0/4274743825 shutdown_connections 2022-09-07T19:42:23.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.668+0000 7f8073fff700 1 -- 172.21.15.80:0/4274743825 wait complete. 2022-09-07T19:42:23.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.669+0000 7f8073fff700 1 Processor -- start 2022-09-07T19:42:23.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 -- start start 2022-09-07T19:42:23.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8074073570 0x7f8074199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074073ec0 0x7f807419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 0x7f80741a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80741a18d0 con 0x7f8074074f50 2022-09-07T19:42:23.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80741a1a40 con 0x7f8074073ec0 2022-09-07T19:42:23.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8073fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80741a1c00 con 0x7f8074073570 2022-09-07T19:42:23.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f80737fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 0x7f80741a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8074073570 0x7f8074199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f80737fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 0x7f80741a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58544/0 (socket says 172.21.15.80:58544) 2022-09-07T19:42:23.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f80727fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074073ec0 0x7f807419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.670+0000 7f80737fe700 1 -- 172.21.15.80:0/2363667788 learned_addr learned my addr 172.21.15.80:0/2363667788 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:23.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80727fc700 1 -- 172.21.15.80:0/2363667788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8074073570 msgr2=0x7f8074199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80727fc700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8074073570 0x7f8074199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80727fc700 1 -- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 msgr2=0x7f80741a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80727fc700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 0x7f80741a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80727fc700 1 -- 172.21.15.80:0/2363667788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009730 con 0x7f8074073ec0 2022-09-07T19:42:23.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80737fe700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 0x7f80741a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:23.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f80727fc700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074073ec0 0x7f807419a250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f806800e6c0 tx=0x7f806800e9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:23.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.671+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068010900 con 0x7f8074073ec0 2022-09-07T19:42:23.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.672+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f8068018420 con 0x7f8074073ec0 2022-09-07T19:42:23.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.672+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8064009470 con 0x7f8074073ec0 2022-09-07T19:42:23.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.672+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068017610 con 0x7f8074073ec0 2022-09-07T19:42:23.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.672+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80741a21f0 con 0x7f8074073ec0 2022-09-07T19:42:23.685 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.673+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807410f960 con 0x7f8074073ec0 2022-09-07T19:42:23.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.675+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f806800c040 con 0x7f8074073ec0 2022-09-07T19:42:23.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.676+0000 7f8057fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f805c099090 0x7f805c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:23.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.676+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f8068014070 con 0x7f8074073ec0 2022-09-07T19:42:23.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.676+0000 7f8072ffd700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f805c099090 0x7f805c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:23.687 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.677+0000 7f8072ffd700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f805c099090 0x7f805c09b540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f807419b1e0 tx=0x7f8064009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:23.687 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.678+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f806808ea50 con 0x7f8074073ec0 2022-09-07T19:42:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:23 smithi155 ceph-mon[97606]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:23 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1999930495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:23 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1813732916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:23 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3174453436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:23 smithi080 ceph-mon[90124]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:23.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:23 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1999930495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:23 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1813732916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:23 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3174453436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.869+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f807410c700 con 0x7f8074073ec0 2022-09-07T19:42:23.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.869+0000 7f8057fff700 1 -- 172.21.15.80:0/2363667788 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8068092070 con 0x7f8074073ec0 2022-09-07T19:42:23.873 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:42:23.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f805c099090 msgr2=0x7f805c09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f805c099090 0x7f805c09b540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f807419b1e0 tx=0x7f8064009e70 comp rx=0 tx=0).stop 2022-09-07T19:42:23.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074073ec0 msgr2=0x7f807419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:23.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074073ec0 0x7f807419a250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f806800e6c0 tx=0x7f806800e9d0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 shutdown_connections 2022-09-07T19:42:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8074074f50 0x7f80741a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f805c099090 0x7f805c09b540 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8074073570 0x7f8074199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 --2- 172.21.15.80:0/2363667788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8074073ec0 0x7f807419a250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 >> 172.21.15.80:0/2363667788 conn(0x7f80740fb4d0 msgr2=0x7f80740fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 shutdown_connections 2022-09-07T19:42:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:23.872+0000 7f8073fff700 1 -- 172.21.15.80:0/2363667788 wait complete. 2022-09-07T19:42:23.881 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:23 smithi154 ceph-mon[96967]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:23.881 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:23 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1999930495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.882 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:23 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1813732916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.882 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:23 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3174453436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:42:23.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2022-09-07T19:42:24.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 -- 172.21.15.80:0/1785148562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc072c90 msgr2=0x7f6bcc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/1785148562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc072c90 0x7f6bcc071170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009810 tx=0x7f6bc0009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:24.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 -- 172.21.15.80:0/1785148562 shutdown_connections 2022-09-07T19:42:24.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/1785148562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc105bc0 0x7f6bcc108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/1785148562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc072c90 0x7f6bcc071170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/1785148562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc071740 0x7f6bcc071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 -- 172.21.15.80:0/1785148562 >> 172.21.15.80:0/1785148562 conn(0x7f6bcc0f93f0 msgr2=0x7f6bcc0fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:24.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 -- 172.21.15.80:0/1785148562 shutdown_connections 2022-09-07T19:42:24.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.125+0000 7f6bd2fff700 1 -- 172.21.15.80:0/1785148562 wait complete. 2022-09-07T19:42:24.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.126+0000 7f6bd2fff700 1 Processor -- start 2022-09-07T19:42:24.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.126+0000 7f6bd2fff700 1 -- start start 2022-09-07T19:42:24.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd2fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc071740 0x7f6bcc195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd2fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 0x7f6bcc1960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd2fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc105bc0 0x7f6bcc19d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd2fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc19d710 con 0x7f6bcc072c90 2022-09-07T19:42:24.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd2fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc19d880 con 0x7f6bcc071740 2022-09-07T19:42:24.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd2fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc19da40 con 0x7f6bcc105bc0 2022-09-07T19:42:24.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 0x7f6bcc1960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 0x7f6bcc1960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58552/0 (socket says 172.21.15.80:58552) 2022-09-07T19:42:24.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 -- 172.21.15.80:0/2242728219 learned_addr learned my addr 172.21.15.80:0/2242728219 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:24.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd0d9b700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc071740 0x7f6bcc195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bd159c700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc105bc0 0x7f6bcc19d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 -- 172.21.15.80:0/2242728219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc105bc0 msgr2=0x7f6bcc19d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc105bc0 0x7f6bcc19d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 -- 172.21.15.80:0/2242728219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc071740 msgr2=0x7f6bcc195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc071740 0x7f6bcc195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.127+0000 7f6bcbfff700 1 -- 172.21.15.80:0/2242728219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009470 con 0x7f6bcc072c90 2022-09-07T19:42:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.128+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 0x7f6bcc1960d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e740 tx=0x7f6bb800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.128+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8005220 con 0x7f6bcc072c90 2022-09-07T19:42:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.128+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc19dd20 con 0x7f6bcc072c90 2022-09-07T19:42:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.128+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc19e220 con 0x7f6bcc072c90 2022-09-07T19:42:24.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.128+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6bb8005380 con 0x7f6bcc072c90 2022-09-07T19:42:24.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.128+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8004b70 con 0x7f6bcc072c90 2022-09-07T19:42:24.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.129+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80051a0 con 0x7f6bcc072c90 2022-09-07T19:42:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.131+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f6bb801e020 con 0x7f6bcc072c90 2022-09-07T19:42:24.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.132+0000 7f6bc9ffb700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6bbc099010 0x7f6bbc09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.132+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f6bb8014070 con 0x7f6bcc072c90 2022-09-07T19:42:24.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.133+0000 7f6bd0d9b700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6bbc099010 0x7f6bbc09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.133+0000 7f6bd0d9b700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6bbc099010 0x7f6bbc09b4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000b4f0 tx=0x7f6bc0009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:24.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.136+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f6bb808ebc0 con 0x7f6bcc072c90 2022-09-07T19:42:24.344 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.345+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ba8005df0 con 0x7f6bcc072c90 2022-09-07T19:42:24.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.346+0000 7f6bc9ffb700 1 -- 172.21.15.80:0/2242728219 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+590 (secure 0 0 0) 0x7f6bb80921e0 con 0x7f6bcc072c90 2022-09-07T19:42:24.347 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/1499799081 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:24.347 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/1499799081 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:24.347 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/722803782 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:24.348 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/2842896476 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:24.348 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1903100695 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:24.348 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/146266391 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:24.349 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/2842896476 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:24.349 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/4051851685 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:24.349 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/3462161622 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:24.349 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/3017372829 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6bbc099010 msgr2=0x7f6bbc09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6bbc099010 0x7f6bbc09b4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000b4f0 tx=0x7f6bc0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 msgr2=0x7f6bcc1960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 0x7f6bcc1960d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e740 tx=0x7f6bb800ea50 comp rx=0 tx=0).stop 2022-09-07T19:42:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 shutdown_connections 2022-09-07T19:42:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6bbc099010 0x7f6bbc09b4c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc105bc0 0x7f6bcc19d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc071740 0x7f6bcc195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 --2- 172.21.15.80:0/2242728219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc072c90 0x7f6bcc1960d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.348+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 >> 172.21.15.80:0/2242728219 conn(0x7f6bcc0f93f0 msgr2=0x7f6bcc0fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.349+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 shutdown_connections 2022-09-07T19:42:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.349+0000 7f6bd2fff700 1 -- 172.21.15.80:0/2242728219 wait complete. 2022-09-07T19:42:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:listed 10 entries 2022-09-07T19:42:24.374 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:42:24.375 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2022-09-07T19:42:24.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 -- 172.21.15.80:0/525057209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fdcf0 msgr2=0x7fb7ec0fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/525057209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec0fe100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009750 tx=0x7fb7dc009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 -- 172.21.15.80:0/525057209 shutdown_connections 2022-09-07T19:42:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/525057209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/525057209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec0fe100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/525057209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fef70 0x7fb7ec0ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 -- 172.21.15.80:0/525057209 >> 172.21.15.80:0/525057209 conn(0x7fb7ec0f93c0 msgr2=0x7fb7ec0fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:24.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.681+0000 7fb7f25ff700 1 -- 172.21.15.80:0/525057209 shutdown_connections 2022-09-07T19:42:24.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.682+0000 7fb7f25ff700 1 -- 172.21.15.80:0/525057209 wait complete. 2022-09-07T19:42:24.689 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 Processor -- start 2022-09-07T19:42:24.689 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 -- start start 2022-09-07T19:42:24.689 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.689 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fef70 0x7fb7ec196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec19d680 con 0x7fb7ec0ff900 2022-09-07T19:42:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec19d7f0 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f25ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec19d9b0 con 0x7fb7ec0fef70 2022-09-07T19:42:24.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7f0b9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.683+0000 7fb7ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7eb7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fef70 0x7fb7ec196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7f0b9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58568/0 (socket says 172.21.15.80:58568) 2022-09-07T19:42:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7f0b9c700 1 -- 172.21.15.80:0/2814178398 learned_addr learned my addr 172.21.15.80:0/2814178398 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7ebfff700 1 -- 172.21.15.80:0/2814178398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fef70 msgr2=0x7fb7ec196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7ebfff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fef70 0x7fb7ec196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7ebfff700 1 -- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 msgr2=0x7fb7ec19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7ebfff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7ebfff700 1 -- 172.21.15.80:0/2814178398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0093b0 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7f0b9c700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:24.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.684+0000 7fb7ebfff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec195b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0096a0 tx=0x7fb7dc004230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:24.694 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.685+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc01d070 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.685+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec19dc30 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.685+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb7dc005590 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.685+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0179f0 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.685+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec19e0d0 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.686+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec109510 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.688+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fb7dc00c040 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.689+0000 7fb7e97fa700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7d4099090 0x7fb7d409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.689+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fb7dc0c3630 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.689+0000 7fb7eb7fe700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7d4099090 0x7fb7d409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:24.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:24 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2363667788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:42:24.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:24 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2242728219' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2022-09-07T19:42:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.690+0000 7fb7eb7fe700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7d4099090 0x7fb7d409b540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005fd0 tx=0x7fb7e0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.691+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb7dc08fbe0 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:24 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2363667788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:42:24.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:24 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2242728219' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2022-09-07T19:42:24.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:24 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2363667788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:42:24.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:24 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2242728219' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2022-09-07T19:42:24.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.883+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7ec1900b0 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.884 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.885+0000 7fb7e97fa700 1 -- 172.21.15.80:0/2814178398 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7fb7dc093200 con 0x7fb7ec0fdcf0 2022-09-07T19:42:24.884 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:24.885 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:24.887 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.887+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7d4099090 msgr2=0x7fb7d409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.887+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7d4099090 0x7fb7d409b540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005fd0 tx=0x7fb7e0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.887+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fdcf0 msgr2=0x7fb7ec195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:24.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.887+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec195b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0096a0 tx=0x7fb7dc004230 comp rx=0 tx=0).stop 2022-09-07T19:42:24.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 shutdown_connections 2022-09-07T19:42:24.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7ec0ff900 0x7fb7ec19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7d4099090 0x7fb7d409b540 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.889 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec0fdcf0 0x7fb7ec195b00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 --2- 172.21.15.80:0/2814178398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7ec0fef70 0x7fb7ec196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:24.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 >> 172.21.15.80:0/2814178398 conn(0x7fb7ec0f93c0 msgr2=0x7fb7ec1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:24.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 shutdown_connections 2022-09-07T19:42:24.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:24.888+0000 7fb7f25ff700 1 -- 172.21.15.80:0/2814178398 wait complete. 2022-09-07T19:42:24.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-07T19:42:05.026979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-09-07T19:42:06.340517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-07T19:42:10.116527+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-07T19:42:24.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:42:25.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 -- 172.21.15.80:0/1861090677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8103910 msgr2=0x7fc1e8105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 --2- 172.21.15.80:0/1861090677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8103910 0x7fc1e8105d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009bb0 tx=0x7fc1e0009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 -- 172.21.15.80:0/1861090677 shutdown_connections 2022-09-07T19:42:25.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 --2- 172.21.15.80:0/1861090677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8103910 0x7fc1e8105d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 --2- 172.21.15.80:0/1861090677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8066bf0 0x7fc1e81008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 --2- 172.21.15.80:0/1861090677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8100e20 0x7fc1e8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 -- 172.21.15.80:0/1861090677 >> 172.21.15.80:0/1861090677 conn(0x7fc1e80f82f0 msgr2=0x7fc1e80fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:25.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 -- 172.21.15.80:0/1861090677 shutdown_connections 2022-09-07T19:42:25.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.147+0000 7fc1efbff700 1 -- 172.21.15.80:0/1861090677 wait complete. 2022-09-07T19:42:25.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 Processor -- start 2022-09-07T19:42:25.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 -- start start 2022-09-07T19:42:25.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 0x7fc1e80fe240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8100e20 0x7fc1e80fc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8103910 0x7fc1e80fce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80fd5c0 con 0x7fc1e8066bf0 2022-09-07T19:42:25.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80fd730 con 0x7fc1e8100e20 2022-09-07T19:42:25.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.149+0000 7fc1efbff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819d9e0 con 0x7fc1e8103910 2022-09-07T19:42:25.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 0x7fc1e80fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 0x7fc1e80fe240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58576/0 (socket says 172.21.15.80:58576) 2022-09-07T19:42:25.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 -- 172.21.15.80:0/107981931 learned_addr learned my addr 172.21.15.80:0/107981931 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:25.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed19a700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8100e20 0x7fc1e80fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ee19c700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8103910 0x7fc1e80fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 -- 172.21.15.80:0/107981931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8103910 msgr2=0x7fc1e80fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8103910 0x7fc1e80fce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 -- 172.21.15.80:0/107981931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8100e20 msgr2=0x7fc1e80fc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8100e20 0x7fc1e80fc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 -- 172.21.15.80:0/107981931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00097e0 con 0x7fc1e8066bf0 2022-09-07T19:42:25.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1ed99b700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 0x7fc1e80fe240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400e6e0 tx=0x7fc1e400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:25.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.150+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4009500 con 0x7fc1e8066bf0 2022-09-07T19:42:25.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.151+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e819dcc0 con 0x7fc1e8066bf0 2022-09-07T19:42:25.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.151+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fc1e4010da0 con 0x7fc1e8066bf0 2022-09-07T19:42:25.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.151+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40173d0 con 0x7fc1e8066bf0 2022-09-07T19:42:25.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.151+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e819e1a0 con 0x7fc1e8066bf0 2022-09-07T19:42:25.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.152+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e8109520 con 0x7fc1e8066bf0 2022-09-07T19:42:25.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.154+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fc1e400c040 con 0x7fc1e8066bf0 2022-09-07T19:42:25.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.155+0000 7fc1deffd700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc1d4099090 0x7fc1d409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.155+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fc1e4014070 con 0x7fc1e8066bf0 2022-09-07T19:42:25.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.155+0000 7fc1ed19a700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc1d4099090 0x7fc1d409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.156+0000 7fc1ed19a700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc1d4099090 0x7fc1d409b540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:25.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.158+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fc1e408f000 con 0x7fc1e8066bf0 2022-09-07T19:42:25.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.347+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1e805f120 con 0x7fc1e8066bf0 2022-09-07T19:42:25.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.347+0000 7fc1deffd700 1 -- 172.21.15.80:0/107981931 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1e4026020 con 0x7fc1e8066bf0 2022-09-07T19:42:25.347 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:42:25.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc1d4099090 msgr2=0x7fc1d409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc1d4099090 0x7fc1d409b540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 msgr2=0x7fc1e80fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 0x7fc1e80fe240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400e6e0 tx=0x7fc1e400e9f0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 shutdown_connections 2022-09-07T19:42:25.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e8066bf0 0x7fc1e80fe240 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc1d4099090 0x7fc1d409b540 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8103910 0x7fc1e80fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 --2- 172.21.15.80:0/107981931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8100e20 0x7fc1e80fc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 >> 172.21.15.80:0/107981931 conn(0x7fc1e80f82f0 msgr2=0x7fc1e80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:25.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 shutdown_connections 2022-09-07T19:42:25.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.350+0000 7fc1efbff700 1 -- 172.21.15.80:0/107981931 wait complete. 2022-09-07T19:42:25.377 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-07T19:42:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 -- 172.21.15.80:0/3954516943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 msgr2=0x7ff2f40fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3954516943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f40fee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009750 tx=0x7ff2e8009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 -- 172.21.15.80:0/3954516943 shutdown_connections 2022-09-07T19:42:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3954516943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f40fdb40 0x7ff2f40fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.615 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3954516943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f40ff510 0x7ff2f41060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.615 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3954516943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f40fee80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.615 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 -- 172.21.15.80:0/3954516943 >> 172.21.15.80:0/3954516943 conn(0x7ff2f40f9230 msgr2=0x7ff2f40fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:25.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 -- 172.21.15.80:0/3954516943 shutdown_connections 2022-09-07T19:42:25.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.609+0000 7ff2f359e700 1 -- 172.21.15.80:0/3954516943 wait complete. 2022-09-07T19:42:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 Processor -- start 2022-09-07T19:42:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 -- start start 2022-09-07T19:42:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f40fdb40 0x7ff2f4195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f4195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f40ff510 0x7ff2f419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419d4d0 con 0x7ff2f40fdb40 2022-09-07T19:42:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419d640 con 0x7ff2f40fe490 2022-09-07T19:42:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.610+0000 7ff2f359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419d800 con 0x7ff2f40ff510 2022-09-07T19:42:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f4195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f4195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:49290/0 (socket says 172.21.15.80:49290) 2022-09-07T19:42:25.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 -- 172.21.15.80:0/3761420030 learned_addr learned my addr 172.21.15.80:0/3761420030 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:25.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f259c700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f40fdb40 0x7ff2f4195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f2d9d700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f40ff510 0x7ff2f419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 -- 172.21.15.80:0/3761420030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f40ff510 msgr2=0x7ff2f419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f40ff510 0x7ff2f419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 -- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f40fdb40 msgr2=0x7ff2f4195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f40fdb40 0x7ff2f4195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 -- 172.21.15.80:0/3761420030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80093b0 con 0x7ff2f40fe490 2022-09-07T19:42:25.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.611+0000 7ff2f1d9b700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f4195e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8004230 tx=0x7ff2e8004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:25.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.612+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e801d070 con 0x7ff2f40fe490 2022-09-07T19:42:25.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.612+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f419da80 con 0x7ff2f40fe490 2022-09-07T19:42:25.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.612+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff2e8003bb0 con 0x7ff2f40fe490 2022-09-07T19:42:25.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.612+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8017ab0 con 0x7ff2f40fe490 2022-09-07T19:42:25.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.612+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f419df20 con 0x7ff2f40fe490 2022-09-07T19:42:25.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.613+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4109300 con 0x7ff2f40fe490 2022-09-07T19:42:25.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.615+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ff2e800c040 con 0x7ff2f40fe490 2022-09-07T19:42:25.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.616+0000 7ff2e37fe700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2dc099010 0x7ff2dc09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:25.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.616+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7ff2e80c3940 con 0x7ff2f40fe490 2022-09-07T19:42:25.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.616+0000 7ff2f259c700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2dc099010 0x7ff2dc09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:25.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.617+0000 7ff2f259c700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2dc099010 0x7ff2dc09b4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005fd0 tx=0x7ff2e4005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:25.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.618+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff2e808fde0 con 0x7ff2f40fe490 2022-09-07T19:42:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:25 smithi155 ceph-mon[97606]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:25.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2814178398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:25.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/107981931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.809+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2f419e530 con 0x7ff2f40fe490 2022-09-07T19:42:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.810+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3761420030 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2e8093400 con 0x7ff2f40fe490 2022-09-07T19:42:25.810 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:42:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2dc099010 msgr2=0x7ff2dc09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2dc099010 0x7ff2dc09b4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005fd0 tx=0x7ff2e4005f60 comp rx=0 tx=0).stop 2022-09-07T19:42:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 msgr2=0x7ff2f4195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f4195e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8004230 tx=0x7ff2e8004260 comp rx=0 tx=0).stop 2022-09-07T19:42:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 shutdown_connections 2022-09-07T19:42:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f40fdb40 0x7ff2f4195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2dc099010 0x7ff2dc09b4c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f40ff510 0x7ff2f419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 --2- 172.21.15.80:0/3761420030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f40fe490 0x7ff2f4195e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 >> 172.21.15.80:0/3761420030 conn(0x7ff2f40f9230 msgr2=0x7ff2f40fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 shutdown_connections 2022-09-07T19:42:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:25.813+0000 7ff2f359e700 1 -- 172.21.15.80:0/3761420030 wait complete. 2022-09-07T19:42:25.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:25 smithi080 ceph-mon[90124]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:25.836 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:25 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2814178398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:25.836 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:25 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/107981931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:25.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-07T19:42:25.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:25 smithi154 ceph-mon[96967]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:42:25.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:25 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2814178398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:25.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:25 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/107981931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 -- 172.21.15.80:0/4123722514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84100f60 msgr2=0x7f3a84103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/4123722514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84100f60 0x7f3a84103340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009750 tx=0x7f3a74009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 -- 172.21.15.80:0/4123722514 shutdown_connections 2022-09-07T19:42:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/4123722514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84103880 0x7f3a84105c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/4123722514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840fe640 0x7f3a84100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/4123722514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84100f60 0x7f3a84103340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 -- 172.21.15.80:0/4123722514 >> 172.21.15.80:0/4123722514 conn(0x7f3a840f8160 msgr2=0x7f3a840fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 -- 172.21.15.80:0/4123722514 shutdown_connections 2022-09-07T19:42:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.070+0000 7f3a89d9d700 1 -- 172.21.15.80:0/4123722514 wait complete. 2022-09-07T19:42:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.071+0000 7f3a89d9d700 1 Processor -- start 2022-09-07T19:42:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 -- start start 2022-09-07T19:42:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840fe640 0x7f3a840fdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84100f60 0x7f3a840fc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84103880 0x7f3a840fcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840fd330 con 0x7f3a84103880 2022-09-07T19:42:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840fd4a0 con 0x7f3a84100f60 2022-09-07T19:42:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.072+0000 7f3a89d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8419d7e0 con 0x7f3a840fe640 2022-09-07T19:42:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a7bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84100f60 0x7f3a840fc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84103880 0x7f3a840fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a7bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84100f60 0x7f3a840fc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:49312/0 (socket says 172.21.15.80:49312) 2022-09-07T19:42:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a7bfff700 1 -- 172.21.15.80:0/1646300814 learned_addr learned my addr 172.21.15.80:0/1646300814 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a88d9b700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840fe640 0x7f3a840fdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 -- 172.21.15.80:0/1646300814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840fe640 msgr2=0x7f3a840fdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840fe640 0x7f3a840fdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 -- 172.21.15.80:0/1646300814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84100f60 msgr2=0x7f3a840fc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84100f60 0x7f3a840fc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 -- 172.21.15.80:0/1646300814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740093b0 con 0x7f3a84103880 2022-09-07T19:42:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a8959c700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84103880 0x7f3a840fcb90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00e970 tx=0x7f3a7c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.073+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c004c30 con 0x7f3a84103880 2022-09-07T19:42:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.074+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3a7c004d90 con 0x7f3a84103880 2022-09-07T19:42:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.074+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c005800 con 0x7f3a84103880 2022-09-07T19:42:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.074+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8419dac0 con 0x7f3a84103880 2022-09-07T19:42:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.074+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8419df80 con 0x7f3a84103880 2022-09-07T19:42:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.075+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a841092c0 con 0x7f3a84103880 2022-09-07T19:42:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.077+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f3a7c01e020 con 0x7f3a84103880 2022-09-07T19:42:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.078+0000 7f3a79ffb700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3a6c099090 0x7f3a6c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.078+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f3a7c014070 con 0x7f3a84103880 2022-09-07T19:42:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.078+0000 7f3a88d9b700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3a6c099090 0x7f3a6c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.079+0000 7f3a88d9b700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3a6c099090 0x7f3a6c09b540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a80005fd0 tx=0x7f3a80005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:26.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.081+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f3a7c08eda0 con 0x7f3a84103880 2022-09-07T19:42:26.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.270+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a84109450 con 0x7f3a84103880 2022-09-07T19:42:26.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.270+0000 7f3a79ffb700 1 -- 172.21.15.80:0/1646300814 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a84109450 con 0x7f3a84103880 2022-09-07T19:42:26.271 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2022-09-07T19:42:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3a6c099090 msgr2=0x7f3a6c09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3a6c099090 0x7f3a6c09b540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a80005fd0 tx=0x7f3a80005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84103880 msgr2=0x7f3a840fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84103880 0x7f3a840fcb90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00e970 tx=0x7f3a7c00ec80 comp rx=0 tx=0).stop 2022-09-07T19:42:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 shutdown_connections 2022-09-07T19:42:26.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a84103880 0x7f3a840fcb90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3a6c099090 0x7f3a6c09b540 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840fe640 0x7f3a840fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 --2- 172.21.15.80:0/1646300814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a84100f60 0x7f3a840fc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 >> 172.21.15.80:0/1646300814 conn(0x7f3a840f8160 msgr2=0x7f3a840ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:26.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 shutdown_connections 2022-09-07T19:42:26.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.273+0000 7f3a89d9d700 1 -- 172.21.15.80:0/1646300814 wait complete. 2022-09-07T19:42:26.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-07T19:42:26.535 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 -- 172.21.15.80:0/996967340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fe490 msgr2=0x7fe4900fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.536 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 --2- 172.21.15.80:0/996967340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fe490 0x7fe4900fee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe484009810 tx=0x7fe484009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:26.536 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 -- 172.21.15.80:0/996967340 shutdown_connections 2022-09-07T19:42:26.536 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 --2- 172.21.15.80:0/996967340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fdb40 0x7fe4900fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 --2- 172.21.15.80:0/996967340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 0x7fe4901060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 --2- 172.21.15.80:0/996967340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fe490 0x7fe4900fee80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 -- 172.21.15.80:0/996967340 >> 172.21.15.80:0/996967340 conn(0x7fe4900f9230 msgr2=0x7fe4900fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 -- 172.21.15.80:0/996967340 shutdown_connections 2022-09-07T19:42:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.536+0000 7fe48f59e700 1 -- 172.21.15.80:0/996967340 wait complete. 2022-09-07T19:42:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.537+0000 7fe48f59e700 1 Processor -- start 2022-09-07T19:42:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 -- start start 2022-09-07T19:42:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fdb40 0x7fe490072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 0x7fe4900710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 0x7fe490071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe490071e10 con 0x7fe4900fe490 2022-09-07T19:42:26.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe490071f80 con 0x7fe4900fdb40 2022-09-07T19:42:26.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.538+0000 7fe48f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49019d820 con 0x7fe4900ff510 2022-09-07T19:42:26.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 0x7fe4900710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 0x7fe490071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 0x7fe4900710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58636/0 (socket says 172.21.15.80:58636) 2022-09-07T19:42:26.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48dd9b700 1 -- 172.21.15.80:0/980163856 learned_addr learned my addr 172.21.15.80:0/980163856 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:26.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48e59c700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fdb40 0x7fe490072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 -- 172.21.15.80:0/980163856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fdb40 msgr2=0x7fe490072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fdb40 0x7fe490072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 -- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 msgr2=0x7fe4900710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.545 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 0x7fe4900710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.545 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 -- 172.21.15.80:0/980163856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009470 con 0x7fe4900ff510 2022-09-07T19:42:26.545 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48dd9b700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 0x7fe4900710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:26.545 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.539+0000 7fe48ed9d700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 0x7fe490071670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe48800eab0 tx=0x7fe48800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:26.546 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.540+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488004c30 con 0x7fe4900ff510 2022-09-07T19:42:26.546 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.540+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49019db00 con 0x7fe4900ff510 2022-09-07T19:42:26.547 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.540+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fe48800ce10 con 0x7fe4900ff510 2022-09-07T19:42:26.548 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.540+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488004280 con 0x7fe4900ff510 2022-09-07T19:42:26.548 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.540+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49019e010 con 0x7fe4900ff510 2022-09-07T19:42:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.541+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe490109300 con 0x7fe4900ff510 2022-09-07T19:42:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.543+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fe48800c040 con 0x7fe4900ff510 2022-09-07T19:42:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.544+0000 7fe47f7fe700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe478099090 0x7fe47809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.544+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fe488014070 con 0x7fe4900ff510 2022-09-07T19:42:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.544+0000 7fe48e59c700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe478099090 0x7fe47809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.545+0000 7fe48e59c700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe478099090 0x7fe47809b540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe480005fd0 tx=0x7fe480005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.546+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fe48808f360 con 0x7fe4900ff510 2022-09-07T19:42:26.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:26 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3761420030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:26 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1646300814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.737+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe49019e8d0 con 0x7fe4900ff510 2022-09-07T19:42:26.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.738+0000 7fe47f7fe700 1 -- 172.21.15.80:0/980163856 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe48801c020 con 0x7fe4900ff510 2022-09-07T19:42:26.738 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:42:26.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe478099090 msgr2=0x7fe47809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe478099090 0x7fe47809b540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe480005fd0 tx=0x7fe480005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 msgr2=0x7fe490071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 0x7fe490071670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe48800eab0 tx=0x7fe48800edc0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 shutdown_connections 2022-09-07T19:42:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe478099090 0x7fe47809b540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4900ff510 0x7fe490071670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4900fdb40 0x7fe490072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 --2- 172.21.15.80:0/980163856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4900fe490 0x7fe4900710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 >> 172.21.15.80:0/980163856 conn(0x7fe4900f9230 msgr2=0x7fe4900fb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 shutdown_connections 2022-09-07T19:42:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.741+0000 7fe48f59e700 1 -- 172.21.15.80:0/980163856 wait complete. 2022-09-07T19:42:26.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2022-09-07T19:42:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:26 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3761420030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:26 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1646300814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:26 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3761420030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:26 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1646300814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:42:26.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 -- 172.21.15.80:0/612901075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 msgr2=0x7fe110071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:26.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 --2- 172.21.15.80:0/612901075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe110071170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe100009810 tx=0x7fe100009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 -- 172.21.15.80:0/612901075 shutdown_connections 2022-09-07T19:42:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 --2- 172.21.15.80:0/612901075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe110071170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 --2- 172.21.15.80:0/612901075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe110101640 0x7fe11010c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 --2- 172.21.15.80:0/612901075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1100716b0 0x7fe110071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 -- 172.21.15.80:0/612901075 >> 172.21.15.80:0/612901075 conn(0x7fe1100f9230 msgr2=0x7fe1100fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 -- 172.21.15.80:0/612901075 shutdown_connections 2022-09-07T19:42:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.995+0000 7fe11579d700 1 -- 172.21.15.80:0/612901075 wait complete. 2022-09-07T19:42:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 Processor -- start 2022-09-07T19:42:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 -- start start 2022-09-07T19:42:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1100716b0 0x7fe110199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe11019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe110101640 0x7fe1101a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101a18c0 con 0x7fe110072bf0 2022-09-07T19:42:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101a1a30 con 0x7fe1100716b0 2022-09-07T19:42:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe11579d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101a1bf0 con 0x7fe110101640 2022-09-07T19:42:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe10f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe11019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe114f9c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe110101640 0x7fe1101a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe10f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe11019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58660/0 (socket says 172.21.15.80:58660) 2022-09-07T19:42:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.997+0000 7fe10f7fe700 1 -- 172.21.15.80:0/3731997123 learned_addr learned my addr 172.21.15.80:0/3731997123 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe10ffff700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1100716b0 0x7fe110199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe114f9c700 1 -- 172.21.15.80:0/3731997123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1100716b0 msgr2=0x7fe110199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe114f9c700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1100716b0 0x7fe110199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe114f9c700 1 -- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 msgr2=0x7fe11019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe114f9c700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe11019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe114f9c700 1 -- 172.21.15.80:0/3731997123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009470 con 0x7fe110101640 2022-09-07T19:42:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe10f7fe700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe11019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe114f9c700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe110101640 0x7fe1101a12f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe10800e990 tx=0x7fe10800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:27.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.998+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108004c30 con 0x7fe110101640 2022-09-07T19:42:27.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.999+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fe108004d90 con 0x7fe110101640 2022-09-07T19:42:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.999+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1101a1ed0 con 0x7fe110101640 2022-09-07T19:42:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.999+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108005720 con 0x7fe110101640 2022-09-07T19:42:27.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:26.999+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1101a2300 con 0x7fe110101640 2022-09-07T19:42:27.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.000+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11010f900 con 0x7fe110101640 2022-09-07T19:42:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.002+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fe108021070 con 0x7fe110101640 2022-09-07T19:42:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.003+0000 7fe10d7fa700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe0f8099010 0x7fe0f809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.003+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fe1080c2430 con 0x7fe110101640 2022-09-07T19:42:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.003+0000 7fe10ffff700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe0f8099010 0x7fe0f809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.004+0000 7fe10ffff700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe0f8099010 0x7fe0f809b4c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe100009760 tx=0x7fe100009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.005+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fe10808e8d0 con 0x7fe110101640 2022-09-07T19:42:27.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.211+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1100ffc10 con 0x7fe110101640 2022-09-07T19:42:27.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.212+0000 7fe10d7fa700 1 -- 172.21.15.80:0/3731997123 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+590 (secure 0 0 0) 0x7fe10801f080 con 0x7fe110101640 2022-09-07T19:42:27.212 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/1499799081 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:27.212 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/1499799081 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:27.212 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/722803782 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:27.213 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/2842896476 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:27.213 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1903100695 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:27.213 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/146266391 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:27.213 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/2842896476 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:27.213 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/4051851685 2022-09-08T19:34:41.782435+0000 2022-09-07T19:42:27.214 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/3462161622 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:27.214 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/3017372829 2022-09-08T19:34:13.528508+0000 2022-09-07T19:42:27.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.214+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe0f8099010 msgr2=0x7fe0f809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:27.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.214+0000 7fe11579d700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe0f8099010 0x7fe0f809b4c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe100009760 tx=0x7fe100009e70 comp rx=0 tx=0).stop 2022-09-07T19:42:27.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.214+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe110101640 msgr2=0x7fe1101a12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:27.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.214+0000 7fe11579d700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe110101640 0x7fe1101a12f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe10800e990 tx=0x7fe10800eca0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 shutdown_connections 2022-09-07T19:42:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fe0f8099010 0x7fe0f809b4c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe110101640 0x7fe1101a12f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1100716b0 0x7fe110199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 --2- 172.21.15.80:0/3731997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe110072bf0 0x7fe11019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 >> 172.21.15.80:0/3731997123 conn(0x7fe1100f9230 msgr2=0x7fe1100fb610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 shutdown_connections 2022-09-07T19:42:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:27.215+0000 7fe11579d700 1 -- 172.21.15.80:0/3731997123 wait complete. 2022-09-07T19:42:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:listed 10 entries 2022-09-07T19:42:27.241 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi080.front.sepia.ceph.com... 2022-09-07T19:42:27.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:27.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2022-09-07T19:42:27.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[128253]: fuse finished with error 0 and tester_r 0 2022-09-07T19:42:27.332 INFO:teuthology.orchestra.run:waiting for 300 2022-09-07T19:42:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:27 smithi080 ceph-mon[90124]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:27 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/980163856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:42:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:27 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3731997123' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2022-09-07T19:42:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:27 smithi154 ceph-mon[96967]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:27 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/980163856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:42:27.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:27 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3731997123' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2022-09-07T19:42:27.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:27 smithi155 ceph-mon[97606]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:27.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:27 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/980163856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:42:27.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:27 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3731997123' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2022-09-07T19:42:29.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:29 smithi080 ceph-mon[90124]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:29 smithi154 ceph-mon[96967]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:29.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:29 smithi155 ceph-mon[97606]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:31.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:31 smithi080 ceph-mon[90124]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:31.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:31 smithi154 ceph-mon[96967]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:31.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:31 smithi155 ceph-mon[97606]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:33.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:42:33.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:42:33.437 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2022-09-07T19:42:33.513 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 -- 172.21.15.80:0/1639111668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0ff900 msgr2=0x7f44ac1061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 --2- 172.21.15.80:0/1639111668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0ff900 0x7f44ac1061c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009bb0 tx=0x7f44a4009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 -- 172.21.15.80:0/1639111668 shutdown_connections 2022-09-07T19:42:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 --2- 172.21.15.80:0/1639111668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0ff900 0x7f44ac1061c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 --2- 172.21.15.80:0/1639111668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac0fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 --2- 172.21.15.80:0/1639111668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44ac0fef70 0x7f44ac0ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 -- 172.21.15.80:0/1639111668 >> 172.21.15.80:0/1639111668 conn(0x7f44ac0f93c0 msgr2=0x7f44ac0fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:33.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 -- 172.21.15.80:0/1639111668 shutdown_connections 2022-09-07T19:42:33.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.743+0000 7f44b33ff700 1 -- 172.21.15.80:0/1639111668 wait complete. 2022-09-07T19:42:33.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.745+0000 7f44b33ff700 1 Processor -- start 2022-09-07T19:42:33.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.745+0000 7f44b33ff700 1 -- start start 2022-09-07T19:42:33.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b33ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:33.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b33ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44ac0fef70 0x7f44ac0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:33.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b33ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac0ff900 0x7f44ac071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:33.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b33ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac071e10 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b33ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac071f80 con 0x7f44ac0ff900 2022-09-07T19:42:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b33ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac19d9d0 con 0x7f44ac0fef70 2022-09-07T19:42:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b119b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b119b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44276/0 (socket says 172.21.15.80:44276) 2022-09-07T19:42:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b119b700 1 -- 172.21.15.80:0/3128293369 learned_addr learned my addr 172.21.15.80:0/3128293369 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b099a700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44ac0fef70 0x7f44ac0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b199c700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac0ff900 0x7f44ac071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.746+0000 7f44b119b700 1 -- 172.21.15.80:0/3128293369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44ac0fef70 msgr2=0x7f44ac0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b119b700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44ac0fef70 0x7f44ac0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b119b700 1 -- 172.21.15.80:0/3128293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac0ff900 msgr2=0x7f44ac071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b119b700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac0ff900 0x7f44ac071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b119b700 1 -- 172.21.15.80:0/3128293369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80093b0 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b119b700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac072a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f44a800e9a0 tx=0x7f44a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800ca10 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f44a800cb70 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a40097e0 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8018680 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.747+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac19e050 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.748+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac1094b0 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.750+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f44a800c040 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.751+0000 7f44a27fc700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4498099090 0x7f449809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.751+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f44a8014070 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.752+0000 7f44b099a700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4498099090 0x7f449809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.753+0000 7f44b099a700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4498099090 0x7f449809b540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f449c005fd0 tx=0x7f449c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.756+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f44a808ef30 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:33 smithi080 ceph-mon[90124]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:33.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:33 smithi154 ceph-mon[96967]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:33.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:33 smithi155 ceph-mon[97606]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.948+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44ac105240 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.949 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.949+0000 7f44a27fc700 1 -- 172.21.15.80:0/3128293369 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7f44a8092550 con 0x7f44ac0fdcf0 2022-09-07T19:42:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:33.950 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4498099090 msgr2=0x7f449809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4498099090 0x7f449809b540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f449c005fd0 tx=0x7f449c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 msgr2=0x7f44ac072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac072a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f44a800e9a0 tx=0x7f44a800ecb0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 shutdown_connections 2022-09-07T19:42:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44ac0fdcf0 0x7f44ac072a90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4498099090 0x7f449809b540 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac0ff900 0x7f44ac071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 --2- 172.21.15.80:0/3128293369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44ac0fef70 0x7f44ac0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:33.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 >> 172.21.15.80:0/3128293369 conn(0x7f44ac0f93c0 msgr2=0x7f44ac102500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:33.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 shutdown_connections 2022-09-07T19:42:33.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:33.952+0000 7f44b33ff700 1 -- 172.21.15.80:0/3128293369 wait complete. 2022-09-07T19:42:33.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.205+0000 7f6c9599d700 1 -- 172.21.15.80:0/3535940134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90071630 msgr2=0x7f6c90071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.205+0000 7f6c9599d700 1 --2- 172.21.15.80:0/3535940134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90071630 0x7f6c90071aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009750 tx=0x7f6c7c009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 -- 172.21.15.80:0/3535940134 shutdown_connections 2022-09-07T19:42:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 --2- 172.21.15.80:0/3535940134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c90107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 --2- 172.21.15.80:0/3535940134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c90072b70 0x7f6c900710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 --2- 172.21.15.80:0/3535940134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90071630 0x7f6c90071aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 -- 172.21.15.80:0/3535940134 >> 172.21.15.80:0/3535940134 conn(0x7f6c900f9260 msgr2=0x7f6c900fb690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 -- 172.21.15.80:0/3535940134 shutdown_connections 2022-09-07T19:42:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.206+0000 7f6c9599d700 1 -- 172.21.15.80:0/3535940134 wait complete. 2022-09-07T19:42:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 Processor -- start 2022-09-07T19:42:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 -- start start 2022-09-07T19:42:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c90071630 0x7f6c901958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 0x7f6c90195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c9019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9019d470 con 0x7f6c90105b00 2022-09-07T19:42:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9019d5e0 con 0x7f6c90072b70 2022-09-07T19:42:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.207+0000 7f6c9599d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9019d7a0 con 0x7f6c90071630 2022-09-07T19:42:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c9019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 0x7f6c90195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c9019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44298/0 (socket says 172.21.15.80:44298) 2022-09-07T19:42:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 0x7f6c90195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:59064/0 (socket says 172.21.15.80:59064) 2022-09-07T19:42:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 -- 172.21.15.80:0/1984665120 learned_addr learned my addr 172.21.15.80:0/1984665120 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9499b700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c90071630 0x7f6c901958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 -- 172.21.15.80:0/1984665120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c90071630 msgr2=0x7f6c901958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c90071630 0x7f6c901958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 -- 172.21.15.80:0/1984665120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 msgr2=0x7f6c90195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 0x7f6c90195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c9519c700 1 -- 172.21.15.80:0/1984665120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c84009470 con 0x7f6c90105b00 2022-09-07T19:42:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.208+0000 7f6c8ffff700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 0x7f6c90195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.209+0000 7f6c9519c700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c9019cea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800ebf0 tx=0x7f6c8800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.209+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880099c0 con 0x7f6c90105b00 2022-09-07T19:42:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.209+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c0093b0 con 0x7f6c90105b00 2022-09-07T19:42:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.209+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6c8800cc90 con 0x7f6c90105b00 2022-09-07T19:42:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.209+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88010430 con 0x7f6c90105b00 2022-09-07T19:42:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.209+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9019ddb0 con 0x7f6c90105b00 2022-09-07T19:42:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.210+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9010b540 con 0x7f6c90105b00 2022-09-07T19:42:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.212+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f6c8801e020 con 0x7f6c90105b00 2022-09-07T19:42:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.213+0000 7f6c8dffb700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c80099010 0x7f6c8009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.213+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f6c88014070 con 0x7f6c90105b00 2022-09-07T19:42:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.214+0000 7f6c9499b700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c80099010 0x7f6c8009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.214+0000 7f6c9499b700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c80099010 0x7f6c8009b4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009440 tx=0x7f6c84005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.217+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f6c8808efe0 con 0x7f6c90105b00 2022-09-07T19:42:34.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.409+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c9005fae0 con 0x7f6c90105b00 2022-09-07T19:42:34.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.410+0000 7f6c8dffb700 1 -- 172.21.15.80:0/1984665120 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7f6c88092600 con 0x7f6c90105b00 2022-09-07T19:42:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:34.410 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:34.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c80099010 msgr2=0x7f6c8009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c80099010 0x7f6c8009b4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009440 tx=0x7f6c84005f60 comp rx=0 tx=0).stop 2022-09-07T19:42:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 msgr2=0x7f6c9019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c9019cea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800ebf0 tx=0x7f6c8800ef00 comp rx=0 tx=0).stop 2022-09-07T19:42:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 shutdown_connections 2022-09-07T19:42:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90105b00 0x7f6c9019cea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6c80099010 0x7f6c8009b4c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c90071630 0x7f6c901958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 --2- 172.21.15.80:0/1984665120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c90072b70 0x7f6c90195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 >> 172.21.15.80:0/1984665120 conn(0x7f6c900f9260 msgr2=0x7f6c900fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 shutdown_connections 2022-09-07T19:42:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.413+0000 7f6c9599d700 1 -- 172.21.15.80:0/1984665120 wait complete. 2022-09-07T19:42:34.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-09-07T19:42:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 -- 172.21.15.80:0/4126823640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210100df0 msgr2=0x7f2210103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 --2- 172.21.15.80:0/4126823640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210100df0 0x7f2210103250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2204009810 tx=0x7f2204009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 -- 172.21.15.80:0/4126823640 shutdown_connections 2022-09-07T19:42:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 --2- 172.21.15.80:0/4126823640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22101038e0 0x7f2210105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 --2- 172.21.15.80:0/4126823640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2210066bf0 0x7f22101008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 --2- 172.21.15.80:0/4126823640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210100df0 0x7f2210103250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 -- 172.21.15.80:0/4126823640 >> 172.21.15.80:0/4126823640 conn(0x7f22100f82e0 msgr2=0x7f22100fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 -- 172.21.15.80:0/4126823640 shutdown_connections 2022-09-07T19:42:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.672+0000 7f22161ff700 1 -- 172.21.15.80:0/4126823640 wait complete. 2022-09-07T19:42:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.673+0000 7f22161ff700 1 Processor -- start 2022-09-07T19:42:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.673+0000 7f22161ff700 1 -- start start 2022-09-07T19:42:34.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f22161ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 0x7f2210195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f22161ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2210100df0 0x7f2210196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f22161ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22101038e0 0x7f221019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f22161ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221019d6c0 con 0x7f2210066bf0 2022-09-07T19:42:34.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f22161ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221019d830 con 0x7f22101038e0 2022-09-07T19:42:34.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f22161ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221019d9f0 con 0x7f2210100df0 2022-09-07T19:42:34.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 0x7f2210195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 0x7f2210195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44324/0 (socket says 172.21.15.80:44324) 2022-09-07T19:42:34.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 -- 172.21.15.80:0/3667675448 learned_addr learned my addr 172.21.15.80:0/3667675448 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:34.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220effd700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2210100df0 0x7f2210196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220ffff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22101038e0 0x7f221019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 -- 172.21.15.80:0/3667675448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2210100df0 msgr2=0x7f2210196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2210100df0 0x7f2210196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 -- 172.21.15.80:0/3667675448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22101038e0 msgr2=0x7f221019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:34.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22101038e0 0x7f221019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:34.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.674+0000 7f220f7fe700 1 -- 172.21.15.80:0/3667675448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204009470 con 0x7f2210066bf0 2022-09-07T19:42:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.675+0000 7f220f7fe700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 0x7f2210195b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f220000e6e0 tx=0x7f220000e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.675+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200009500 con 0x7f2210066bf0 2022-09-07T19:42:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.675+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f2200010da0 con 0x7f2210066bf0 2022-09-07T19:42:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.675+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221019dcd0 con 0x7f2210066bf0 2022-09-07T19:42:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.675+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000173d0 con 0x7f2210066bf0 2022-09-07T19:42:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.675+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221019e180 con 0x7f2210066bf0 2022-09-07T19:42:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.676+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2210109560 con 0x7f2210066bf0 2022-09-07T19:42:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.678+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f220000c040 con 0x7f2210066bf0 2022-09-07T19:42:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.679+0000 7f220cff9700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f21f8099090 0x7f21f809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.679+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f2200014070 con 0x7f2210066bf0 2022-09-07T19:42:34.687 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.680+0000 7f220effd700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f21f8099090 0x7f21f809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:34.687 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.680+0000 7f220effd700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f21f8099090 0x7f21f809b540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f220400b4f0 tx=0x7f2204009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:34.687 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.683+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f220004fc80 con 0x7f2210066bf0 2022-09-07T19:42:34.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:34 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3128293369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:34.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:34 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1984665120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:34 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3128293369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:34 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1984665120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:34.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:34.921+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f221019e880 con 0x7f2210066bf0 2022-09-07T19:42:34.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:34 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3128293369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:34.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:34 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1984665120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:35.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.475+0000 7f220cff9700 1 -- 172.21.15.80:0/3667675448 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f220008eb30 con 0x7f2210066bf0 2022-09-07T19:42:35.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f21f8099090 msgr2=0x7f21f809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:35.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f21f8099090 0x7f21f809b540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f220400b4f0 tx=0x7f2204009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 msgr2=0x7f2210195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:35.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 0x7f2210195b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f220000e6e0 tx=0x7f220000e9f0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 shutdown_connections 2022-09-07T19:42:35.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2210066bf0 0x7f2210195b40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f21f8099090 0x7f21f809b540 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22101038e0 0x7f221019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 --2- 172.21.15.80:0/3667675448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2210100df0 0x7f2210196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 >> 172.21.15.80:0/3667675448 conn(0x7f22100f82e0 msgr2=0x7f22100fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:35.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 shutdown_connections 2022-09-07T19:42:35.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.478+0000 7f22161ff700 1 -- 172.21.15.80:0/3667675448 wait complete. 2022-09-07T19:42:35.507 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2022-09-07T19:42:35.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2022-09-07T19:42:35.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 -- 172.21.15.80:0/2438942118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 msgr2=0x7f95c00ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:35.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2438942118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c00ff3d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009810 tx=0x7f95b4009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:35.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 -- 172.21.15.80:0/2438942118 shutdown_connections 2022-09-07T19:42:35.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2438942118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c00ff910 0x7f95c01061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2438942118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 0x7f95c00fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2438942118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c00ff3d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 -- 172.21.15.80:0/2438942118 >> 172.21.15.80:0/2438942118 conn(0x7f95c00f93f0 msgr2=0x7f95c00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:35.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 -- 172.21.15.80:0/2438942118 shutdown_connections 2022-09-07T19:42:35.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.739+0000 7f95c55ff700 1 -- 172.21.15.80:0/2438942118 wait complete. 2022-09-07T19:42:35.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.740+0000 7f95c55ff700 1 Processor -- start 2022-09-07T19:42:35.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.740+0000 7f95c55ff700 1 -- start start 2022-09-07T19:42:35.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95c55ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 0x7f95c0195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95c55ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c0196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95c55ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c00ff910 0x7f95c019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95c55ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c019d6c0 con 0x7f95c00fef80 2022-09-07T19:42:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95c55ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c019d830 con 0x7f95c00ff910 2022-09-07T19:42:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95c55ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c019d9f0 con 0x7f95c00fdd00 2022-09-07T19:42:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95be7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c0196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95be7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c0196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44328/0 (socket says 172.21.15.80:44328) 2022-09-07T19:42:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95be7fc700 1 -- 172.21.15.80:0/2905104750 learned_addr learned my addr 172.21.15.80:0/2905104750 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95beffd700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 0x7f95c0195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.741+0000 7f95bf7fe700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c00ff910 0x7f95c019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95be7fc700 1 -- 172.21.15.80:0/2905104750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 msgr2=0x7f95c0195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95be7fc700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 0x7f95c0195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95be7fc700 1 -- 172.21.15.80:0/2905104750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c00ff910 msgr2=0x7f95c019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95be7fc700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c00ff910 0x7f95c019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95be7fc700 1 -- 172.21.15.80:0/2905104750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009730 con 0x7f95c00fef80 2022-09-07T19:42:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95beffd700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 0x7f95c0195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95be7fc700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c0196080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f95b40059c0 tx=0x7f95b400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b401d070 con 0x7f95c00fef80 2022-09-07T19:42:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f95b400f880 con 0x7f95c00fef80 2022-09-07T19:42:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b4009470 con 0x7f95c00fef80 2022-09-07T19:42:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.742+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40047d0 con 0x7f95c00fef80 2022-09-07T19:42:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.743+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c019dfe0 con 0x7f95c00fef80 2022-09-07T19:42:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.744+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c01094b0 con 0x7f95c00fef80 2022-09-07T19:42:35.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.745+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f95b4028030 con 0x7f95c00fef80 2022-09-07T19:42:35.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.746+0000 7f95a7fff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f95a8099090 0x7f95a809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:35.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.747+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f95b40c31a0 con 0x7f95c00fef80 2022-09-07T19:42:35.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.747+0000 7f95beffd700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f95a8099090 0x7f95a809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:35.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.747+0000 7f95beffd700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f95a8099090 0x7f95a809b540 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95c00fede0 tx=0x7f95b0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:35.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.750+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f95b408f640 con 0x7f95c00fef80 2022-09-07T19:42:35.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:35 smithi080 ceph-mon[90124]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:35.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:35 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3667675448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2022-09-07T19:42:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:35 smithi154 ceph-mon[96967]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:35 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3667675448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2022-09-07T19:42:35.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:35 smithi155 ceph-mon[97606]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:35.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:35 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3667675448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2022-09-07T19:42:35.987 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:35.988+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f95c019eae0 con 0x7f95c00fef80 2022-09-07T19:42:36.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.489+0000 7f95a7fff700 1 -- 172.21.15.80:0/2905104750 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f95b4092c60 con 0x7f95c00fef80 2022-09-07T19:42:36.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f95a8099090 msgr2=0x7f95a809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:36.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f95a8099090 0x7f95a809b540 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95c00fede0 tx=0x7f95b0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 msgr2=0x7f95c0196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:36.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c0196080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f95b40059c0 tx=0x7f95b400f690 comp rx=0 tx=0).stop 2022-09-07T19:42:36.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 shutdown_connections 2022-09-07T19:42:36.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f95a8099090 0x7f95a809b540 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c00ff910 0x7f95c019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdd00 0x7f95c0195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 --2- 172.21.15.80:0/2905104750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c00fef80 0x7f95c0196080 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 >> 172.21.15.80:0/2905104750 conn(0x7f95c00f93f0 msgr2=0x7f95c00fb710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:36.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 shutdown_connections 2022-09-07T19:42:36.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.493+0000 7f95c55ff700 1 -- 172.21.15.80:0/2905104750 wait complete. 2022-09-07T19:42:36.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2022-09-07T19:42:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 -- 172.21.15.80:0/3665222388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280fdb40 msgr2=0x7f2f280fdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/3665222388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280fdb40 0x7f2f280fdf50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009810 tx=0x7f2f24009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 -- 172.21.15.80:0/3665222388 shutdown_connections 2022-09-07T19:42:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/3665222388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280ff510 0x7f2f281060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/3665222388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280fdb40 0x7f2f280fdf50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/3665222388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f280fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 -- 172.21.15.80:0/3665222388 >> 172.21.15.80:0/3665222388 conn(0x7f2f280f9230 msgr2=0x7f2f280fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:36.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 -- 172.21.15.80:0/3665222388 shutdown_connections 2022-09-07T19:42:36.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.761+0000 7f2f2e59d700 1 -- 172.21.15.80:0/3665222388 wait complete. 2022-09-07T19:42:36.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.762+0000 7f2f2e59d700 1 Processor -- start 2022-09-07T19:42:36.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.762+0000 7f2f2e59d700 1 -- start start 2022-09-07T19:42:36.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2e59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fdb40 0x7f2f28193760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:36.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2e59d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f28193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:36.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2e59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280ff510 0x7f2f2819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:36.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2e59d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2819b2e0 con 0x7f2f280fe490 2022-09-07T19:42:36.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2e59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2819b450 con 0x7f2f280ff510 2022-09-07T19:42:36.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2e59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2819b610 con 0x7f2f280fdb40 2022-09-07T19:42:36.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2cd9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f28193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:36.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2d59b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fdb40 0x7f2f28193760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:36.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2cd9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f28193ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44344/0 (socket says 172.21.15.80:44344) 2022-09-07T19:42:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2cd9a700 1 -- 172.21.15.80:0/240414733 learned_addr learned my addr 172.21.15.80:0/240414733 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.763+0000 7f2f2dd9c700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280ff510 0x7f2f2819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2cd9a700 1 -- 172.21.15.80:0/240414733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fdb40 msgr2=0x7f2f28193760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2cd9a700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fdb40 0x7f2f28193760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2cd9a700 1 -- 172.21.15.80:0/240414733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280ff510 msgr2=0x7f2f2819ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2cd9a700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280ff510 0x7f2f2819ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2cd9a700 1 -- 172.21.15.80:0/240414733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180093b0 con 0x7f2f280fe490 2022-09-07T19:42:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2d59b700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fdb40 0x7f2f28193760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2cd9a700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f28193ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009fd0 tx=0x7f2f1800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180097b0 con 0x7f2f280fe490 2022-09-07T19:42:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f2f18004220 con 0x7f2f280fe490 2022-09-07T19:42:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18003cd0 con 0x7f2f280fe490 2022-09-07T19:42:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f24009470 con 0x7f2f280fe490 2022-09-07T19:42:36.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.764+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2819bc20 con 0x7f2f280fe490 2022-09-07T19:42:36.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.765+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f28109330 con 0x7f2f280fe490 2022-09-07T19:42:36.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.767+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f2f1801e020 con 0x7f2f280fe490 2022-09-07T19:42:36.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.768+0000 7f2f1e7fc700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2f14099010 0x7f2f1409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.768+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f2f18014070 con 0x7f2f280fe490 2022-09-07T19:42:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.769+0000 7f2f2d59b700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2f14099010 0x7f2f1409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.770+0000 7f2f2d59b700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2f14099010 0x7f2f1409b4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400b4f0 tx=0x7f2f24009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:36.773+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f2f1808ee50 con 0x7f2f280fe490 2022-09-07T19:42:36.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:36 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3667675448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2022-09-07T19:42:36.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:36 smithi080 ceph-mon[90124]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:36.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:36 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2905104750' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2022-09-07T19:42:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:36 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3667675448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2022-09-07T19:42:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:36 smithi154 ceph-mon[96967]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:36 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2905104750' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2022-09-07T19:42:36.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:36 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3667675448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2022-09-07T19:42:36.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:36 smithi155 ceph-mon[97606]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:36.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:36 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2905104750' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2022-09-07T19:42:37.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.011+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f2f2805f120 con 0x7f2f280fe490 2022-09-07T19:42:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.496+0000 7f2f1e7fc700 1 -- 172.21.15.80:0/240414733 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2f18092470 con 0x7f2f280fe490 2022-09-07T19:42:37.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2f14099010 msgr2=0x7f2f1409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:37.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2f14099010 0x7f2f1409b4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400b4f0 tx=0x7f2f24009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 msgr2=0x7f2f28193ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:37.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f28193ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009fd0 tx=0x7f2f1800eca0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 shutdown_connections 2022-09-07T19:42:37.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2f14099010 0x7f2f1409b4c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f280ff510 0x7f2f2819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fdb40 0x7f2f28193760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 --2- 172.21.15.80:0/240414733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f280fe490 0x7f2f28193ca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 >> 172.21.15.80:0/240414733 conn(0x7f2f280f9230 msgr2=0x7f2f280fb500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:37.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 shutdown_connections 2022-09-07T19:42:37.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.501+0000 7f2f2e59d700 1 -- 172.21.15.80:0/240414733 wait complete. 2022-09-07T19:42:37.532 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-09-07T19:42:37.764 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 -- 172.21.15.80:0/2310050019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 msgr2=0x7f09ec0ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:37.764 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 --2- 172.21.15.80:0/2310050019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 0x7f09ec0ff3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009810 tx=0x7f09dc009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:37.764 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 -- 172.21.15.80:0/2310050019 shutdown_connections 2022-09-07T19:42:37.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 --2- 172.21.15.80:0/2310050019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec0fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 --2- 172.21.15.80:0/2310050019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09ec0ff910 0x7f09ec1061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 --2- 172.21.15.80:0/2310050019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 0x7f09ec0ff3d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.764+0000 7f09f41ff700 1 -- 172.21.15.80:0/2310050019 >> 172.21.15.80:0/2310050019 conn(0x7f09ec0f93f0 msgr2=0x7f09ec0fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:37.766 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.765+0000 7f09f41ff700 1 -- 172.21.15.80:0/2310050019 shutdown_connections 2022-09-07T19:42:37.766 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.765+0000 7f09f41ff700 1 -- 172.21.15.80:0/2310050019 wait complete. 2022-09-07T19:42:37.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 Processor -- start 2022-09-07T19:42:37.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 -- start start 2022-09-07T19:42:37.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:37.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 0x7f09ec1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:37.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09ec0ff910 0x7f09ec19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:37.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec19d6e0 con 0x7f09ec0fdd00 2022-09-07T19:42:37.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec19d850 con 0x7f09ec0ff910 2022-09-07T19:42:37.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.766+0000 7f09f41ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec19da10 con 0x7f09ec0fef80 2022-09-07T19:42:37.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:37.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44356/0 (socket says 172.21.15.80:44356) 2022-09-07T19:42:37.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 -- 172.21.15.80:0/3396200479 learned_addr learned my addr 172.21.15.80:0/3396200479 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:37.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f279c700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09ec0ff910 0x7f09ec19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:37.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f179a700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 0x7f09ec1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:37.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 -- 172.21.15.80:0/3396200479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 msgr2=0x7f09ec1960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:37.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 0x7f09ec1960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 -- 172.21.15.80:0/3396200479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09ec0ff910 msgr2=0x7f09ec19d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:37.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09ec0ff910 0x7f09ec19d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:37.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 -- 172.21.15.80:0/3396200479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009470 con 0x7f09ec0fdd00 2022-09-07T19:42:37.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.767+0000 7f09f1f9b700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec195b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e710 tx=0x7f09e800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:37.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.768+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8004220 con 0x7f09ec0fdd00 2022-09-07T19:42:37.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.768+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec19dcf0 con 0x7f09ec0fdd00 2022-09-07T19:42:37.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.768+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f09e8004380 con 0x7f09ec0fdd00 2022-09-07T19:42:37.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.768+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8003cf0 con 0x7f09ec0fdd00 2022-09-07T19:42:37.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.768+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec19e1a0 con 0x7f09ec0fdd00 2022-09-07T19:42:37.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.769+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec109520 con 0x7f09ec0fdd00 2022-09-07T19:42:37.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.771+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f09e801e020 con 0x7f09ec0fdd00 2022-09-07T19:42:37.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.772+0000 7f09e2ffd700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f09d8099090 0x7f09d809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:37.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.772+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f09e8014070 con 0x7f09ec0fdd00 2022-09-07T19:42:37.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.772+0000 7f09f179a700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f09d8099090 0x7f09d809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:37.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.773+0000 7f09f179a700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f09d8099090 0x7f09d809b540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00b4f0 tx=0x7f09dc009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:37.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:37.776+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f09e808ebd0 con 0x7f09ec0fdd00 2022-09-07T19:42:37.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:37.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-09-07T19:42:37.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2905104750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2022-09-07T19:42:37.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2022-09-07T19:42:37.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:37.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2022-09-07T19:42:37.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: daemon mds.a is now active in filesystem cephfs as rank 1 2022-09-07T19:42:37.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:37 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/240414733' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-09-07T19:42:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-09-07T19:42:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2905104750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2022-09-07T19:42:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2022-09-07T19:42:37.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:37.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2022-09-07T19:42:37.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: daemon mds.a is now active in filesystem cephfs as rank 1 2022-09-07T19:42:37.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:37 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/240414733' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-09-07T19:42:37.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2022-09-07T19:42:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-09-07T19:42:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2905104750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2022-09-07T19:42:37.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2022-09-07T19:42:37.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2022-09-07T19:42:37.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2022-09-07T19:42:37.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: daemon mds.a is now active in filesystem cephfs as rank 1 2022-09-07T19:42:37.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:37 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/240414733' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-09-07T19:42:38.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.013+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f09ec1900c0 con 0x7f09ec0fdd00 2022-09-07T19:42:38.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.506+0000 7f09e2ffd700 1 -- 172.21.15.80:0/3396200479 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f09e80921f0 con 0x7f09ec0fdd00 2022-09-07T19:42:38.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f09d8099090 msgr2=0x7f09d809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:38.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f09d8099090 0x7f09d809b540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00b4f0 tx=0x7f09dc009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 msgr2=0x7f09ec195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:38.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec195b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e710 tx=0x7f09e800ea20 comp rx=0 tx=0).stop 2022-09-07T19:42:38.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 shutdown_connections 2022-09-07T19:42:38.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09ec0fdd00 0x7f09ec195b60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f09d8099090 0x7f09d809b540 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09ec0ff910 0x7f09ec19d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 --2- 172.21.15.80:0/3396200479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09ec0fef80 0x7f09ec1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.508+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 >> 172.21.15.80:0/3396200479 conn(0x7f09ec0f93f0 msgr2=0x7f09ec104960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:38.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.509+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 shutdown_connections 2022-09-07T19:42:38.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.509+0000 7f09f41ff700 1 -- 172.21.15.80:0/3396200479 wait complete. 2022-09-07T19:42:38.536 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2022-09-07T19:42:38.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2022-09-07T19:42:38.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.769+0000 7f5743fff700 1 -- 172.21.15.80:0/931722490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 msgr2=0x7f57440fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:38.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.769+0000 7f5743fff700 1 --2- 172.21.15.80:0/931722490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 0x7f57440fee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5738009810 tx=0x7f5738009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:38.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.769+0000 7f5743fff700 1 -- 172.21.15.80:0/931722490 shutdown_connections 2022-09-07T19:42:38.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.769+0000 7f5743fff700 1 --2- 172.21.15.80:0/931722490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57440ff510 0x7f57441060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.770+0000 7f5743fff700 1 --2- 172.21.15.80:0/931722490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f57440fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.770+0000 7f5743fff700 1 --2- 172.21.15.80:0/931722490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 0x7f57440fee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.770+0000 7f5743fff700 1 -- 172.21.15.80:0/931722490 >> 172.21.15.80:0/931722490 conn(0x7f57440f9230 msgr2=0x7f57440fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:38.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.770+0000 7f5743fff700 1 -- 172.21.15.80:0/931722490 shutdown_connections 2022-09-07T19:42:38.772 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.770+0000 7f5743fff700 1 -- 172.21.15.80:0/931722490 wait complete. 2022-09-07T19:42:38.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.771+0000 7f5743fff700 1 Processor -- start 2022-09-07T19:42:38.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 -- start start 2022-09-07T19:42:38.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f5744193740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:38.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 0x7f5744193c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:38.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57440ff510 0x7f574419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:38.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574419b2c0 con 0x7f57440ff510 2022-09-07T19:42:38.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574419b430 con 0x7f57440fdb40 2022-09-07T19:42:38.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5743fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574419b5f0 con 0x7f57440fe490 2022-09-07T19:42:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.772+0000 7f5742ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f5744193740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f5744193740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:59136/0 (socket says 172.21.15.80:59136) 2022-09-07T19:42:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f57427fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 0x7f5744193c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 -- 172.21.15.80:0/1544420194 learned_addr learned my addr 172.21.15.80:0/1544420194 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f57437fe700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57440ff510 0x7f574419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 -- 172.21.15.80:0/1544420194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 msgr2=0x7f5744193c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 0x7f5744193c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 -- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57440ff510 msgr2=0x7f574419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57440ff510 0x7f574419acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 -- 172.21.15.80:0/1544420194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340093b0 con 0x7f57440fdb40 2022-09-07T19:42:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.773+0000 7f5742ffd700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f5744193740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f573400e9c0 tx=0x7f573400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.774+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340097b0 con 0x7f57440fdb40 2022-09-07T19:42:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.774+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5738009470 con 0x7f57440fdb40 2022-09-07T19:42:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.774+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574419bca0 con 0x7f57440fdb40 2022-09-07T19:42:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.774+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f573400ce70 con 0x7f57440fdb40 2022-09-07T19:42:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.774+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734003c60 con 0x7f57440fdb40 2022-09-07T19:42:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.775+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57240051a0 con 0x7f57440fdb40 2022-09-07T19:42:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.777+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f573401e020 con 0x7f57440fdb40 2022-09-07T19:42:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.778+0000 7f572bfff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f572c099090 0x7f572c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.778+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f5734014070 con 0x7f57440fdb40 2022-09-07T19:42:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.779+0000 7f57427fc700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f572c099090 0x7f572c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.779+0000 7f57427fc700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f572c099090 0x7f572c09b540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f573800b4f0 tx=0x7f5738009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:38.780+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f573408ee90 con 0x7f57440fdb40 2022-09-07T19:42:38.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] up:active 2022-09-07T19:42:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/240414733' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-09-07T19:42:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2022-09-07T19:42:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-09-07T19:42:38.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: Cluster is now healthy 2022-09-07T19:42:38.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2022-09-07T19:42:38.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2022-09-07T19:42:38.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: daemon mds.h is now active in filesystem cephfs as rank 2 2022-09-07T19:42:38.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:38 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3396200479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2022-09-07T19:42:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] up:active 2022-09-07T19:42:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/240414733' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-09-07T19:42:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2022-09-07T19:42:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-09-07T19:42:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: Cluster is now healthy 2022-09-07T19:42:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2022-09-07T19:42:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2022-09-07T19:42:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: daemon mds.h is now active in filesystem cephfs as rank 2 2022-09-07T19:42:38.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:38 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3396200479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2022-09-07T19:42:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] up:active 2022-09-07T19:42:38.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/240414733' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-09-07T19:42:38.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2022-09-07T19:42:38.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-09-07T19:42:38.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: Cluster is now healthy 2022-09-07T19:42:38.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2022-09-07T19:42:38.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2022-09-07T19:42:38.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: daemon mds.h is now active in filesystem cephfs as rank 2 2022-09-07T19:42:38.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:38 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3396200479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2022-09-07T19:42:39.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.012+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f5724000bf0 con 0x7f572c099090 2022-09-07T19:42:39.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.064+0000 7f572bfff700 1 -- 172.21.15.80:0/1544420194 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5724000bf0 con 0x7f572c099090 2022-09-07T19:42:39.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f572c099090 msgr2=0x7f572c09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f572c099090 0x7f572c09b540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f573800b4f0 tx=0x7f5738009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 msgr2=0x7f5744193740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f5744193740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f573400e9c0 tx=0x7f573400ecd0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 shutdown_connections 2022-09-07T19:42:39.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57440ff510 0x7f574419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f572c099090 0x7f572c09b540 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57440fdb40 0x7f5744193740 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.068 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 --2- 172.21.15.80:0/1544420194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57440fe490 0x7f5744193c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.069 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 >> 172.21.15.80:0/1544420194 conn(0x7f57440f9230 msgr2=0x7f57440fb540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:39.069 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 shutdown_connections 2022-09-07T19:42:39.070 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.067+0000 7f5743fff700 1 -- 172.21.15.80:0/1544420194 wait complete. 2022-09-07T19:42:39.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2022-09-07T19:42:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 -- 172.21.15.80:0/2349247735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300ff910 msgr2=0x7f90301061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 --2- 172.21.15.80:0/2349247735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300ff910 0x7f90301061d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9028009bb0 tx=0x7f9028009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 -- 172.21.15.80:0/2349247735 shutdown_connections 2022-09-07T19:42:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 --2- 172.21.15.80:0/2349247735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300ff910 0x7f90301061d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 --2- 172.21.15.80:0/2349247735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300fdd00 0x7f90300fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 --2- 172.21.15.80:0/2349247735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fef80 0x7f90300ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 -- 172.21.15.80:0/2349247735 >> 172.21.15.80:0/2349247735 conn(0x7f90300f93f0 msgr2=0x7f90300fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 -- 172.21.15.80:0/2349247735 shutdown_connections 2022-09-07T19:42:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.325+0000 7f90373ff700 1 -- 172.21.15.80:0/2349247735 wait complete. 2022-09-07T19:42:39.329 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.326+0000 7f90373ff700 1 Processor -- start 2022-09-07T19:42:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 -- start start 2022-09-07T19:42:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 0x7f9030072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300fef80 0x7f90300710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300ff910 0x7f9030071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030071e10 con 0x7f90300fef80 2022-09-07T19:42:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030071f80 con 0x7f90300ff910 2022-09-07T19:42:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f90373ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903019da30 con 0x7f90300fdd00 2022-09-07T19:42:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f903519b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 0x7f9030072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f903499a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300fef80 0x7f90300710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f903519b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 0x7f9030072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:38266/0 (socket says 172.21.15.80:38266) 2022-09-07T19:42:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f903519b700 1 -- 172.21.15.80:0/353419582 learned_addr learned my addr 172.21.15.80:0/353419582 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.327+0000 7f903599c700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300ff910 0x7f9030071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903519b700 1 -- 172.21.15.80:0/353419582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300ff910 msgr2=0x7f9030071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903519b700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300ff910 0x7f9030071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903519b700 1 -- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300fef80 msgr2=0x7f90300710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903519b700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300fef80 0x7f90300710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903519b700 1 -- 172.21.15.80:0/353419582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280097e0 con 0x7f90300fdd00 2022-09-07T19:42:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903599c700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300ff910 0x7f9030071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:42:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f903519b700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 0x7f9030072a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f902c00d700 tx=0x7f902c00da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00f890 con 0x7f90300fdd00 2022-09-07T19:42:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903019dd10 con 0x7f90300fdd00 2022-09-07T19:42:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f902c00fe90 con 0x7f90300fdd00 2022-09-07T19:42:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.328+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00e610 con 0x7f90300fdd00 2022-09-07T19:42:39.336 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.329+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903019e190 con 0x7f90300fdd00 2022-09-07T19:42:39.336 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.330+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9030109530 con 0x7f90300fdd00 2022-09-07T19:42:39.337 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.332+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f902c019030 con 0x7f90300fdd00 2022-09-07T19:42:39.337 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.333+0000 7f90267fc700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f901c099010 0x7f901c09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.333+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f902c0c1a50 con 0x7f90300fdd00 2022-09-07T19:42:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.334+0000 7f903499a700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f901c099010 0x7f901c09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.334+0000 7f903499a700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f901c099010 0x7f901c09b4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9020005fd0 tx=0x7f9020005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.336+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f902c08def0 con 0x7f90300fdd00 2022-09-07T19:42:39.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:42:39.019+0000 7f6c197b2700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:42:39.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:42:39.019+0000 7f6c197b2700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:42:39.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:42:39.019+0000 7f6c197b2700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:42:39.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:42:39.019+0000 7f6c197b2700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:42:39.369 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:42:39.019+0000 7f6c197b2700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:42:39.561 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.562+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f903005fc40 con 0x7f901c099010 2022-09-07T19:42:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.567+0000 7f90267fc700 1 -- 172.21.15.80:0/353419582 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f903005fc40 con 0x7f901c099010 2022-09-07T19:42:39.566 INFO:teuthology.orchestra.run.smithi080.stdout:/volumes/_nogroup/sv_0/cbac0f34-9a7e-44fd-8db2-8e5bb71abf14 2022-09-07T19:42:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f901c099010 msgr2=0x7f901c09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f901c099010 0x7f901c09b4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9020005fd0 tx=0x7f9020005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 msgr2=0x7f9030072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 0x7f9030072a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f902c00d700 tx=0x7f902c00da10 comp rx=0 tx=0).stop 2022-09-07T19:42:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 shutdown_connections 2022-09-07T19:42:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f901c099010 0x7f901c09b4c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90300ff910 0x7f9030071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90300fdd00 0x7f9030072a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 --2- 172.21.15.80:0/353419582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90300fef80 0x7f90300710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 >> 172.21.15.80:0/353419582 conn(0x7f90300f93f0 msgr2=0x7f9030102560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:39.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 shutdown_connections 2022-09-07T19:42:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.569+0000 7f90373ff700 1 -- 172.21.15.80:0/353419582 wait complete. 2022-09-07T19:42:39.596 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2022-09-07T19:42:39.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 -- 172.21.15.80:0/4091769647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fdd00 msgr2=0x7f04fc0fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 --2- 172.21.15.80:0/4091769647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fdd00 0x7f04fc0fe110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009810 tx=0x7f04f8009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:39.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 -- 172.21.15.80:0/4091769647 shutdown_connections 2022-09-07T19:42:39.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 --2- 172.21.15.80:0/4091769647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc1061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 --2- 172.21.15.80:0/4091769647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fdd00 0x7f04fc0fe110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 --2- 172.21.15.80:0/4091769647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04fc0fef80 0x7f04fc0ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.829 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 -- 172.21.15.80:0/4091769647 >> 172.21.15.80:0/4091769647 conn(0x7f04fc0f93f0 msgr2=0x7f04fc0fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:39.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 -- 172.21.15.80:0/4091769647 shutdown_connections 2022-09-07T19:42:39.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.828+0000 7f05045ff700 1 -- 172.21.15.80:0/4091769647 wait complete. 2022-09-07T19:42:39.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.829+0000 7f05045ff700 1 Processor -- start 2022-09-07T19:42:39.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.829+0000 7f05045ff700 1 -- start start 2022-09-07T19:42:39.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f05045ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04fc0fdd00 0x7f04fc195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f05045ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fef80 0x7f04fc1960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f05045ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc19d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f05045ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc19d700 con 0x7f04fc0ff910 2022-09-07T19:42:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f05045ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc19d870 con 0x7f04fc0fef80 2022-09-07T19:42:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f05045ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc19da30 con 0x7f04fc0fdd00 2022-09-07T19:42:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f0502b9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc19d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f0502b9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc19d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44438/0 (socket says 172.21.15.80:44438) 2022-09-07T19:42:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f0502b9c700 1 -- 172.21.15.80:0/863349646 learned_addr learned my addr 172.21.15.80:0/863349646 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f0501b9a700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fef80 0x7f04fc1960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.830+0000 7f050239b700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04fc0fdd00 0x7f04fc195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f0502b9c700 1 -- 172.21.15.80:0/863349646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04fc0fdd00 msgr2=0x7f04fc195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f0502b9c700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04fc0fdd00 0x7f04fc195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f0502b9c700 1 -- 172.21.15.80:0/863349646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fef80 msgr2=0x7f04fc1960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f0502b9c700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fef80 0x7f04fc1960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f0502b9c700 1 -- 172.21.15.80:0/863349646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8009470 con 0x7f04fc0ff910 2022-09-07T19:42:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f0502b9c700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc19d130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04f400eaf0 tx=0x7f04f400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4009960 con 0x7f04fc0ff910 2022-09-07T19:42:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc19dd10 con 0x7f04fc0ff910 2022-09-07T19:42:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f04f400ce70 con 0x7f04fc0ff910 2022-09-07T19:42:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40058b0 con 0x7f04fc0ff910 2022-09-07T19:42:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.831+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc19e1d0 con 0x7f04fc0ff910 2022-09-07T19:42:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.832+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc1094b0 con 0x7f04fc0ff910 2022-09-07T19:42:39.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.834+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f04f401e020 con 0x7f04fc0ff910 2022-09-07T19:42:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.835+0000 7f04f37fe700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f04e8099090 0x7f04e809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.836+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f04f4014070 con 0x7f04fc0ff910 2022-09-07T19:42:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.836+0000 7f050239b700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f04e8099090 0x7f04e809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.836+0000 7f050239b700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f04e8099090 0x7f04e809b540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b4f0 tx=0x7f04f8009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:39.839+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f04f408ef40 con 0x7f04fc0ff910 2022-09-07T19:42:39.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-mon[90124]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:39.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-mon[90124]: mds.? [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] up:active 2022-09-07T19:42:39.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3396200479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2022-09-07T19:42:39.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-mon[90124]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2022-09-07T19:42:39.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:39 smithi080 ceph-mon[90124]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2022-09-07T19:42:39.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:39 smithi154 ceph-mon[96967]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:39.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:39 smithi154 ceph-mon[96967]: mds.? [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] up:active 2022-09-07T19:42:39.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:39 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3396200479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2022-09-07T19:42:39.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:39 smithi154 ceph-mon[96967]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2022-09-07T19:42:39.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:39 smithi154 ceph-mon[96967]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2022-09-07T19:42:39.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:39 smithi155 ceph-mon[97606]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2022-09-07T19:42:39.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:39 smithi155 ceph-mon[97606]: mds.? [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] up:active 2022-09-07T19:42:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:39 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3396200479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2022-09-07T19:42:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:39 smithi155 ceph-mon[97606]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2022-09-07T19:42:39.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:39 smithi155 ceph-mon[97606]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2022-09-07T19:42:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.066+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f04fc105a60 con 0x7f04e8099090 2022-09-07T19:42:40.090 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.091+0000 7f04f37fe700 1 -- 172.21.15.80:0/863349646 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f04fc105a60 con 0x7f04e8099090 2022-09-07T19:42:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.093+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f04e8099090 msgr2=0x7f04e809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.093+0000 7f05045ff700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f04e8099090 0x7f04e809b540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b4f0 tx=0x7f04f8009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.093+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 msgr2=0x7f04fc19d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.093+0000 7f05045ff700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc19d130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04f400eaf0 tx=0x7f04f400ee00 comp rx=0 tx=0).stop 2022-09-07T19:42:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 shutdown_connections 2022-09-07T19:42:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04fc0ff910 0x7f04fc19d130 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f04e8099090 0x7f04e809b540 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04fc0fdd00 0x7f04fc195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 --2- 172.21.15.80:0/863349646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc0fef80 0x7f04fc1960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 >> 172.21.15.80:0/863349646 conn(0x7f04fc0f93f0 msgr2=0x7f04fc0fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 shutdown_connections 2022-09-07T19:42:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.094+0000 7f05045ff700 1 -- 172.21.15.80:0/863349646 wait complete. 2022-09-07T19:42:40.119 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2022-09-07T19:42:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 -- 172.21.15.80:0/4147700380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc071740 msgr2=0x7fefcc071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 --2- 172.21.15.80:0/4147700380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc071740 0x7fefcc071bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009810 tx=0x7fefc0009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:40.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 -- 172.21.15.80:0/4147700380 shutdown_connections 2022-09-07T19:42:40.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 --2- 172.21.15.80:0/4147700380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc105bc0 0x7fefcc108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.351 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 --2- 172.21.15.80:0/4147700380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 0x7fefcc071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 --2- 172.21.15.80:0/4147700380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc071740 0x7fefcc071bb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.350+0000 7fefd13ff700 1 -- 172.21.15.80:0/4147700380 >> 172.21.15.80:0/4147700380 conn(0x7fefcc0f93f0 msgr2=0x7fefcc0fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:40.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.351+0000 7fefd13ff700 1 -- 172.21.15.80:0/4147700380 shutdown_connections 2022-09-07T19:42:40.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.351+0000 7fefd13ff700 1 -- 172.21.15.80:0/4147700380 wait complete. 2022-09-07T19:42:40.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 Processor -- start 2022-09-07T19:42:40.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 -- start start 2022-09-07T19:42:40.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc071740 0x7fefcc195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 0x7fefcc196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc105bc0 0x7fefcc19d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc19d740 con 0x7fefcc105bc0 2022-09-07T19:42:40.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc19d8b0 con 0x7fefcc072c90 2022-09-07T19:42:40.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.352+0000 7fefd13ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc19da70 con 0x7fefcc071740 2022-09-07T19:42:40.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefca7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 0x7fefcc196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc071740 0x7fefcc195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefca7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 0x7fefcc196100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:59202/0 (socket says 172.21.15.80:59202) 2022-09-07T19:42:40.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefca7fc700 1 -- 172.21.15.80:0/3670316919 learned_addr learned my addr 172.21.15.80:0/3670316919 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:40.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcb7fe700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc105bc0 0x7fefcc19d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 -- 172.21.15.80:0/3670316919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 msgr2=0x7fefcc196100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 0x7fefcc196100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 -- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc105bc0 msgr2=0x7fefcc19d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc105bc0 0x7fefcc19d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 -- 172.21.15.80:0/3670316919 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4009730 con 0x7fefcc071740 2022-09-07T19:42:40.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.353+0000 7fefcaffd700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc071740 0x7fefcc195bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00e6c0 tx=0x7fefbc00e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:40.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.354+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc010840 con 0x7fefcc071740 2022-09-07T19:42:40.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.354+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc0009470 con 0x7fefcc071740 2022-09-07T19:42:40.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.354+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fefbc010e40 con 0x7fefcc071740 2022-09-07T19:42:40.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.354+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00f420 con 0x7fefcc071740 2022-09-07T19:42:40.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.354+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc19e0d0 con 0x7fefcc071740 2022-09-07T19:42:40.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.355+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc10b700 con 0x7fefcc071740 2022-09-07T19:42:40.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.357+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fefbc00c040 con 0x7fefcc071740 2022-09-07T19:42:40.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.358+0000 7fefb3fff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fefb4099010 0x7fefb409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.359+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fefbc014070 con 0x7fefcc071740 2022-09-07T19:42:40.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.359+0000 7fefca7fc700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fefb4099010 0x7fefb409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.359+0000 7fefca7fc700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fefb4099010 0x7fefb409b4c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fefc000b4f0 tx=0x7fefc0009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:40.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.361+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fefbc08eb30 con 0x7fefcc071740 2022-09-07T19:42:40.524 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.525+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fefbc018670 con 0x7fefcc071740 2022-09-07T19:42:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.592+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fefcc05fb50 con 0x7fefb4099010 2022-09-07T19:42:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.596+0000 7fefb3fff700 1 -- 172.21.15.80:0/3670316919 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fefcc05fb50 con 0x7fefb4099010 2022-09-07T19:42:40.596 INFO:teuthology.orchestra.run.smithi080.stdout:/volumes/_nogroup/sv_1/e1cc8319-35ea-431f-9b58-9e68f9f6d67a 2022-09-07T19:42:40.598 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.598+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fefb4099010 msgr2=0x7fefb409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.599 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.598+0000 7fefd13ff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fefb4099010 0x7fefb409b4c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fefc000b4f0 tx=0x7fefc0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.599 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.598+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc071740 msgr2=0x7fefcc195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.600 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.598+0000 7fefd13ff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc071740 0x7fefcc195bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00e6c0 tx=0x7fefbc00e9d0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.600 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 shutdown_connections 2022-09-07T19:42:40.601 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefcc105bc0 0x7fefcc19d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.601 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fefb4099010 0x7fefb409b4c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc071740 0x7fefcc195bc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 --2- 172.21.15.80:0/3670316919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefcc072c90 0x7fefcc196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 >> 172.21.15.80:0/3670316919 conn(0x7fefcc0f93f0 msgr2=0x7fefcc0fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 shutdown_connections 2022-09-07T19:42:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.599+0000 7fefd13ff700 1 -- 172.21.15.80:0/3670316919 wait complete. 2022-09-07T19:42:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:40 smithi154 ceph-mon[96967]: from='client.24815 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:40.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:40 smithi154 ceph-mon[96967]: from='client.24808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:40.624 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 07 19:42:40 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mds-b[123748]: 2022-09-07T19:42:40.295+0000 7f0656a61700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2022-09-07T19:42:40.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:42:40.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 -- 172.21.15.80:0/2989345169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 msgr2=0x7f01d41015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2989345169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 0x7f01d41015f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009750 tx=0x7f01c8009a60 comp rx=0 tx=0).stop 2022-09-07T19:42:40.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 -- 172.21.15.80:0/2989345169 shutdown_connections 2022-09-07T19:42:40.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2989345169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2989345169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4101b30 0x7f01d41083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2989345169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 0x7f01d41015f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 -- 172.21.15.80:0/2989345169 >> 172.21.15.80:0/2989345169 conn(0x7f01d40fb6b0 msgr2=0x7f01d40fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:40.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 -- 172.21.15.80:0/2989345169 shutdown_connections 2022-09-07T19:42:40.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.857+0000 7f01da9ff700 1 -- 172.21.15.80:0/2989345169 wait complete. 2022-09-07T19:42:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.858+0000 7f01da9ff700 1 Processor -- start 2022-09-07T19:42:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.858+0000 7f01da9ff700 1 -- start start 2022-09-07T19:42:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.858+0000 7f01da9ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01da9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 0x7f01d4196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.864 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01da9ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4101b30 0x7f01d419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.864 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01da9ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d419d660 con 0x7f01d40fff20 2022-09-07T19:42:40.864 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01da9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d419d7d0 con 0x7f01d41011a0 2022-09-07T19:42:40.865 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01da9ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d419d990 con 0x7f01d4101b30 2022-09-07T19:42:40.865 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.865 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44472/0 (socket says 172.21.15.80:44472) 2022-09-07T19:42:40.866 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 -- 172.21.15.80:0/2186906797 learned_addr learned my addr 172.21.15.80:0/2186906797 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:40.866 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d37fe700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 0x7f01d4196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.866 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d8f9c700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4101b30 0x7f01d419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.866 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 -- 172.21.15.80:0/2186906797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4101b30 msgr2=0x7f01d419d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.867 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4101b30 0x7f01d419d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.867 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 -- 172.21.15.80:0/2186906797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 msgr2=0x7f01d4196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:40.867 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 0x7f01d4196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:40.867 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.859+0000 7f01d3fff700 1 -- 172.21.15.80:0/2186906797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009730 con 0x7f01d40fff20 2022-09-07T19:42:40.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.860+0000 7f01d3fff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4195ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e710 tx=0x7f01c400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:40.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.860+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4004220 con 0x7f01d40fff20 2022-09-07T19:42:40.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.860+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c80093b0 con 0x7f01d40fff20 2022-09-07T19:42:40.868 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.860+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f01c4004380 con 0x7f01d40fff20 2022-09-07T19:42:40.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.860+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4003c80 con 0x7f01d40fff20 2022-09-07T19:42:40.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.860+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d419dff0 con 0x7f01d40fff20 2022-09-07T19:42:40.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.861+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d410b6d0 con 0x7f01d40fff20 2022-09-07T19:42:40.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.863+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f01c401e020 con 0x7f01d40fff20 2022-09-07T19:42:40.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.864+0000 7f01d17fa700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01bc099050 0x7f01bc09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:40.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.864+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7f01c4014070 con 0x7f01d40fff20 2022-09-07T19:42:40.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.865+0000 7f01d37fe700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01bc099050 0x7f01bc09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:40.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.865+0000 7f01d37fe700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01bc099050 0x7f01bc09b500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01c800f500 tx=0x7f01c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:40.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:40.868+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f01c408ebf0 con 0x7f01d40fff20 2022-09-07T19:42:40.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:40 smithi080 ceph-mon[90124]: from='client.24815 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:40.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:40 smithi080 ceph-mon[90124]: from='client.24808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:40.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:40 smithi155 ceph-mon[97606]: from='client.24815 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:40.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:40 smithi155 ceph-mon[97606]: from='client.24808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.105+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01d419dc70 con 0x7f01d40fff20 2022-09-07T19:42:41.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.106+0000 7f01d17fa700 1 -- 172.21.15.80:0/2186906797 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10733 (secure 0 0 0) 0x7f01d419dc70 con 0x7f01d40fff20 2022-09-07T19:42:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:41.106 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-07T19:42:06.917499+0000","modified":"2022-09-07T19:42:38.506873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24575,"mds_1":24569,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24500":{"gid":24500,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24569":{"gid":24569,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-07T19:42:41.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.108+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01bc099050 msgr2=0x7f01bc09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.108+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01bc099050 0x7f01bc09b500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01c800f500 tx=0x7f01c8005f90 comp rx=0 tx=0).stop 2022-09-07T19:42:41.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.108+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 msgr2=0x7f01d4195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.108+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4195ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e710 tx=0x7f01c400ea20 comp rx=0 tx=0).stop 2022-09-07T19:42:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 shutdown_connections 2022-09-07T19:42:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01d40fff20 0x7f01d4195ae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f01bc099050 0x7f01bc09b500 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4101b30 0x7f01d419d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 --2- 172.21.15.80:0/2186906797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d41011a0 0x7f01d4196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 >> 172.21.15.80:0/2186906797 conn(0x7f01d40fb6b0 msgr2=0x7f01d40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 shutdown_connections 2022-09-07T19:42:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.109+0000 7f01da9ff700 1 -- 172.21.15.80:0/2186906797 wait complete. 2022-09-07T19:42:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2022-09-07T19:42:41.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:42:41.362 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 -- 172.21.15.80:0/1199908264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c1038c0 msgr2=0x7fc99c105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/1199908264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c1038c0 0x7fc99c105d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc994009bb0 tx=0x7fc994009ec0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 -- 172.21.15.80:0/1199908264 shutdown_connections 2022-09-07T19:42:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/1199908264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c1038c0 0x7fc99c105d40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/1199908264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc99c066bf0 0x7fc99c100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/1199908264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 0x7fc99c103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 -- 172.21.15.80:0/1199908264 >> 172.21.15.80:0/1199908264 conn(0x7fc99c0f82a0 msgr2=0x7fc99c0fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 -- 172.21.15.80:0/1199908264 shutdown_connections 2022-09-07T19:42:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.363+0000 7fc9a2dff700 1 -- 172.21.15.80:0/1199908264 wait complete. 2022-09-07T19:42:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 Processor -- start 2022-09-07T19:42:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 -- start start 2022-09-07T19:42:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 0x7fc99c0fe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 0x7fc99c0fc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc99c1038c0 0x7fc99c0fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0fd570 con 0x7fc99c100dd0 2022-09-07T19:42:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.364+0000 7fc9a2dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0fd6e0 con 0x7fc99c066bf0 2022-09-07T19:42:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc9a2dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c19d980 con 0x7fc99c1038c0 2022-09-07T19:42:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc99bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 0x7fc99c0fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc9a0b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 0x7fc99c0fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc9a0b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 0x7fc99c0fe1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:59220/0 (socket says 172.21.15.80:59220) 2022-09-07T19:42:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc9a0b9b700 1 -- 172.21.15.80:0/241687360 learned_addr learned my addr 172.21.15.80:0/241687360 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc9a139c700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc99c1038c0 0x7fc99c0fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc99bfff700 1 -- 172.21.15.80:0/241687360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc99c1038c0 msgr2=0x7fc99c0fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc99bfff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc99c1038c0 0x7fc99c0fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc99bfff700 1 -- 172.21.15.80:0/241687360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 msgr2=0x7fc99c0fe1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc99bfff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 0x7fc99c0fe1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc99bfff700 1 -- 172.21.15.80:0/241687360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9880093b0 con 0x7fc99c100dd0 2022-09-07T19:42:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.365+0000 7fc9a0b9b700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 0x7fc99c0fe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.366+0000 7fc99bfff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 0x7fc99c0fc830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc98800e9c0 tx=0x7fc98800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.366+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988004220 con 0x7fc99c100dd0 2022-09-07T19:42:41.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.366+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fc988004380 con 0x7fc99c100dd0 2022-09-07T19:42:41.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.366+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9940097e0 con 0x7fc99c100dd0 2022-09-07T19:42:41.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.366+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988003cf0 con 0x7fc99c100dd0 2022-09-07T19:42:41.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.366+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c19dfe0 con 0x7fc99c100dd0 2022-09-07T19:42:41.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.367+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c109480 con 0x7fc99c100dd0 2022-09-07T19:42:41.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.369+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fc98801e020 con 0x7fc99c100dd0 2022-09-07T19:42:41.378 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.370+0000 7fc999ffb700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc98c099050 0x7fc98c09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.370+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fc988014070 con 0x7fc99c100dd0 2022-09-07T19:42:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.370+0000 7fc9a0b9b700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc98c099050 0x7fc98c09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.371+0000 7fc9a0b9b700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc98c099050 0x7fc98c09b500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc990005ad0 tx=0x7fc990005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.374+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fc98808eeb0 con 0x7fc99c100dd0 2022-09-07T19:42:41.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.570+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc99c19db40 con 0x7fc99c100dd0 2022-09-07T19:42:41.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.571+0000 7fc999ffb700 1 -- 172.21.15.80:0/241687360 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23189 (secure 0 0 0) 0x7fc9880924d0 con 0x7fc99c100dd0 2022-09-07T19:42:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:41.571 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:11.922331+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc98c099050 msgr2=0x7fc98c09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc98c099050 0x7fc98c09b500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc990005ad0 tx=0x7fc990005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 msgr2=0x7fc99c0fc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 0x7fc99c0fc830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc98800e9c0 tx=0x7fc98800ecd0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 shutdown_connections 2022-09-07T19:42:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc98c099050 0x7fc98c09b500 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc99c1038c0 0x7fc99c0fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99c066bf0 0x7fc99c0fe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 --2- 172.21.15.80:0/241687360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc99c100dd0 0x7fc99c0fc830 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.573+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 >> 172.21.15.80:0/241687360 conn(0x7fc99c0f82a0 msgr2=0x7fc99c0ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.574+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 shutdown_connections 2022-09-07T19:42:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.574+0000 7fc9a2dff700 1 -- 172.21.15.80:0/241687360 wait complete. 2022-09-07T19:42:41.600 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-09-07T19:42:41.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-09-07T19:42:41.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 -- 172.21.15.80:0/1710087329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 msgr2=0x7fa8481055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 --2- 172.21.15.80:0/1710087329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481055b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa838009810 tx=0x7fa838009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:41.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 -- 172.21.15.80:0/1710087329 shutdown_connections 2022-09-07T19:42:41.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 --2- 172.21.15.80:0/1710087329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa848105af0 0x7fa848107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 --2- 172.21.15.80:0/1710087329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa848066bf0 0x7fa848102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 --2- 172.21.15.80:0/1710087329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481055b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.827+0000 7fa8507ff700 1 -- 172.21.15.80:0/1710087329 >> 172.21.15.80:0/1710087329 conn(0x7fa8480f82a0 msgr2=0x7fa8480fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:41.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.828+0000 7fa8507ff700 1 -- 172.21.15.80:0/1710087329 shutdown_connections 2022-09-07T19:42:41.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.828+0000 7fa8507ff700 1 -- 172.21.15.80:0/1710087329 wait complete. 2022-09-07T19:42:41.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 Processor -- start 2022-09-07T19:42:41.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 -- start start 2022-09-07T19:42:41.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa848066bf0 0x7fa848195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa848105af0 0x7fa84819d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84819d6f0 con 0x7fa8481031d0 2022-09-07T19:42:41.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84819d860 con 0x7fa848105af0 2022-09-07T19:42:41.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa8507ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84819da20 con 0x7fa848066bf0 2022-09-07T19:42:41.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.829+0000 7fa84dd9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44510/0 (socket says 172.21.15.80:44510) 2022-09-07T19:42:41.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 -- 172.21.15.80:0/3505153482 learned_addr learned my addr 172.21.15.80:0/3505153482 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:41.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84e59b700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa848066bf0 0x7fa848195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84ed9c700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa848105af0 0x7fa84819d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 -- 172.21.15.80:0/3505153482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa848066bf0 msgr2=0x7fa848195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa848066bf0 0x7fa848195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 -- 172.21.15.80:0/3505153482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa848105af0 msgr2=0x7fa84819d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:41.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa848105af0 0x7fa84819d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 -- 172.21.15.80:0/3505153482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838009470 con 0x7fa8481031d0 2022-09-07T19:42:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa84dd9a700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481960b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa8380059c0 tx=0x7fa83800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.830+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83801d070 con 0x7fa8481031d0 2022-09-07T19:42:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.831+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fa83800f880 con 0x7fa8481031d0 2022-09-07T19:42:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.831+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84819dca0 con 0x7fa8481031d0 2022-09-07T19:42:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.831+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380047d0 con 0x7fa8481031d0 2022-09-07T19:42:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.831+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84819e150 con 0x7fa8481031d0 2022-09-07T19:42:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.832+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84810b700 con 0x7fa8481031d0 2022-09-07T19:42:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.833+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fa838028030 con 0x7fa8481031d0 2022-09-07T19:42:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.835+0000 7fa83f7fe700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa834099050 0x7fa83409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.835+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7fa8380c3250 con 0x7fa8481031d0 2022-09-07T19:42:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.835+0000 7fa84e59b700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa834099050 0x7fa83409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.836+0000 7fa84e59b700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa834099050 0x7fa83409b500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa848066fc0 tx=0x7fa844005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:41.838+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa83808f710 con 0x7fa8481031d0 2022-09-07T19:42:41.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:41 smithi080 ceph-mon[90124]: pgmap v318: 129 pgs: 129 active+clean; 604 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2022-09-07T19:42:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:41 smithi080 ceph-mon[90124]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:41 smithi080 ceph-mon[90124]: mgrmap e17: x(active, since 7m), standbys: z, y 2022-09-07T19:42:41.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:41 smithi080 ceph-mon[90124]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:41 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2186906797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:41 smithi154 ceph-mon[96967]: pgmap v318: 129 pgs: 129 active+clean; 604 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2022-09-07T19:42:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:41 smithi154 ceph-mon[96967]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:41 smithi154 ceph-mon[96967]: mgrmap e17: x(active, since 7m), standbys: z, y 2022-09-07T19:42:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:41 smithi154 ceph-mon[96967]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:41 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2186906797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:41.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:41 smithi155 ceph-mon[97606]: pgmap v318: 129 pgs: 129 active+clean; 604 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2022-09-07T19:42:41.989 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:41 smithi155 ceph-mon[97606]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.990 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:41 smithi155 ceph-mon[97606]: mgrmap e17: x(active, since 7m), standbys: z, y 2022-09-07T19:42:41.990 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:41 smithi155 ceph-mon[97606]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:42:41.990 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:41 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2186906797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:42:42.032 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.032+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa84805f120 con 0x7fa834099050 2022-09-07T19:42:42.047 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.048+0000 7fa83f7fe700 1 -- 172.21.15.80:0/3505153482 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+423243 (secure 0 0 0) 0x7fa84805f120 con 0x7fa834099050 2022-09-07T19:42:42.056 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:42.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa834099050 msgr2=0x7fa83409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa834099050 0x7fa83409b500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa848066fc0 tx=0x7fa844005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 msgr2=0x7fa8481960b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481960b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa8380059c0 tx=0x7fa83800f690 comp rx=0 tx=0).stop 2022-09-07T19:42:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 shutdown_connections 2022-09-07T19:42:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa834099050 0x7fa83409b500 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa848105af0 0x7fa84819d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa848066bf0 0x7fa848195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 --2- 172.21.15.80:0/3505153482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8481031d0 0x7fa8481960b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 >> 172.21.15.80:0/3505153482 conn(0x7fa8480f82a0 msgr2=0x7fa848103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 shutdown_connections 2022-09-07T19:42:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.054+0000 7fa8507ff700 1 -- 172.21.15.80:0/3505153482 wait complete. 2022-09-07T19:42:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2022-09-07T19:42:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2022-09-07T19:42:41.935458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619715,"num_objects":54,"num_object_clones":0,"num_object_copies":163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":165,"num_read_kb":166,"num_write":306,"num_write_kb":2999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":247,"ondisk_log_size":247,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79320,"kb_used_data":11640,"kb_used_omap":0,"kb_used_meta":67584,"kb_avail":1124862504,"statfs":{"total":1151940427776,"available":1151859204096,"internally_reserved":0,"allocated":11919360,"data_stored":7522524,"data_compressed":247344,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":69206016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24816,"num_objects":30,"num_object_clones":0,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":29,"num_read_kb":47,"num_write":76,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003608"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385511+0000","last_change":"2022-09-07T19:42:06.951015+0000","last_active":"2022-09-07T19:42:11.385511+0000","last_peered":"2022-09-07T19:42:11.385511+0000","last_clean":"2022-09-07T19:42:11.385511+0000","last_became_active":"2022-09-07T19:42:06.950768+0000","last_became_peered":"2022-09-07T19:42:06.950768+0000","last_unstale":"2022-09-07T19:42:11.385511+0000","last_undegraded":"2022-09-07T19:42:11.385511+0000","last_fullsized":"2022-09-07T19:42:11.385511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:35:45.040811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390979+0000","last_change":"2022-09-07T19:42:06.956370+0000","last_active":"2022-09-07T19:42:11.390979+0000","last_peered":"2022-09-07T19:42:11.390979+0000","last_clean":"2022-09-07T19:42:11.390979+0000","last_became_active":"2022-09-07T19:42:06.955072+0000","last_became_peered":"2022-09-07T19:42:06.955072+0000","last_unstale":"2022-09-07T19:42:11.390979+0000","last_undegraded":"2022-09-07T19:42:11.390979+0000","last_fullsized":"2022-09-07T19:42:11.390979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:01:51.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390716+0000","last_change":"2022-09-07T19:42:06.957647+0000","last_active":"2022-09-07T19:42:11.390716+0000","last_peered":"2022-09-07T19:42:11.390716+0000","last_clean":"2022-09-07T19:42:11.390716+0000","last_became_active":"2022-09-07T19:42:06.956731+0000","last_became_peered":"2022-09-07T19:42:06.956731+0000","last_unstale":"2022-09-07T19:42:11.390716+0000","last_undegraded":"2022-09-07T19:42:11.390716+0000","last_fullsized":"2022-09-07T19:42:11.390716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:13.700278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393361+0000","last_change":"2022-09-07T19:42:06.946811+0000","last_active":"2022-09-07T19:42:11.393361+0000","last_peered":"2022-09-07T19:42:11.393361+0000","last_clean":"2022-09-07T19:42:11.393361+0000","last_became_active":"2022-09-07T19:42:06.946133+0000","last_became_peered":"2022-09-07T19:42:06.946133+0000","last_unstale":"2022-09-07T19:42:11.393361+0000","last_undegraded":"2022-09-07T19:42:11.393361+0000","last_fullsized":"2022-09-07T19:42:11.393361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:17:46.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390177+0000","last_change":"2022-09-07T19:42:06.938599+0000","last_active":"2022-09-07T19:42:11.390177+0000","last_peered":"2022-09-07T19:42:11.390177+0000","last_clean":"2022-09-07T19:42:11.390177+0000","last_became_active":"2022-09-07T19:42:06.938280+0000","last_became_peered":"2022-09-07T19:42:06.938280+0000","last_unstale":"2022-09-07T19:42:11.390177+0000","last_undegraded":"2022-09-07T19:42:11.390177+0000","last_fullsized":"2022-09-07T19:42:11.390177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:41:40.529183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387680+0000","last_change":"2022-09-07T19:42:06.939120+0000","last_active":"2022-09-07T19:42:11.387680+0000","last_peered":"2022-09-07T19:42:11.387680+0000","last_clean":"2022-09-07T19:42:11.387680+0000","last_became_active":"2022-09-07T19:42:06.938805+0000","last_became_peered":"2022-09-07T19:42:06.938805+0000","last_unstale":"2022-09-07T19:42:11.387680+0000","last_undegraded":"2022-09-07T19:42:11.387680+0000","last_fullsized":"2022-09-07T19:42:11.387680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:26:17.772579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394663+0000","last_change":"2022-09-07T19:42:06.935222+0000","last_active":"2022-09-07T19:42:11.394663+0000","last_peered":"2022-09-07T19:42:11.394663+0000","last_clean":"2022-09-07T19:42:11.394663+0000","last_became_active":"2022-09-07T19:42:06.934863+0000","last_became_peered":"2022-09-07T19:42:06.934863+0000","last_unstale":"2022-09-07T19:42:11.394663+0000","last_undegraded":"2022-09-07T19:42:11.394663+0000","last_fullsized":"2022-09-07T19:42:11.394663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:10:12.989147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396711+0000","last_change":"2022-09-07T19:42:06.940593+0000","last_active":"2022-09-07T19:42:11.396711+0000","last_peered":"2022-09-07T19:42:11.396711+0000","last_clean":"2022-09-07T19:42:11.396711+0000","last_became_active":"2022-09-07T19:42:06.940209+0000","last_became_peered":"2022-09-07T19:42:06.940209+0000","last_unstale":"2022-09-07T19:42:11.396711+0000","last_undegraded":"2022-09-07T19:42:11.396711+0000","last_fullsized":"2022-09-07T19:42:11.396711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:45:25.341085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.400890+0000","last_change":"2022-09-07T19:42:06.935215+0000","last_active":"2022-09-07T19:42:11.400890+0000","last_peered":"2022-09-07T19:42:11.400890+0000","last_clean":"2022-09-07T19:42:11.400890+0000","last_became_active":"2022-09-07T19:42:06.934974+0000","last_became_peered":"2022-09-07T19:42:06.934974+0000","last_unstale":"2022-09-07T19:42:11.400890+0000","last_undegraded":"2022-09-07T19:42:11.400890+0000","last_fullsized":"2022-09-07T19:42:11.400890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:01.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.388206+0000","last_change":"2022-09-07T19:42:06.939935+0000","last_active":"2022-09-07T19:42:11.388206+0000","last_peered":"2022-09-07T19:42:11.388206+0000","last_clean":"2022-09-07T19:42:11.388206+0000","last_became_active":"2022-09-07T19:42:06.939160+0000","last_became_peered":"2022-09-07T19:42:06.939160+0000","last_unstale":"2022-09-07T19:42:11.388206+0000","last_undegraded":"2022-09-07T19:42:11.388206+0000","last_fullsized":"2022-09-07T19:42:11.388206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:32.324752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396697+0000","last_change":"2022-09-07T19:42:06.948084+0000","last_active":"2022-09-07T19:42:11.396697+0000","last_peered":"2022-09-07T19:42:11.396697+0000","last_clean":"2022-09-07T19:42:11.396697+0000","last_became_active":"2022-09-07T19:42:06.947552+0000","last_became_peered":"2022-09-07T19:42:06.947552+0000","last_unstale":"2022-09-07T19:42:11.396697+0000","last_undegraded":"2022-09-07T19:42:11.396697+0000","last_fullsized":"2022-09-07T19:42:11.396697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:51:20.247983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393320+0000","last_change":"2022-09-07T19:42:06.947021+0000","last_active":"2022-09-07T19:42:11.393320+0000","last_peered":"2022-09-07T19:42:11.393320+0000","last_clean":"2022-09-07T19:42:11.393320+0000","last_became_active":"2022-09-07T19:42:06.946507+0000","last_became_peered":"2022-09-07T19:42:06.946507+0000","last_unstale":"2022-09-07T19:42:11.393320+0000","last_undegraded":"2022-09-07T19:42:11.393320+0000","last_fullsized":"2022-09-07T19:42:11.393320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:25:15.358991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393713+0000","last_change":"2022-09-07T19:42:06.940573+0000","last_active":"2022-09-07T19:42:11.393713+0000","last_peered":"2022-09-07T19:42:11.393713+0000","last_clean":"2022-09-07T19:42:11.393713+0000","last_became_active":"2022-09-07T19:42:06.940298+0000","last_became_peered":"2022-09-07T19:42:06.940298+0000","last_unstale":"2022-09-07T19:42:11.393713+0000","last_undegraded":"2022-09-07T19:42:11.393713+0000","last_fullsized":"2022-09-07T19:42:11.393713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:41.459964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392730+0000","last_change":"2022-09-07T19:42:06.953348+0000","last_active":"2022-09-07T19:42:11.392730+0000","last_peered":"2022-09-07T19:42:11.392730+0000","last_clean":"2022-09-07T19:42:11.392730+0000","last_became_active":"2022-09-07T19:42:06.952776+0000","last_became_peered":"2022-09-07T19:42:06.952776+0000","last_unstale":"2022-09-07T19:42:11.392730+0000","last_undegraded":"2022-09-07T19:42:11.392730+0000","last_fullsized":"2022-09-07T19:42:11.392730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:58:29.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390619+0000","last_change":"2022-09-07T19:42:06.952737+0000","last_active":"2022-09-07T19:42:11.390619+0000","last_peered":"2022-09-07T19:42:11.390619+0000","last_clean":"2022-09-07T19:42:11.390619+0000","last_became_active":"2022-09-07T19:42:06.950280+0000","last_became_peered":"2022-09-07T19:42:06.950280+0000","last_unstale":"2022-09-07T19:42:11.390619+0000","last_undegraded":"2022-09-07T19:42:11.390619+0000","last_fullsized":"2022-09-07T19:42:11.390619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:08:05.741215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394128+0000","last_change":"2022-09-07T19:42:06.954614+0000","last_active":"2022-09-07T19:42:11.394128+0000","last_peered":"2022-09-07T19:42:11.394128+0000","last_clean":"2022-09-07T19:42:11.394128+0000","last_became_active":"2022-09-07T19:42:06.954312+0000","last_became_peered":"2022-09-07T19:42:06.954312+0000","last_unstale":"2022-09-07T19:42:11.394128+0000","last_undegraded":"2022-09-07T19:42:11.394128+0000","last_fullsized":"2022-09-07T19:42:11.394128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:39:14.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385354+0000","last_change":"2022-09-07T19:42:06.950491+0000","last_active":"2022-09-07T19:42:11.385354+0000","last_peered":"2022-09-07T19:42:11.385354+0000","last_clean":"2022-09-07T19:42:11.385354+0000","last_became_active":"2022-09-07T19:42:06.950164+0000","last_became_peered":"2022-09-07T19:42:06.950164+0000","last_unstale":"2022-09-07T19:42:11.385354+0000","last_undegraded":"2022-09-07T19:42:11.385354+0000","last_fullsized":"2022-09-07T19:42:11.385354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:25.631788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.388547+0000","last_change":"2022-09-07T19:42:06.933766+0000","last_active":"2022-09-07T19:42:11.388547+0000","last_peered":"2022-09-07T19:42:11.388547+0000","last_clean":"2022-09-07T19:42:11.388547+0000","last_became_active":"2022-09-07T19:42:06.933448+0000","last_became_peered":"2022-09-07T19:42:06.933448+0000","last_unstale":"2022-09-07T19:42:11.388547+0000","last_undegraded":"2022-09-07T19:42:11.388547+0000","last_fullsized":"2022-09-07T19:42:11.388547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:10.478403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395066+0000","last_change":"2022-09-07T19:42:06.937141+0000","last_active":"2022-09-07T19:42:11.395066+0000","last_peered":"2022-09-07T19:42:11.395066+0000","last_clean":"2022-09-07T19:42:11.395066+0000","last_became_active":"2022-09-07T19:42:06.936841+0000","last_became_peered":"2022-09-07T19:42:06.936841+0000","last_unstale":"2022-09-07T19:42:11.395066+0000","last_undegraded":"2022-09-07T19:42:11.395066+0000","last_fullsized":"2022-09-07T19:42:11.395066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:57:43.397083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927672+0000","last_change":"2022-09-07T19:42:11.413877+0000","last_active":"2022-09-07T19:42:11.927672+0000","last_peered":"2022-09-07T19:42:11.927672+0000","last_clean":"2022-09-07T19:42:11.927672+0000","last_became_active":"2022-09-07T19:42:11.413419+0000","last_became_peered":"2022-09-07T19:42:11.413419+0000","last_unstale":"2022-09-07T19:42:11.927672+0000","last_undegraded":"2022-09-07T19:42:11.927672+0000","last_fullsized":"2022-09-07T19:42:11.927672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:40:06.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511036+0000","last_change":"2022-09-07T19:42:06.360233+0000","last_active":"2022-09-07T19:42:37.511036+0000","last_peered":"2022-09-07T19:42:37.511036+0000","last_clean":"2022-09-07T19:42:37.511036+0000","last_became_active":"2022-09-07T19:42:06.359937+0000","last_became_peered":"2022-09-07T19:42:06.359937+0000","last_unstale":"2022-09-07T19:42:37.511036+0000","last_undegraded":"2022-09-07T19:42:37.511036+0000","last_fullsized":"2022-09-07T19:42:37.511036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:02.665896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.398633+0000","last_change":"2022-09-07T19:42:06.943068+0000","last_active":"2022-09-07T19:42:11.398633+0000","last_peered":"2022-09-07T19:42:11.398633+0000","last_clean":"2022-09-07T19:42:11.398633+0000","last_became_active":"2022-09-07T19:42:06.942735+0000","last_became_peered":"2022-09-07T19:42:06.942735+0000","last_unstale":"2022-09-07T19:42:11.398633+0000","last_undegraded":"2022-09-07T19:42:11.398633+0000","last_fullsized":"2022-09-07T19:42:11.398633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:20:21.052216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.413185+0000","last_change":"2022-09-07T19:42:11.412836+0000","last_active":"2022-09-07T19:42:11.413185+0000","last_peered":"2022-09-07T19:42:11.413185+0000","last_clean":"2022-09-07T19:42:11.413185+0000","last_became_active":"2022-09-07T19:42:11.412407+0000","last_became_peered":"2022-09-07T19:42:11.412407+0000","last_unstale":"2022-09-07T19:42:11.413185+0000","last_undegraded":"2022-09-07T19:42:11.413185+0000","last_fullsized":"2022-09-07T19:42:11.413185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:40:35.056313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.447116+0000","last_change":"2022-09-07T19:42:06.372498+0000","last_active":"2022-09-07T19:42:12.447116+0000","last_peered":"2022-09-07T19:42:12.447116+0000","last_clean":"2022-09-07T19:42:12.447116+0000","last_became_active":"2022-09-07T19:42:06.372183+0000","last_became_peered":"2022-09-07T19:42:06.372183+0000","last_unstale":"2022-09-07T19:42:12.447116+0000","last_undegraded":"2022-09-07T19:42:12.447116+0000","last_fullsized":"2022-09-07T19:42:12.447116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:00:56.451463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392960+0000","last_change":"2022-09-07T19:42:06.953146+0000","last_active":"2022-09-07T19:42:11.392960+0000","last_peered":"2022-09-07T19:42:11.392960+0000","last_clean":"2022-09-07T19:42:11.392960+0000","last_became_active":"2022-09-07T19:42:06.952824+0000","last_became_peered":"2022-09-07T19:42:06.952824+0000","last_unstale":"2022-09-07T19:42:11.392960+0000","last_undegraded":"2022-09-07T19:42:11.392960+0000","last_fullsized":"2022-09-07T19:42:11.392960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:59:59.989327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.412557+0000","last_change":"2022-09-07T19:42:11.411807+0000","last_active":"2022-09-07T19:42:11.412557+0000","last_peered":"2022-09-07T19:42:11.412557+0000","last_clean":"2022-09-07T19:42:11.412557+0000","last_became_active":"2022-09-07T19:42:11.411392+0000","last_became_peered":"2022-09-07T19:42:11.411392+0000","last_unstale":"2022-09-07T19:42:11.412557+0000","last_undegraded":"2022-09-07T19:42:11.412557+0000","last_fullsized":"2022-09-07T19:42:11.412557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:37:00.477243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390782+0000","last_change":"2022-09-07T19:42:06.359561+0000","last_active":"2022-09-07T19:42:11.390782+0000","last_peered":"2022-09-07T19:42:11.390782+0000","last_clean":"2022-09-07T19:42:11.390782+0000","last_became_active":"2022-09-07T19:42:06.359200+0000","last_became_peered":"2022-09-07T19:42:06.359200+0000","last_unstale":"2022-09-07T19:42:11.390782+0000","last_undegraded":"2022-09-07T19:42:11.390782+0000","last_fullsized":"2022-09-07T19:42:11.390782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:16:13.894233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393817+0000","last_change":"2022-09-07T19:42:06.943682+0000","last_active":"2022-09-07T19:42:11.393817+0000","last_peered":"2022-09-07T19:42:11.393817+0000","last_clean":"2022-09-07T19:42:11.393817+0000","last_became_active":"2022-09-07T19:42:06.943323+0000","last_became_peered":"2022-09-07T19:42:06.943323+0000","last_unstale":"2022-09-07T19:42:11.393817+0000","last_undegraded":"2022-09-07T19:42:11.393817+0000","last_fullsized":"2022-09-07T19:42:11.393817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:00:26.030438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.403785+0000","last_change":"2022-09-07T19:42:11.403222+0000","last_active":"2022-09-07T19:42:11.403785+0000","last_peered":"2022-09-07T19:42:11.403785+0000","last_clean":"2022-09-07T19:42:11.403785+0000","last_became_active":"2022-09-07T19:42:11.402740+0000","last_became_peered":"2022-09-07T19:42:11.402740+0000","last_unstale":"2022-09-07T19:42:11.403785+0000","last_undegraded":"2022-09-07T19:42:11.403785+0000","last_fullsized":"2022-09-07T19:42:11.403785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:55:07.470945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390960+0000","last_change":"2022-09-07T19:42:06.353930+0000","last_active":"2022-09-07T19:42:11.390960+0000","last_peered":"2022-09-07T19:42:11.390960+0000","last_clean":"2022-09-07T19:42:11.390960+0000","last_became_active":"2022-09-07T19:42:06.353603+0000","last_became_peered":"2022-09-07T19:42:06.353603+0000","last_unstale":"2022-09-07T19:42:11.390960+0000","last_undegraded":"2022-09-07T19:42:11.390960+0000","last_fullsized":"2022-09-07T19:42:11.390960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:50.562667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393675+0000","last_change":"2022-09-07T19:42:06.948086+0000","last_active":"2022-09-07T19:42:11.393675+0000","last_peered":"2022-09-07T19:42:11.393675+0000","last_clean":"2022-09-07T19:42:11.393675+0000","last_became_active":"2022-09-07T19:42:06.947805+0000","last_became_peered":"2022-09-07T19:42:06.947805+0000","last_unstale":"2022-09-07T19:42:11.393675+0000","last_undegraded":"2022-09-07T19:42:11.393675+0000","last_fullsized":"2022-09-07T19:42:11.393675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:36:53.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927837+0000","last_change":"2022-09-07T19:42:11.401915+0000","last_active":"2022-09-07T19:42:11.927837+0000","last_peered":"2022-09-07T19:42:11.927837+0000","last_clean":"2022-09-07T19:42:11.927837+0000","last_became_active":"2022-09-07T19:42:11.401513+0000","last_became_peered":"2022-09-07T19:42:11.401513+0000","last_unstale":"2022-09-07T19:42:11.927837+0000","last_undegraded":"2022-09-07T19:42:11.927837+0000","last_fullsized":"2022-09-07T19:42:11.927837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:42:34.774516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:38.522700+0000","last_change":"2022-09-07T19:42:06.361590+0000","last_active":"2022-09-07T19:42:38.522700+0000","last_peered":"2022-09-07T19:42:38.522700+0000","last_clean":"2022-09-07T19:42:38.522700+0000","last_became_active":"2022-09-07T19:42:06.361278+0000","last_became_peered":"2022-09-07T19:42:06.361278+0000","last_unstale":"2022-09-07T19:42:38.522700+0000","last_undegraded":"2022-09-07T19:42:38.522700+0000","last_fullsized":"2022-09-07T19:42:38.522700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:30.487710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.389805+0000","last_change":"2022-09-07T19:42:06.936076+0000","last_active":"2022-09-07T19:42:11.389805+0000","last_peered":"2022-09-07T19:42:11.389805+0000","last_clean":"2022-09-07T19:42:11.389805+0000","last_became_active":"2022-09-07T19:42:06.935747+0000","last_became_peered":"2022-09-07T19:42:06.935747+0000","last_unstale":"2022-09-07T19:42:11.389805+0000","last_undegraded":"2022-09-07T19:42:11.389805+0000","last_fullsized":"2022-09-07T19:42:11.389805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:20:17.729299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927684+0000","last_change":"2022-09-07T19:42:11.414174+0000","last_active":"2022-09-07T19:42:11.927684+0000","last_peered":"2022-09-07T19:42:11.927684+0000","last_clean":"2022-09-07T19:42:11.927684+0000","last_became_active":"2022-09-07T19:42:11.413798+0000","last_became_peered":"2022-09-07T19:42:11.413798+0000","last_unstale":"2022-09-07T19:42:11.927684+0000","last_undegraded":"2022-09-07T19:42:11.927684+0000","last_fullsized":"2022-09-07T19:42:11.927684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:17.386698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.509341+0000","last_change":"2022-09-07T19:42:06.375593+0000","last_active":"2022-09-07T19:42:37.509341+0000","last_peered":"2022-09-07T19:42:37.509341+0000","last_clean":"2022-09-07T19:42:37.509341+0000","last_became_active":"2022-09-07T19:42:06.375396+0000","last_became_peered":"2022-09-07T19:42:06.375396+0000","last_unstale":"2022-09-07T19:42:37.509341+0000","last_undegraded":"2022-09-07T19:42:37.509341+0000","last_fullsized":"2022-09-07T19:42:37.509341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:00:10.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394799+0000","last_change":"2022-09-07T19:42:06.936369+0000","last_active":"2022-09-07T19:42:11.394799+0000","last_peered":"2022-09-07T19:42:11.394799+0000","last_clean":"2022-09-07T19:42:11.394799+0000","last_became_active":"2022-09-07T19:42:06.936083+0000","last_became_peered":"2022-09-07T19:42:06.936083+0000","last_unstale":"2022-09-07T19:42:11.394799+0000","last_undegraded":"2022-09-07T19:42:11.394799+0000","last_fullsized":"2022-09-07T19:42:11.394799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:50:17.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696090+0000","last_change":"2022-09-07T19:42:11.399043+0000","last_active":"2022-09-07T19:42:12.696090+0000","last_peered":"2022-09-07T19:42:12.696090+0000","last_clean":"2022-09-07T19:42:12.696090+0000","last_became_active":"2022-09-07T19:42:11.398634+0000","last_became_peered":"2022-09-07T19:42:11.398634+0000","last_unstale":"2022-09-07T19:42:12.696090+0000","last_undegraded":"2022-09-07T19:42:12.696090+0000","last_fullsized":"2022-09-07T19:42:12.696090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:30:06.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511366+0000","last_change":"2022-09-07T19:42:06.365700+0000","last_active":"2022-09-07T19:42:37.511366+0000","last_peered":"2022-09-07T19:42:37.511366+0000","last_clean":"2022-09-07T19:42:37.511366+0000","last_became_active":"2022-09-07T19:42:06.365338+0000","last_became_peered":"2022-09-07T19:42:06.365338+0000","last_unstale":"2022-09-07T19:42:37.511366+0000","last_undegraded":"2022-09-07T19:42:37.511366+0000","last_fullsized":"2022-09-07T19:42:37.511366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:18.825477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396628+0000","last_change":"2022-09-07T19:42:06.938275+0000","last_active":"2022-09-07T19:42:11.396628+0000","last_peered":"2022-09-07T19:42:11.396628+0000","last_clean":"2022-09-07T19:42:11.396628+0000","last_became_active":"2022-09-07T19:42:06.937893+0000","last_became_peered":"2022-09-07T19:42:06.937893+0000","last_unstale":"2022-09-07T19:42:11.396628+0000","last_undegraded":"2022-09-07T19:42:11.396628+0000","last_fullsized":"2022-09-07T19:42:11.396628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:42:22.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.792009+0000","last_change":"2022-09-07T19:42:11.406329+0000","last_active":"2022-09-07T19:42:12.792009+0000","last_peered":"2022-09-07T19:42:12.792009+0000","last_clean":"2022-09-07T19:42:12.792009+0000","last_became_active":"2022-09-07T19:42:11.405954+0000","last_became_peered":"2022-09-07T19:42:11.405954+0000","last_unstale":"2022-09-07T19:42:12.792009+0000","last_undegraded":"2022-09-07T19:42:12.792009+0000","last_fullsized":"2022-09-07T19:42:12.792009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:15.735179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.695912+0000","last_change":"2022-09-07T19:42:06.360190+0000","last_active":"2022-09-07T19:42:12.695912+0000","last_peered":"2022-09-07T19:42:12.695912+0000","last_clean":"2022-09-07T19:42:12.695912+0000","last_became_active":"2022-09-07T19:42:06.359893+0000","last_became_peered":"2022-09-07T19:42:06.359893+0000","last_unstale":"2022-09-07T19:42:12.695912+0000","last_undegraded":"2022-09-07T19:42:12.695912+0000","last_fullsized":"2022-09-07T19:42:12.695912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:09:54.310816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387585+0000","last_change":"2022-09-07T19:42:06.931094+0000","last_active":"2022-09-07T19:42:11.387585+0000","last_peered":"2022-09-07T19:42:11.387585+0000","last_clean":"2022-09-07T19:42:11.387585+0000","last_became_active":"2022-09-07T19:42:06.930781+0000","last_became_peered":"2022-09-07T19:42:06.930781+0000","last_unstale":"2022-09-07T19:42:11.387585+0000","last_undegraded":"2022-09-07T19:42:11.387585+0000","last_fullsized":"2022-09-07T19:42:11.387585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:31:17.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.446517+0000","last_change":"2022-09-07T19:42:11.402900+0000","last_active":"2022-09-07T19:42:12.446517+0000","last_peered":"2022-09-07T19:42:12.446517+0000","last_clean":"2022-09-07T19:42:12.446517+0000","last_became_active":"2022-09-07T19:42:11.402553+0000","last_became_peered":"2022-09-07T19:42:11.402553+0000","last_unstale":"2022-09-07T19:42:12.446517+0000","last_undegraded":"2022-09-07T19:42:12.446517+0000","last_fullsized":"2022-09-07T19:42:12.446517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:19:01.667064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:38.520959+0000","last_change":"2022-09-07T19:42:06.363330+0000","last_active":"2022-09-07T19:42:38.520959+0000","last_peered":"2022-09-07T19:42:38.520959+0000","last_clean":"2022-09-07T19:42:38.520959+0000","last_became_active":"2022-09-07T19:42:06.363057+0000","last_became_peered":"2022-09-07T19:42:06.363057+0000","last_unstale":"2022-09-07T19:42:38.520959+0000","last_undegraded":"2022-09-07T19:42:38.520959+0000","last_fullsized":"2022-09-07T19:42:38.520959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:36.386640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394590+0000","last_change":"2022-09-07T19:42:06.943678+0000","last_active":"2022-09-07T19:42:11.394590+0000","last_peered":"2022-09-07T19:42:11.394590+0000","last_clean":"2022-09-07T19:42:11.394590+0000","last_became_active":"2022-09-07T19:42:06.942341+0000","last_became_peered":"2022-09-07T19:42:06.942341+0000","last_unstale":"2022-09-07T19:42:11.394590+0000","last_undegraded":"2022-09-07T19:42:11.394590+0000","last_fullsized":"2022-09-07T19:42:11.394590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:30:24.776240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.926877+0000","last_change":"2022-09-07T19:42:11.410225+0000","last_active":"2022-09-07T19:42:11.926877+0000","last_peered":"2022-09-07T19:42:11.926877+0000","last_clean":"2022-09-07T19:42:11.926877+0000","last_became_active":"2022-09-07T19:42:11.409826+0000","last_became_peered":"2022-09-07T19:42:11.409826+0000","last_unstale":"2022-09-07T19:42:11.926877+0000","last_undegraded":"2022-09-07T19:42:11.926877+0000","last_fullsized":"2022-09-07T19:42:11.926877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:01.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.506957+0000","last_change":"2022-09-07T19:42:06.357384+0000","last_active":"2022-09-07T19:42:36.506957+0000","last_peered":"2022-09-07T19:42:36.506957+0000","last_clean":"2022-09-07T19:42:36.506957+0000","last_became_active":"2022-09-07T19:42:06.357042+0000","last_became_peered":"2022-09-07T19:42:06.357042+0000","last_unstale":"2022-09-07T19:42:36.506957+0000","last_undegraded":"2022-09-07T19:42:36.506957+0000","last_fullsized":"2022-09-07T19:42:36.506957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:36:30.278258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393075+0000","last_change":"2022-09-07T19:42:06.952991+0000","last_active":"2022-09-07T19:42:11.393075+0000","last_peered":"2022-09-07T19:42:11.393075+0000","last_clean":"2022-09-07T19:42:11.393075+0000","last_became_active":"2022-09-07T19:42:06.952650+0000","last_became_peered":"2022-09-07T19:42:06.952650+0000","last_unstale":"2022-09-07T19:42:11.393075+0000","last_undegraded":"2022-09-07T19:42:11.393075+0000","last_fullsized":"2022-09-07T19:42:11.393075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:15:44.166803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.412815+0000","last_change":"2022-09-07T19:42:11.412153+0000","last_active":"2022-09-07T19:42:11.412815+0000","last_peered":"2022-09-07T19:42:11.412815+0000","last_clean":"2022-09-07T19:42:11.412815+0000","last_became_active":"2022-09-07T19:42:11.411371+0000","last_became_peered":"2022-09-07T19:42:11.411371+0000","last_unstale":"2022-09-07T19:42:11.412815+0000","last_undegraded":"2022-09-07T19:42:11.412815+0000","last_fullsized":"2022-09-07T19:42:11.412815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:34:31.765609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.507467+0000","last_change":"2022-09-07T19:42:06.356763+0000","last_active":"2022-09-07T19:42:36.507467+0000","last_peered":"2022-09-07T19:42:36.507467+0000","last_clean":"2022-09-07T19:42:36.507467+0000","last_became_active":"2022-09-07T19:42:06.356155+0000","last_became_peered":"2022-09-07T19:42:06.356155+0000","last_unstale":"2022-09-07T19:42:36.507467+0000","last_undegraded":"2022-09-07T19:42:36.507467+0000","last_fullsized":"2022-09-07T19:42:36.507467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:06:07.941810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394366+0000","last_change":"2022-09-07T19:42:06.940746+0000","last_active":"2022-09-07T19:42:11.394366+0000","last_peered":"2022-09-07T19:42:11.394366+0000","last_clean":"2022-09-07T19:42:11.394366+0000","last_became_active":"2022-09-07T19:42:06.939798+0000","last_became_peered":"2022-09-07T19:42:06.939798+0000","last_unstale":"2022-09-07T19:42:11.394366+0000","last_undegraded":"2022-09-07T19:42:11.394366+0000","last_fullsized":"2022-09-07T19:42:11.394366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:02:25.348841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927169+0000","last_change":"2022-09-07T19:42:11.393014+0000","last_active":"2022-09-07T19:42:11.927169+0000","last_peered":"2022-09-07T19:42:11.927169+0000","last_clean":"2022-09-07T19:42:11.927169+0000","last_became_active":"2022-09-07T19:42:11.392465+0000","last_became_peered":"2022-09-07T19:42:11.392465+0000","last_unstale":"2022-09-07T19:42:11.927169+0000","last_undegraded":"2022-09-07T19:42:11.927169+0000","last_fullsized":"2022-09-07T19:42:11.927169+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:52:11.553583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'19","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:39.523611+0000","last_change":"2022-09-07T19:42:06.364454+0000","last_active":"2022-09-07T19:42:39.523611+0000","last_peered":"2022-09-07T19:42:39.523611+0000","last_clean":"2022-09-07T19:42:39.523611+0000","last_became_active":"2022-09-07T19:42:06.364112+0000","last_became_peered":"2022-09-07T19:42:06.364112+0000","last_unstale":"2022-09-07T19:42:39.523611+0000","last_undegraded":"2022-09-07T19:42:39.523611+0000","last_fullsized":"2022-09-07T19:42:39.523611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:04:50.190357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25650,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":29,"num_write":20,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390498+0000","last_change":"2022-09-07T19:42:06.942860+0000","last_active":"2022-09-07T19:42:11.390498+0000","last_peered":"2022-09-07T19:42:11.390498+0000","last_clean":"2022-09-07T19:42:11.390498+0000","last_became_active":"2022-09-07T19:42:06.941587+0000","last_became_peered":"2022-09-07T19:42:06.941587+0000","last_unstale":"2022-09-07T19:42:11.390498+0000","last_undegraded":"2022-09-07T19:42:11.390498+0000","last_fullsized":"2022-09-07T19:42:11.390498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:41:45.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.697047+0000","last_change":"2022-09-07T19:42:11.403579+0000","last_active":"2022-09-07T19:42:12.697047+0000","last_peered":"2022-09-07T19:42:12.697047+0000","last_clean":"2022-09-07T19:42:12.697047+0000","last_became_active":"2022-09-07T19:42:11.402923+0000","last_became_peered":"2022-09-07T19:42:11.402923+0000","last_unstale":"2022-09-07T19:42:12.697047+0000","last_undegraded":"2022-09-07T19:42:12.697047+0000","last_fullsized":"2022-09-07T19:42:12.697047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:39:47.178557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.506883+0000","last_change":"2022-09-07T19:42:06.369220+0000","last_active":"2022-09-07T19:42:36.506883+0000","last_peered":"2022-09-07T19:42:36.506883+0000","last_clean":"2022-09-07T19:42:36.506883+0000","last_became_active":"2022-09-07T19:42:06.368957+0000","last_became_peered":"2022-09-07T19:42:06.368957+0000","last_unstale":"2022-09-07T19:42:36.506883+0000","last_undegraded":"2022-09-07T19:42:36.506883+0000","last_fullsized":"2022-09-07T19:42:36.506883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:13:27.882414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392515+0000","last_change":"2022-09-07T19:42:06.942818+0000","last_active":"2022-09-07T19:42:11.392515+0000","last_peered":"2022-09-07T19:42:11.392515+0000","last_clean":"2022-09-07T19:42:11.392515+0000","last_became_active":"2022-09-07T19:42:06.942536+0000","last_became_peered":"2022-09-07T19:42:06.942536+0000","last_unstale":"2022-09-07T19:42:11.392515+0000","last_undegraded":"2022-09-07T19:42:11.392515+0000","last_fullsized":"2022-09-07T19:42:11.392515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:41:05.892343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.695933+0000","last_change":"2022-09-07T19:42:11.401939+0000","last_active":"2022-09-07T19:42:12.695933+0000","last_peered":"2022-09-07T19:42:12.695933+0000","last_clean":"2022-09-07T19:42:12.695933+0000","last_became_active":"2022-09-07T19:42:11.401423+0000","last_became_peered":"2022-09-07T19:42:11.401423+0000","last_unstale":"2022-09-07T19:42:12.695933+0000","last_undegraded":"2022-09-07T19:42:12.695933+0000","last_fullsized":"2022-09-07T19:42:12.695933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:23:58.588767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508420+0000","last_change":"2022-09-07T19:42:06.372606+0000","last_active":"2022-09-07T19:42:36.508420+0000","last_peered":"2022-09-07T19:42:36.508420+0000","last_clean":"2022-09-07T19:42:36.508420+0000","last_became_active":"2022-09-07T19:42:06.372314+0000","last_became_peered":"2022-09-07T19:42:06.372314+0000","last_unstale":"2022-09-07T19:42:36.508420+0000","last_undegraded":"2022-09-07T19:42:36.508420+0000","last_fullsized":"2022-09-07T19:42:36.508420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:57:29.102343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395305+0000","last_change":"2022-09-07T19:42:06.945336+0000","last_active":"2022-09-07T19:42:11.395305+0000","last_peered":"2022-09-07T19:42:11.395305+0000","last_clean":"2022-09-07T19:42:11.395305+0000","last_became_active":"2022-09-07T19:42:06.945056+0000","last_became_peered":"2022-09-07T19:42:06.945056+0000","last_unstale":"2022-09-07T19:42:11.395305+0000","last_undegraded":"2022-09-07T19:42:11.395305+0000","last_fullsized":"2022-09-07T19:42:11.395305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:24.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927155+0000","last_change":"2022-09-07T19:42:11.404998+0000","last_active":"2022-09-07T19:42:11.927155+0000","last_peered":"2022-09-07T19:42:11.927155+0000","last_clean":"2022-09-07T19:42:11.927155+0000","last_became_active":"2022-09-07T19:42:11.404553+0000","last_became_peered":"2022-09-07T19:42:11.404553+0000","last_unstale":"2022-09-07T19:42:11.927155+0000","last_undegraded":"2022-09-07T19:42:11.927155+0000","last_fullsized":"2022-09-07T19:42:11.927155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:36:55.188346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:39.522231+0000","last_change":"2022-09-07T19:42:06.356368+0000","last_active":"2022-09-07T19:42:39.522231+0000","last_peered":"2022-09-07T19:42:39.522231+0000","last_clean":"2022-09-07T19:42:39.522231+0000","last_became_active":"2022-09-07T19:42:06.356036+0000","last_became_peered":"2022-09-07T19:42:06.356036+0000","last_unstale":"2022-09-07T19:42:39.522231+0000","last_undegraded":"2022-09-07T19:42:39.522231+0000","last_fullsized":"2022-09-07T19:42:39.522231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:37.882450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392284+0000","last_change":"2022-09-07T19:42:06.936825+0000","last_active":"2022-09-07T19:42:11.392284+0000","last_peered":"2022-09-07T19:42:11.392284+0000","last_clean":"2022-09-07T19:42:11.392284+0000","last_became_active":"2022-09-07T19:42:06.936512+0000","last_became_peered":"2022-09-07T19:42:06.936512+0000","last_unstale":"2022-09-07T19:42:11.392284+0000","last_undegraded":"2022-09-07T19:42:11.392284+0000","last_fullsized":"2022-09-07T19:42:11.392284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:35:55.141151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.574134+0000","last_change":"2022-09-07T19:42:11.411115+0000","last_active":"2022-09-07T19:42:11.574134+0000","last_peered":"2022-09-07T19:42:11.574134+0000","last_clean":"2022-09-07T19:42:11.574134+0000","last_became_active":"2022-09-07T19:42:11.410742+0000","last_became_peered":"2022-09-07T19:42:11.410742+0000","last_unstale":"2022-09-07T19:42:11.574134+0000","last_undegraded":"2022-09-07T19:42:11.574134+0000","last_fullsized":"2022-09-07T19:42:11.574134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:11:06.320256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'10","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.507920+0000","last_change":"2022-09-07T19:42:06.363366+0000","last_active":"2022-09-07T19:42:36.507920+0000","last_peered":"2022-09-07T19:42:36.507920+0000","last_clean":"2022-09-07T19:42:36.507920+0000","last_became_active":"2022-09-07T19:42:06.362993+0000","last_became_peered":"2022-09-07T19:42:06.362993+0000","last_unstale":"2022-09-07T19:42:36.507920+0000","last_undegraded":"2022-09-07T19:42:36.507920+0000","last_fullsized":"2022-09-07T19:42:36.507920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:31:15.571050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392779+0000","last_change":"2022-09-07T19:42:06.948273+0000","last_active":"2022-09-07T19:42:11.392779+0000","last_peered":"2022-09-07T19:42:11.392779+0000","last_clean":"2022-09-07T19:42:11.392779+0000","last_became_active":"2022-09-07T19:42:06.947701+0000","last_became_peered":"2022-09-07T19:42:06.947701+0000","last_unstale":"2022-09-07T19:42:11.392779+0000","last_undegraded":"2022-09-07T19:42:11.392779+0000","last_fullsized":"2022-09-07T19:42:11.392779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:01:57.543316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696352+0000","last_change":"2022-09-07T19:42:11.403357+0000","last_active":"2022-09-07T19:42:12.696352+0000","last_peered":"2022-09-07T19:42:12.696352+0000","last_clean":"2022-09-07T19:42:12.696352+0000","last_became_active":"2022-09-07T19:42:11.402903+0000","last_became_peered":"2022-09-07T19:42:11.402903+0000","last_unstale":"2022-09-07T19:42:12.696352+0000","last_undegraded":"2022-09-07T19:42:12.696352+0000","last_fullsized":"2022-09-07T19:42:12.696352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:52:19.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.389996+0000","last_change":"2022-09-07T19:42:06.358259+0000","last_active":"2022-09-07T19:42:11.389996+0000","last_peered":"2022-09-07T19:42:11.389996+0000","last_clean":"2022-09-07T19:42:11.389996+0000","last_became_active":"2022-09-07T19:42:06.357963+0000","last_became_peered":"2022-09-07T19:42:06.357963+0000","last_unstale":"2022-09-07T19:42:11.389996+0000","last_undegraded":"2022-09-07T19:42:11.389996+0000","last_fullsized":"2022-09-07T19:42:11.389996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:53:56.014702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385104+0000","last_change":"2022-09-07T19:42:06.942490+0000","last_active":"2022-09-07T19:42:11.385104+0000","last_peered":"2022-09-07T19:42:11.385104+0000","last_clean":"2022-09-07T19:42:11.385104+0000","last_became_active":"2022-09-07T19:42:06.942192+0000","last_became_peered":"2022-09-07T19:42:06.942192+0000","last_unstale":"2022-09-07T19:42:11.385104+0000","last_undegraded":"2022-09-07T19:42:11.385104+0000","last_fullsized":"2022-09-07T19:42:11.385104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:45:56.895458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.030674+0000","last_change":"2022-09-07T19:42:11.405272+0000","last_active":"2022-09-07T19:42:12.030674+0000","last_peered":"2022-09-07T19:42:12.030674+0000","last_clean":"2022-09-07T19:42:12.030674+0000","last_became_active":"2022-09-07T19:42:11.404883+0000","last_became_peered":"2022-09-07T19:42:11.404883+0000","last_unstale":"2022-09-07T19:42:12.030674+0000","last_undegraded":"2022-09-07T19:42:12.030674+0000","last_fullsized":"2022-09-07T19:42:12.030674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:30:29.469763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.388348+0000","last_change":"2022-09-07T19:42:06.358852+0000","last_active":"2022-09-07T19:42:11.388348+0000","last_peered":"2022-09-07T19:42:11.388348+0000","last_clean":"2022-09-07T19:42:11.388348+0000","last_became_active":"2022-09-07T19:42:06.358465+0000","last_became_peered":"2022-09-07T19:42:06.358465+0000","last_unstale":"2022-09-07T19:42:11.388348+0000","last_undegraded":"2022-09-07T19:42:11.388348+0000","last_fullsized":"2022-09-07T19:42:11.388348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:15:57.255952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387955+0000","last_change":"2022-09-07T19:42:06.941011+0000","last_active":"2022-09-07T19:42:11.387955+0000","last_peered":"2022-09-07T19:42:11.387955+0000","last_clean":"2022-09-07T19:42:11.387955+0000","last_became_active":"2022-09-07T19:42:06.940728+0000","last_became_peered":"2022-09-07T19:42:06.940728+0000","last_unstale":"2022-09-07T19:42:11.387955+0000","last_undegraded":"2022-09-07T19:42:11.387955+0000","last_fullsized":"2022-09-07T19:42:11.387955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:57:52.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.574099+0000","last_change":"2022-09-07T19:42:11.405383+0000","last_active":"2022-09-07T19:42:11.574099+0000","last_peered":"2022-09-07T19:42:11.574099+0000","last_clean":"2022-09-07T19:42:11.574099+0000","last_became_active":"2022-09-07T19:42:11.405021+0000","last_became_peered":"2022-09-07T19:42:11.405021+0000","last_unstale":"2022-09-07T19:42:11.574099+0000","last_undegraded":"2022-09-07T19:42:11.574099+0000","last_fullsized":"2022-09-07T19:42:11.574099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:24:30.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927609+0000","last_change":"2022-09-07T19:42:06.365791+0000","last_active":"2022-09-07T19:42:11.927609+0000","last_peered":"2022-09-07T19:42:11.927609+0000","last_clean":"2022-09-07T19:42:11.927609+0000","last_became_active":"2022-09-07T19:42:06.365471+0000","last_became_peered":"2022-09-07T19:42:06.365471+0000","last_unstale":"2022-09-07T19:42:11.927609+0000","last_undegraded":"2022-09-07T19:42:11.927609+0000","last_fullsized":"2022-09-07T19:42:11.927609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:38:03.735263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387872+0000","last_change":"2022-09-07T19:42:06.951163+0000","last_active":"2022-09-07T19:42:11.387872+0000","last_peered":"2022-09-07T19:42:11.387872+0000","last_clean":"2022-09-07T19:42:11.387872+0000","last_became_active":"2022-09-07T19:42:06.950879+0000","last_became_peered":"2022-09-07T19:42:06.950879+0000","last_unstale":"2022-09-07T19:42:11.387872+0000","last_undegraded":"2022-09-07T19:42:11.387872+0000","last_fullsized":"2022-09-07T19:42:11.387872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:19:17.420880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.574174+0000","last_change":"2022-09-07T19:42:11.402397+0000","last_active":"2022-09-07T19:42:11.574174+0000","last_peered":"2022-09-07T19:42:11.574174+0000","last_clean":"2022-09-07T19:42:11.574174+0000","last_became_active":"2022-09-07T19:42:11.402036+0000","last_became_peered":"2022-09-07T19:42:11.402036+0000","last_unstale":"2022-09-07T19:42:11.574174+0000","last_undegraded":"2022-09-07T19:42:11.574174+0000","last_fullsized":"2022-09-07T19:42:11.574174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:42:53.158561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392161+0000","last_change":"2022-09-07T19:42:06.936405+0000","last_active":"2022-09-07T19:42:11.392161+0000","last_peered":"2022-09-07T19:42:11.392161+0000","last_clean":"2022-09-07T19:42:11.392161+0000","last_became_active":"2022-09-07T19:42:06.936125+0000","last_became_peered":"2022-09-07T19:42:06.936125+0000","last_unstale":"2022-09-07T19:42:11.392161+0000","last_undegraded":"2022-09-07T19:42:11.392161+0000","last_fullsized":"2022-09-07T19:42:11.392161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:47:33.002955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:40.524427+0000","last_change":"2022-09-07T19:42:06.372771+0000","last_active":"2022-09-07T19:42:40.524427+0000","last_peered":"2022-09-07T19:42:40.524427+0000","last_clean":"2022-09-07T19:42:40.524427+0000","last_became_active":"2022-09-07T19:42:06.372498+0000","last_became_peered":"2022-09-07T19:42:06.372498+0000","last_unstale":"2022-09-07T19:42:40.524427+0000","last_undegraded":"2022-09-07T19:42:40.524427+0000","last_fullsized":"2022-09-07T19:42:40.524427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:26:04.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927962+0000","last_change":"2022-09-07T19:42:11.410486+0000","last_active":"2022-09-07T19:42:11.927962+0000","last_peered":"2022-09-07T19:42:11.927962+0000","last_clean":"2022-09-07T19:42:11.927962+0000","last_became_active":"2022-09-07T19:42:11.410195+0000","last_became_peered":"2022-09-07T19:42:11.410195+0000","last_unstale":"2022-09-07T19:42:11.927962+0000","last_undegraded":"2022-09-07T19:42:11.927962+0000","last_fullsized":"2022-09-07T19:42:11.927962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:01:25.927536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.397440+0000","last_change":"2022-09-07T19:42:06.942040+0000","last_active":"2022-09-07T19:42:11.397440+0000","last_peered":"2022-09-07T19:42:11.397440+0000","last_clean":"2022-09-07T19:42:11.397440+0000","last_became_active":"2022-09-07T19:42:06.941732+0000","last_became_peered":"2022-09-07T19:42:06.941732+0000","last_unstale":"2022-09-07T19:42:11.397440+0000","last_undegraded":"2022-09-07T19:42:11.397440+0000","last_fullsized":"2022-09-07T19:42:11.397440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:05:56.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:38.515164+0000","last_change":"2022-09-07T19:42:06.361996+0000","last_active":"2022-09-07T19:42:38.515164+0000","last_peered":"2022-09-07T19:42:38.515164+0000","last_clean":"2022-09-07T19:42:38.515164+0000","last_became_active":"2022-09-07T19:42:06.361658+0000","last_became_peered":"2022-09-07T19:42:06.361658+0000","last_unstale":"2022-09-07T19:42:38.515164+0000","last_undegraded":"2022-09-07T19:42:38.515164+0000","last_fullsized":"2022-09-07T19:42:38.515164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:07:13.180501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":377,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392116+0000","last_change":"2022-09-07T19:40:58.352995+0000","last_active":"2022-09-07T19:42:11.392116+0000","last_peered":"2022-09-07T19:42:11.392116+0000","last_clean":"2022-09-07T19:42:11.392116+0000","last_became_active":"2022-09-07T19:40:58.352548+0000","last_became_peered":"2022-09-07T19:40:58.352548+0000","last_unstale":"2022-09-07T19:42:11.392116+0000","last_undegraded":"2022-09-07T19:42:11.392116+0000","last_fullsized":"2022-09-07T19:42:11.392116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_clean_scrub_stamp":"2022-09-07T19:37:12.654773+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:58:55.796726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696510+0000","last_change":"2022-09-07T19:42:11.404798+0000","last_active":"2022-09-07T19:42:12.696510+0000","last_peered":"2022-09-07T19:42:12.696510+0000","last_clean":"2022-09-07T19:42:12.696510+0000","last_became_active":"2022-09-07T19:42:11.404370+0000","last_became_peered":"2022-09-07T19:42:11.404370+0000","last_unstale":"2022-09-07T19:42:12.696510+0000","last_undegraded":"2022-09-07T19:42:12.696510+0000","last_fullsized":"2022-09-07T19:42:12.696510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:40.619684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392014+0000","last_change":"2022-09-07T19:42:06.943283+0000","last_active":"2022-09-07T19:42:11.392014+0000","last_peered":"2022-09-07T19:42:11.392014+0000","last_clean":"2022-09-07T19:42:11.392014+0000","last_became_active":"2022-09-07T19:42:06.942864+0000","last_became_peered":"2022-09-07T19:42:06.942864+0000","last_unstale":"2022-09-07T19:42:11.392014+0000","last_undegraded":"2022-09-07T19:42:11.392014+0000","last_fullsized":"2022-09-07T19:42:11.392014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:23.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.508311+0000","last_change":"2022-09-07T19:42:06.361341+0000","last_active":"2022-09-07T19:42:37.508311+0000","last_peered":"2022-09-07T19:42:37.508311+0000","last_clean":"2022-09-07T19:42:37.508311+0000","last_became_active":"2022-09-07T19:42:06.361008+0000","last_became_peered":"2022-09-07T19:42:06.361008+0000","last_unstale":"2022-09-07T19:42:37.508311+0000","last_undegraded":"2022-09-07T19:42:37.508311+0000","last_fullsized":"2022-09-07T19:42:37.508311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:08:54.850406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696187+0000","last_change":"2022-09-07T19:42:11.401991+0000","last_active":"2022-09-07T19:42:12.696187+0000","last_peered":"2022-09-07T19:42:12.696187+0000","last_clean":"2022-09-07T19:42:12.696187+0000","last_became_active":"2022-09-07T19:42:11.401129+0000","last_became_peered":"2022-09-07T19:42:11.401129+0000","last_unstale":"2022-09-07T19:42:12.696187+0000","last_undegraded":"2022-09-07T19:42:12.696187+0000","last_fullsized":"2022-09-07T19:42:12.696187+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:11:40.780758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.096965+0000","last_change":"2022-09-07T19:42:06.364282+0000","last_active":"2022-09-07T19:42:12.096965+0000","last_peered":"2022-09-07T19:42:12.096965+0000","last_clean":"2022-09-07T19:42:12.096965+0000","last_became_active":"2022-09-07T19:42:06.364004+0000","last_became_peered":"2022-09-07T19:42:06.364004+0000","last_unstale":"2022-09-07T19:42:12.096965+0000","last_undegraded":"2022-09-07T19:42:12.096965+0000","last_fullsized":"2022-09-07T19:42:12.096965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:16.489787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395908+0000","last_change":"2022-09-07T19:42:06.935556+0000","last_active":"2022-09-07T19:42:11.395908+0000","last_peered":"2022-09-07T19:42:11.395908+0000","last_clean":"2022-09-07T19:42:11.395908+0000","last_became_active":"2022-09-07T19:42:06.935277+0000","last_became_peered":"2022-09-07T19:42:06.935277+0000","last_unstale":"2022-09-07T19:42:11.395908+0000","last_undegraded":"2022-09-07T19:42:11.395908+0000","last_fullsized":"2022-09-07T19:42:11.395908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:52:27.506947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.446499+0000","last_change":"2022-09-07T19:42:11.402833+0000","last_active":"2022-09-07T19:42:12.446499+0000","last_peered":"2022-09-07T19:42:12.446499+0000","last_clean":"2022-09-07T19:42:12.446499+0000","last_became_active":"2022-09-07T19:42:11.402478+0000","last_became_peered":"2022-09-07T19:42:11.402478+0000","last_unstale":"2022-09-07T19:42:12.446499+0000","last_undegraded":"2022-09-07T19:42:12.446499+0000","last_fullsized":"2022-09-07T19:42:12.446499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:58:50.474580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511576+0000","last_change":"2022-09-07T19:42:06.369761+0000","last_active":"2022-09-07T19:42:37.511576+0000","last_peered":"2022-09-07T19:42:37.511576+0000","last_clean":"2022-09-07T19:42:37.511576+0000","last_became_active":"2022-09-07T19:42:06.369366+0000","last_became_peered":"2022-09-07T19:42:06.369366+0000","last_unstale":"2022-09-07T19:42:37.511576+0000","last_undegraded":"2022-09-07T19:42:37.511576+0000","last_fullsized":"2022-09-07T19:42:37.511576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:58.993644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.398303+0000","last_change":"2022-09-07T19:42:06.939822+0000","last_active":"2022-09-07T19:42:11.398303+0000","last_peered":"2022-09-07T19:42:11.398303+0000","last_clean":"2022-09-07T19:42:11.398303+0000","last_became_active":"2022-09-07T19:42:06.939515+0000","last_became_peered":"2022-09-07T19:42:06.939515+0000","last_unstale":"2022-09-07T19:42:11.398303+0000","last_undegraded":"2022-09-07T19:42:11.398303+0000","last_fullsized":"2022-09-07T19:42:11.398303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:32:15.696524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927284+0000","last_change":"2022-09-07T19:42:11.401085+0000","last_active":"2022-09-07T19:42:11.927284+0000","last_peered":"2022-09-07T19:42:11.927284+0000","last_clean":"2022-09-07T19:42:11.927284+0000","last_became_active":"2022-09-07T19:42:11.400594+0000","last_became_peered":"2022-09-07T19:42:11.400594+0000","last_unstale":"2022-09-07T19:42:11.927284+0000","last_undegraded":"2022-09-07T19:42:11.927284+0000","last_fullsized":"2022-09-07T19:42:11.927284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:44:52.837616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508875+0000","last_change":"2022-09-07T19:42:06.365721+0000","last_active":"2022-09-07T19:42:36.508875+0000","last_peered":"2022-09-07T19:42:36.508875+0000","last_clean":"2022-09-07T19:42:36.508875+0000","last_became_active":"2022-09-07T19:42:06.365388+0000","last_became_peered":"2022-09-07T19:42:06.365388+0000","last_unstale":"2022-09-07T19:42:36.508875+0000","last_undegraded":"2022-09-07T19:42:36.508875+0000","last_fullsized":"2022-09-07T19:42:36.508875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:51:57.432567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.391059+0000","last_change":"2022-09-07T19:42:06.959467+0000","last_active":"2022-09-07T19:42:11.391059+0000","last_peered":"2022-09-07T19:42:11.391059+0000","last_clean":"2022-09-07T19:42:11.391059+0000","last_became_active":"2022-09-07T19:42:06.959165+0000","last_became_peered":"2022-09-07T19:42:06.959165+0000","last_unstale":"2022-09-07T19:42:11.391059+0000","last_undegraded":"2022-09-07T19:42:11.391059+0000","last_fullsized":"2022-09-07T19:42:11.391059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:45:54.697717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.414611+0000","last_change":"2022-09-07T19:42:11.414077+0000","last_active":"2022-09-07T19:42:11.414611+0000","last_peered":"2022-09-07T19:42:11.414611+0000","last_clean":"2022-09-07T19:42:11.414611+0000","last_became_active":"2022-09-07T19:42:11.413611+0000","last_became_peered":"2022-09-07T19:42:11.413611+0000","last_unstale":"2022-09-07T19:42:11.414611+0000","last_undegraded":"2022-09-07T19:42:11.414611+0000","last_fullsized":"2022-09-07T19:42:11.414611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:28:23.166148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508469+0000","last_change":"2022-09-07T19:42:06.359443+0000","last_active":"2022-09-07T19:42:36.508469+0000","last_peered":"2022-09-07T19:42:36.508469+0000","last_clean":"2022-09-07T19:42:36.508469+0000","last_became_active":"2022-09-07T19:42:06.359095+0000","last_became_peered":"2022-09-07T19:42:06.359095+0000","last_unstale":"2022-09-07T19:42:36.508469+0000","last_undegraded":"2022-09-07T19:42:36.508469+0000","last_fullsized":"2022-09-07T19:42:36.508469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:36:01.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.389445+0000","last_change":"2022-09-07T19:42:06.933410+0000","last_active":"2022-09-07T19:42:11.389445+0000","last_peered":"2022-09-07T19:42:11.389445+0000","last_clean":"2022-09-07T19:42:11.389445+0000","last_became_active":"2022-09-07T19:42:06.933092+0000","last_became_peered":"2022-09-07T19:42:06.933092+0000","last_unstale":"2022-09-07T19:42:11.389445+0000","last_undegraded":"2022-09-07T19:42:11.389445+0000","last_fullsized":"2022-09-07T19:42:11.389445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:39:51.700247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927287+0000","last_change":"2022-09-07T19:42:11.409290+0000","last_active":"2022-09-07T19:42:11.927287+0000","last_peered":"2022-09-07T19:42:11.927287+0000","last_clean":"2022-09-07T19:42:11.927287+0000","last_became_active":"2022-09-07T19:42:11.408883+0000","last_became_peered":"2022-09-07T19:42:11.408883+0000","last_unstale":"2022-09-07T19:42:11.927287+0000","last_undegraded":"2022-09-07T19:42:11.927287+0000","last_fullsized":"2022-09-07T19:42:11.927287+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:51:39.640794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508618+0000","last_change":"2022-09-07T19:42:06.377191+0000","last_active":"2022-09-07T19:42:36.508618+0000","last_peered":"2022-09-07T19:42:36.508618+0000","last_clean":"2022-09-07T19:42:36.508618+0000","last_became_active":"2022-09-07T19:42:06.376437+0000","last_became_peered":"2022-09-07T19:42:06.376437+0000","last_unstale":"2022-09-07T19:42:36.508618+0000","last_undegraded":"2022-09-07T19:42:36.508618+0000","last_fullsized":"2022-09-07T19:42:36.508618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:53:44.874088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.384886+0000","last_change":"2022-09-07T19:42:06.954380+0000","last_active":"2022-09-07T19:42:11.384886+0000","last_peered":"2022-09-07T19:42:11.384886+0000","last_clean":"2022-09-07T19:42:11.384886+0000","last_became_active":"2022-09-07T19:42:06.954206+0000","last_became_peered":"2022-09-07T19:42:06.954206+0000","last_unstale":"2022-09-07T19:42:11.384886+0000","last_undegraded":"2022-09-07T19:42:11.384886+0000","last_fullsized":"2022-09-07T19:42:11.384886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:49:23.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.165560+0000","last_change":"2022-09-07T19:42:11.412101+0000","last_active":"2022-09-07T19:42:12.165560+0000","last_peered":"2022-09-07T19:42:12.165560+0000","last_clean":"2022-09-07T19:42:12.165560+0000","last_became_active":"2022-09-07T19:42:11.411528+0000","last_became_peered":"2022-09-07T19:42:11.411528+0000","last_unstale":"2022-09-07T19:42:12.165560+0000","last_undegraded":"2022-09-07T19:42:12.165560+0000","last_fullsized":"2022-09-07T19:42:12.165560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:51:28.248093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392326+0000","last_change":"2022-09-07T19:42:06.358321+0000","last_active":"2022-09-07T19:42:11.392326+0000","last_peered":"2022-09-07T19:42:11.392326+0000","last_clean":"2022-09-07T19:42:11.392326+0000","last_became_active":"2022-09-07T19:42:06.358016+0000","last_became_peered":"2022-09-07T19:42:06.358016+0000","last_unstale":"2022-09-07T19:42:11.392326+0000","last_undegraded":"2022-09-07T19:42:11.392326+0000","last_fullsized":"2022-09-07T19:42:11.392326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:44:23.140211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.397729+0000","last_change":"2022-09-07T19:42:06.954601+0000","last_active":"2022-09-07T19:42:11.397729+0000","last_peered":"2022-09-07T19:42:11.397729+0000","last_clean":"2022-09-07T19:42:11.397729+0000","last_became_active":"2022-09-07T19:42:06.954220+0000","last_became_peered":"2022-09-07T19:42:06.954220+0000","last_unstale":"2022-09-07T19:42:11.397729+0000","last_undegraded":"2022-09-07T19:42:11.397729+0000","last_fullsized":"2022-09-07T19:42:11.397729+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:21.042536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.407074+0000","last_change":"2022-09-07T19:42:11.406496+0000","last_active":"2022-09-07T19:42:11.407074+0000","last_peered":"2022-09-07T19:42:11.407074+0000","last_clean":"2022-09-07T19:42:11.407074+0000","last_became_active":"2022-09-07T19:42:11.406097+0000","last_became_peered":"2022-09-07T19:42:11.406097+0000","last_unstale":"2022-09-07T19:42:11.407074+0000","last_undegraded":"2022-09-07T19:42:11.407074+0000","last_fullsized":"2022-09-07T19:42:11.407074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:19.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.506932+0000","last_change":"2022-09-07T19:42:06.357410+0000","last_active":"2022-09-07T19:42:36.506932+0000","last_peered":"2022-09-07T19:42:36.506932+0000","last_clean":"2022-09-07T19:42:36.506932+0000","last_became_active":"2022-09-07T19:42:06.357016+0000","last_became_peered":"2022-09-07T19:42:06.357016+0000","last_unstale":"2022-09-07T19:42:36.506932+0000","last_undegraded":"2022-09-07T19:42:36.506932+0000","last_fullsized":"2022-09-07T19:42:36.506932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:10:30.657678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392626+0000","last_change":"2022-09-07T19:42:06.944746+0000","last_active":"2022-09-07T19:42:11.392626+0000","last_peered":"2022-09-07T19:42:11.392626+0000","last_clean":"2022-09-07T19:42:11.392626+0000","last_became_active":"2022-09-07T19:42:06.944324+0000","last_became_peered":"2022-09-07T19:42:06.944324+0000","last_unstale":"2022-09-07T19:42:11.392626+0000","last_undegraded":"2022-09-07T19:42:11.392626+0000","last_fullsized":"2022-09-07T19:42:11.392626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:20:56.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696608+0000","last_change":"2022-09-07T19:42:11.405830+0000","last_active":"2022-09-07T19:42:12.696608+0000","last_peered":"2022-09-07T19:42:12.696608+0000","last_clean":"2022-09-07T19:42:12.696608+0000","last_became_active":"2022-09-07T19:42:11.405375+0000","last_became_peered":"2022-09-07T19:42:11.405375+0000","last_unstale":"2022-09-07T19:42:12.696608+0000","last_undegraded":"2022-09-07T19:42:12.696608+0000","last_fullsized":"2022-09-07T19:42:12.696608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:30:43.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393436+0000","last_change":"2022-09-07T19:42:06.359635+0000","last_active":"2022-09-07T19:42:11.393436+0000","last_peered":"2022-09-07T19:42:11.393436+0000","last_clean":"2022-09-07T19:42:11.393436+0000","last_became_active":"2022-09-07T19:42:06.359349+0000","last_became_peered":"2022-09-07T19:42:06.359349+0000","last_unstale":"2022-09-07T19:42:11.393436+0000","last_undegraded":"2022-09-07T19:42:11.393436+0000","last_fullsized":"2022-09-07T19:42:11.393436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:56.282670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396137+0000","last_change":"2022-09-07T19:42:06.948313+0000","last_active":"2022-09-07T19:42:11.396137+0000","last_peered":"2022-09-07T19:42:11.396137+0000","last_clean":"2022-09-07T19:42:11.396137+0000","last_became_active":"2022-09-07T19:42:06.948008+0000","last_became_peered":"2022-09-07T19:42:06.948008+0000","last_unstale":"2022-09-07T19:42:11.396137+0000","last_undegraded":"2022-09-07T19:42:11.396137+0000","last_fullsized":"2022-09-07T19:42:11.396137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:39:30.575085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.791943+0000","last_change":"2022-09-07T19:42:11.413042+0000","last_active":"2022-09-07T19:42:12.791943+0000","last_peered":"2022-09-07T19:42:12.791943+0000","last_clean":"2022-09-07T19:42:12.791943+0000","last_became_active":"2022-09-07T19:42:11.412658+0000","last_became_peered":"2022-09-07T19:42:11.412658+0000","last_unstale":"2022-09-07T19:42:12.791943+0000","last_undegraded":"2022-09-07T19:42:12.791943+0000","last_fullsized":"2022-09-07T19:42:12.791943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:33:41.892522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696928+0000","last_change":"2022-09-07T19:42:06.376394+0000","last_active":"2022-09-07T19:42:12.696928+0000","last_peered":"2022-09-07T19:42:12.696928+0000","last_clean":"2022-09-07T19:42:12.696928+0000","last_became_active":"2022-09-07T19:42:06.376141+0000","last_became_peered":"2022-09-07T19:42:06.376141+0000","last_unstale":"2022-09-07T19:42:12.696928+0000","last_undegraded":"2022-09-07T19:42:12.696928+0000","last_fullsized":"2022-09-07T19:42:12.696928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:40:00.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395864+0000","last_change":"2022-09-07T19:42:06.937730+0000","last_active":"2022-09-07T19:42:11.395864+0000","last_peered":"2022-09-07T19:42:11.395864+0000","last_clean":"2022-09-07T19:42:11.395864+0000","last_became_active":"2022-09-07T19:42:06.937387+0000","last_became_peered":"2022-09-07T19:42:06.937387+0000","last_unstale":"2022-09-07T19:42:11.395864+0000","last_undegraded":"2022-09-07T19:42:11.395864+0000","last_fullsized":"2022-09-07T19:42:11.395864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:22:04.045843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.695610+0000","last_change":"2022-09-07T19:42:11.403846+0000","last_active":"2022-09-07T19:42:12.695610+0000","last_peered":"2022-09-07T19:42:12.695610+0000","last_clean":"2022-09-07T19:42:12.695610+0000","last_became_active":"2022-09-07T19:42:11.403096+0000","last_became_peered":"2022-09-07T19:42:11.403096+0000","last_unstale":"2022-09-07T19:42:12.695610+0000","last_undegraded":"2022-09-07T19:42:12.695610+0000","last_fullsized":"2022-09-07T19:42:12.695610+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:37:41.081199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393924+0000","last_change":"2022-09-07T19:42:06.378938+0000","last_active":"2022-09-07T19:42:11.393924+0000","last_peered":"2022-09-07T19:42:11.393924+0000","last_clean":"2022-09-07T19:42:11.393924+0000","last_became_active":"2022-09-07T19:42:06.378545+0000","last_became_peered":"2022-09-07T19:42:06.378545+0000","last_unstale":"2022-09-07T19:42:11.393924+0000","last_undegraded":"2022-09-07T19:42:11.393924+0000","last_fullsized":"2022-09-07T19:42:11.393924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:53.904515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395964+0000","last_change":"2022-09-07T19:42:06.936282+0000","last_active":"2022-09-07T19:42:11.395964+0000","last_peered":"2022-09-07T19:42:11.395964+0000","last_clean":"2022-09-07T19:42:11.395964+0000","last_became_active":"2022-09-07T19:42:06.935916+0000","last_became_peered":"2022-09-07T19:42:06.935916+0000","last_unstale":"2022-09-07T19:42:11.395964+0000","last_undegraded":"2022-09-07T19:42:11.395964+0000","last_fullsized":"2022-09-07T19:42:11.395964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:53:06.657196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.384928+0000","last_change":"2022-09-07T19:42:06.938195+0000","last_active":"2022-09-07T19:42:11.384928+0000","last_peered":"2022-09-07T19:42:11.384928+0000","last_clean":"2022-09-07T19:42:11.384928+0000","last_became_active":"2022-09-07T19:42:06.937916+0000","last_became_peered":"2022-09-07T19:42:06.937916+0000","last_unstale":"2022-09-07T19:42:11.384928+0000","last_undegraded":"2022-09-07T19:42:11.384928+0000","last_fullsized":"2022-09-07T19:42:11.384928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:22:43.390552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.397496+0000","last_change":"2022-09-07T19:42:06.940303+0000","last_active":"2022-09-07T19:42:11.397496+0000","last_peered":"2022-09-07T19:42:11.397496+0000","last_clean":"2022-09-07T19:42:11.397496+0000","last_became_active":"2022-09-07T19:42:06.939974+0000","last_became_peered":"2022-09-07T19:42:06.939974+0000","last_unstale":"2022-09-07T19:42:11.397496+0000","last_undegraded":"2022-09-07T19:42:11.397496+0000","last_fullsized":"2022-09-07T19:42:11.397496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:36:37.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392222+0000","last_change":"2022-09-07T19:42:06.948849+0000","last_active":"2022-09-07T19:42:11.392222+0000","last_peered":"2022-09-07T19:42:11.392222+0000","last_clean":"2022-09-07T19:42:11.392222+0000","last_became_active":"2022-09-07T19:42:06.948263+0000","last_became_peered":"2022-09-07T19:42:06.948263+0000","last_unstale":"2022-09-07T19:42:11.392222+0000","last_undegraded":"2022-09-07T19:42:11.392222+0000","last_fullsized":"2022-09-07T19:42:11.392222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:33:26.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392027+0000","last_change":"2022-09-07T19:42:06.957145+0000","last_active":"2022-09-07T19:42:11.392027+0000","last_peered":"2022-09-07T19:42:11.392027+0000","last_clean":"2022-09-07T19:42:11.392027+0000","last_became_active":"2022-09-07T19:42:06.956769+0000","last_became_peered":"2022-09-07T19:42:06.956769+0000","last_unstale":"2022-09-07T19:42:11.392027+0000","last_undegraded":"2022-09-07T19:42:11.392027+0000","last_fullsized":"2022-09-07T19:42:11.392027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:51:09.154847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395998+0000","last_change":"2022-09-07T19:42:06.954543+0000","last_active":"2022-09-07T19:42:11.395998+0000","last_peered":"2022-09-07T19:42:11.395998+0000","last_clean":"2022-09-07T19:42:11.395998+0000","last_became_active":"2022-09-07T19:42:06.954229+0000","last_became_peered":"2022-09-07T19:42:06.954229+0000","last_unstale":"2022-09-07T19:42:11.395998+0000","last_undegraded":"2022-09-07T19:42:11.395998+0000","last_fullsized":"2022-09-07T19:42:11.395998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:55:48.612830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385125+0000","last_change":"2022-09-07T19:42:06.937808+0000","last_active":"2022-09-07T19:42:11.385125+0000","last_peered":"2022-09-07T19:42:11.385125+0000","last_clean":"2022-09-07T19:42:11.385125+0000","last_became_active":"2022-09-07T19:42:06.937452+0000","last_became_peered":"2022-09-07T19:42:06.937452+0000","last_unstale":"2022-09-07T19:42:11.385125+0000","last_undegraded":"2022-09-07T19:42:11.385125+0000","last_fullsized":"2022-09-07T19:42:11.385125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:56:19.296497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396244+0000","last_change":"2022-09-07T19:42:06.939519+0000","last_active":"2022-09-07T19:42:11.396244+0000","last_peered":"2022-09-07T19:42:11.396244+0000","last_clean":"2022-09-07T19:42:11.396244+0000","last_became_active":"2022-09-07T19:42:06.939171+0000","last_became_peered":"2022-09-07T19:42:06.939171+0000","last_unstale":"2022-09-07T19:42:11.396244+0000","last_undegraded":"2022-09-07T19:42:11.396244+0000","last_fullsized":"2022-09-07T19:42:11.396244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:12:30.663072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.398396+0000","last_change":"2022-09-07T19:42:06.939331+0000","last_active":"2022-09-07T19:42:11.398396+0000","last_peered":"2022-09-07T19:42:11.398396+0000","last_clean":"2022-09-07T19:42:11.398396+0000","last_became_active":"2022-09-07T19:42:06.939034+0000","last_became_peered":"2022-09-07T19:42:06.939034+0000","last_unstale":"2022-09-07T19:42:11.398396+0000","last_undegraded":"2022-09-07T19:42:11.398396+0000","last_fullsized":"2022-09-07T19:42:11.398396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:14:24.794753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392377+0000","last_change":"2022-09-07T19:42:06.934403+0000","last_active":"2022-09-07T19:42:11.392377+0000","last_peered":"2022-09-07T19:42:11.392377+0000","last_clean":"2022-09-07T19:42:11.392377+0000","last_became_active":"2022-09-07T19:42:06.934031+0000","last_became_peered":"2022-09-07T19:42:06.934031+0000","last_unstale":"2022-09-07T19:42:11.392377+0000","last_undegraded":"2022-09-07T19:42:11.392377+0000","last_fullsized":"2022-09-07T19:42:11.392377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:44:44.491011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395716+0000","last_change":"2022-09-07T19:42:06.940112+0000","last_active":"2022-09-07T19:42:11.395716+0000","last_peered":"2022-09-07T19:42:11.395716+0000","last_clean":"2022-09-07T19:42:11.395716+0000","last_became_active":"2022-09-07T19:42:06.939734+0000","last_became_peered":"2022-09-07T19:42:06.939734+0000","last_unstale":"2022-09-07T19:42:11.395716+0000","last_undegraded":"2022-09-07T19:42:11.395716+0000","last_fullsized":"2022-09-07T19:42:11.395716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:17:34.201649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394343+0000","last_change":"2022-09-07T19:42:06.945504+0000","last_active":"2022-09-07T19:42:11.394343+0000","last_peered":"2022-09-07T19:42:11.394343+0000","last_clean":"2022-09-07T19:42:11.394343+0000","last_became_active":"2022-09-07T19:42:06.945194+0000","last_became_peered":"2022-09-07T19:42:06.945194+0000","last_unstale":"2022-09-07T19:42:11.394343+0000","last_undegraded":"2022-09-07T19:42:11.394343+0000","last_fullsized":"2022-09-07T19:42:11.394343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:54:10.526721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393627+0000","last_change":"2022-09-07T19:42:06.953952+0000","last_active":"2022-09-07T19:42:11.393627+0000","last_peered":"2022-09-07T19:42:11.393627+0000","last_clean":"2022-09-07T19:42:11.393627+0000","last_became_active":"2022-09-07T19:42:06.953594+0000","last_became_peered":"2022-09-07T19:42:06.953594+0000","last_unstale":"2022-09-07T19:42:11.393627+0000","last_undegraded":"2022-09-07T19:42:11.393627+0000","last_fullsized":"2022-09-07T19:42:11.393627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:52:15.188770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385233+0000","last_change":"2022-09-07T19:42:06.943804+0000","last_active":"2022-09-07T19:42:11.385233+0000","last_peered":"2022-09-07T19:42:11.385233+0000","last_clean":"2022-09-07T19:42:11.385233+0000","last_became_active":"2022-09-07T19:42:06.943499+0000","last_became_peered":"2022-09-07T19:42:06.943499+0000","last_unstale":"2022-09-07T19:42:11.385233+0000","last_undegraded":"2022-09-07T19:42:11.385233+0000","last_fullsized":"2022-09-07T19:42:11.385233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:20.646159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281075,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":29224,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":29,"num_read_kb":47,"num_write":124,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":43935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6076,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739076,"statfs":{"total":95995035648,"available":95988813824,"internally_reserved":0,"allocated":970752,"data_stored":480149,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.505},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.442}]},{"osd":1,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59799999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.68899999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":9,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72199999999999998}]},{"osd":10,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68000000000000005}]}]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6364,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738788,"statfs":{"total":95995035648,"available":95988518912,"internally_reserved":0,"allocated":1069056,"data_stored":1088492,"data_compressed":47426,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69799999999999995}]},{"osd":4,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75800000000000001}]},{"osd":9,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.85999999999999999}]},{"osd":11,"last update":"Wed Sep 7 19:42:20 2022","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.878},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.84199999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6216,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738936,"statfs":{"total":95995035648,"available":95988670464,"internally_reserved":0,"allocated":983040,"data_stored":476289,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69299999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.746}]},{"osd":2,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90700000000000003,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98899999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76800000000000002},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89500000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94099999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.621},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80700000000000005,"15min":0.81499999999999995},"min":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.89200000000000002,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.85399999999999998,"15min":0.876},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94199999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.86299999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.76200000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.753}]},{"osd":7,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.98499999999999999,"5min":1.599,"15min":1.599},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.93899999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.95299999999999996,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.86099999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.98799999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0589999999999999,"5min":1.357,"15min":1.357},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.96499999999999997,"15min":0.98899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.03,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.751}]},{"osd":10,"last update":"Wed Sep 7 19:41:56 2022","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070497,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6336,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738816,"statfs":{"total":95995035648,"available":95988547584,"internally_reserved":0,"allocated":974848,"data_stored":476097,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64000000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.54200000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.496},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56799999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82299999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40600000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61499999999999999,"5min":0.874,"15min":0.874},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55400000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78700000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.996,"5min":1.026,"15min":1.026},"last":0.755}]},{"osd":7,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76300000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72999999999999998}]},{"osd":9,"last update":"Wed Sep 7 19:41:33 2022","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80900000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.79100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6448,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738704,"statfs":{"total":95995035648,"available":95988432896,"internally_reserved":0,"allocated":1024000,"data_stored":1066995,"data_compressed":47426,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:35 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42099999999999999,"15min":0.41099999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53100000000000003,"5min":1.097,"15min":1.097},"last":0.38},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.623,"5min":0.748,"15min":0.748},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.58499999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68899999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.495},{"interface":"front","average":{"1min":0.443,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.752,"15min":1.752},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.78,"15min":1.78},"last":0.72299999999999998}]},{"osd":6,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65600000000000003}]},{"osd":8,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.57999999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.57999999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77700000000000002}]},{"osd":9,"last update":"Wed Sep 7 19:42:34 2022","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68100000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.627}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495662,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6328,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738824,"statfs":{"total":95995035648,"available":95988555776,"internally_reserved":0,"allocated":966656,"data_stored":475577,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.44600000000000001},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70299999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.41399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63200000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.996,"15min":0.996},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97099999999999997,"5min":1.073,"15min":1.073},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0129999999999999,"5min":1.097,"15min":1.097},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.52900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Sep 7 19:42:38 2022","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.626}]},{"osd":8,"last update":"Wed Sep 7 19:42:02 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.754},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.627,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.054,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59599999999999997}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.141,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.032},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84499999999999997}]},{"osd":10,"last update":"Wed Sep 7 19:41:58 2022","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.92300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7232,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737920,"statfs":{"total":95995035648,"available":95987630080,"internally_reserved":0,"allocated":974848,"data_stored":479236,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:58 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55600000000000005,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.877,"5min":1.04,"15min":1.04},"last":0.497}]},{"osd":2,"last update":"Wed Sep 7 19:42:24 2022","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Sep 7 19:41:50 2022","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.65700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.40400000000000003},"min":{"1min":0.26200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Sep 7 19:42:10 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":1.107,"15min":1.107},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85499999999999998,"5min":0.875,"15min":0.875},"last":0.65800000000000003}]},{"osd":8,"last update":"Wed Sep 7 19:41:58 2022","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81299999999999994}]},{"osd":9,"last update":"Wed Sep 7 19:42:31 2022","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.747,"15min":0.749},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.069,"15min":1.069},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94399999999999995,"5min":1.056,"15min":1.056},"last":0.76300000000000001}]},{"osd":10,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.753},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.77200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7232,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737920,"statfs":{"total":95995035648,"available":95987630080,"internally_reserved":0,"allocated":974848,"data_stored":476165,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 7 19:41:59 2022","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.88500000000000001,"5min":1.77,"15min":1.77},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.86899999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:42:21 2022","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82099999999999995,"5min":1.036,"15min":1.036},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82199999999999995,"5min":1.903,"15min":1.903},"last":0.96399999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:40:50 2022","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78900000000000003,"5min":1.841,"15min":1.841},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94099999999999995,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.244,"15min":1.244},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86099999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Sep 7 19:41:38 2022","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1759999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.69299999999999995},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.88800000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:42:07 2022","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.004,"5min":1.337,"15min":1.337},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":1.042,"15min":1.042},"last":0.70999999999999996}]},{"osd":7,"last update":"Wed Sep 7 19:41:38 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.0069999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:41:59 2022","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.92800000000000005}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1299999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.127,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83799999999999997}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.96799999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.98299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7308,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737844,"statfs":{"total":95995035648,"available":95987552256,"internally_reserved":0,"allocated":987136,"data_stored":479844,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.42799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79500000000000004,"5min":1.113,"15min":1.113},"last":0.84899999999999998}]},{"osd":1,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81299999999999994,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":2.117,"15min":2.117},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed Sep 7 19:42:00 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.73999999999999999}]},{"osd":4,"last update":"Wed Sep 7 19:41:12 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.374,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed Sep 7 19:41:39 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:42:08 2022","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.754,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Sep 7 19:41:33 2022","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68300000000000005}]},{"osd":8,"last update":"Wed Sep 7 19:42:00 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Wed Sep 7 19:42:30 2022","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2},"last":0.80400000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:42:00 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6656,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738496,"statfs":{"total":95995035648,"available":95988219904,"internally_reserved":0,"allocated":974848,"data_stored":475448,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:54 2022","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.436,"15min":0.40999999999999998},"min":{"1min":0.33600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.103,"5min":1.111,"15min":1.111},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed Sep 7 19:41:54 2022","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.49299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89000000000000001,"5min":1.03,"15min":1.03},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.621,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":1.018,"15min":1.018},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:41:54 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67700000000000005,"15min":0.64800000000000002},"min":{"1min":0.61099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.038,"5min":1.288,"15min":1.288},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.46700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Sep 7 19:42:12 2022","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.62},"min":{"1min":0.51300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.746},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"min":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Sep 7 19:41:38 2022","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.55100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.63300000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90100000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:42:12 2022","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.93700000000000006,"5min":1.115,"15min":1.115},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91900000000000004,"5min":0.999,"15min":0.999},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Sep 7 19:42:36 2022","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.76600000000000001,"15min":0.73499999999999999},"min":{"1min":0.67500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0529999999999999,"5min":1.173,"15min":1.173},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.61599999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.97499999999999998,"5min":1.075,"15min":1.075},"last":0.80700000000000005}]},{"osd":8,"last update":"Wed Sep 7 19:42:01 2022","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.879}]},{"osd":9,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.91800000000000004,"15min":0.92300000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.1819999999999999,"5min":1.204,"15min":1.204},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.089,"5min":1.143,"15min":1.143},"last":0.67200000000000004}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.016}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6464,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738688,"statfs":{"total":95995035648,"available":95988416512,"internally_reserved":0,"allocated":974848,"data_stored":476476,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:16 2022","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53800000000000003},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.36499999999999999,"15min":0.34399999999999997},"min":{"1min":0.312,"5min":0.192,"15min":0.192},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.38200000000000001,"15min":0.35999999999999999},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.61899999999999999,"5min":0.753,"15min":0.753},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.4779999999999998,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53900000000000003,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.58499999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed Sep 7 19:41:40 2022","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.90200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83799999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.752}]},{"osd":7,"last update":"Wed Sep 7 19:41:40 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70699999999999996}]},{"osd":8,"last update":"Wed Sep 7 19:42:01 2022","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.51900000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73699999999999999}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.879,"5min":0.999,"15min":0.999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89900000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77200000000000002}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6660,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738492,"statfs":{"total":95995035648,"available":95988215808,"internally_reserved":0,"allocated":1044480,"data_stored":1071756,"data_compressed":47426,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.505}]},{"osd":1,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72999999999999998,"5min":0.754,"15min":0.754},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":1.097},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.53000000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77100000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66700000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:41:56 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.498}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.69799999999999995}]},{"osd":10,"last update":"Wed Sep 7 19:41:56 2022","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-07T19:42:42.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-09-07T19:42:42.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 -- 172.21.15.80:0/197388535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 msgr2=0x7effcc0fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.348 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 --2- 172.21.15.80:0/197388535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 0x7effcc0fe100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7effc0009810 tx=0x7effc0009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:42.348 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 -- 172.21.15.80:0/197388535 shutdown_connections 2022-09-07T19:42:42.348 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 --2- 172.21.15.80:0/197388535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.348 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 --2- 172.21.15.80:0/197388535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 0x7effcc0fe100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 --2- 172.21.15.80:0/197388535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc0fef70 0x7effcc0ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 -- 172.21.15.80:0/197388535 >> 172.21.15.80:0/197388535 conn(0x7effcc0f93c0 msgr2=0x7effcc0fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:42.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.347+0000 7effd2dff700 1 -- 172.21.15.80:0/197388535 shutdown_connections 2022-09-07T19:42:42.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.348+0000 7effd2dff700 1 -- 172.21.15.80:0/197388535 wait complete. 2022-09-07T19:42:42.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 Processor -- start 2022-09-07T19:42:42.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 -- start start 2022-09-07T19:42:42.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 0x7effcc195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:42.352 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc0fef70 0x7effcc196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:42.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:42.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc19d760 con 0x7effcc0ff900 2022-09-07T19:42:42.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc19d8d0 con 0x7effcc0fdcf0 2022-09-07T19:42:42.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd2dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc19da90 con 0x7effcc0fef70 2022-09-07T19:42:42.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd139c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:42.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd139c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc19d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44524/0 (socket says 172.21.15.80:44524) 2022-09-07T19:42:42.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.349+0000 7effd139c700 1 -- 172.21.15.80:0/2308695136 learned_addr learned my addr 172.21.15.80:0/2308695136 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:42.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effcbfff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc0fef70 0x7effcc196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:42.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd0b9b700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 0x7effcc195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:42.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd139c700 1 -- 172.21.15.80:0/2308695136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc0fef70 msgr2=0x7effcc196120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd139c700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc0fef70 0x7effcc196120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd139c700 1 -- 172.21.15.80:0/2308695136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 msgr2=0x7effcc195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd139c700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 0x7effcc195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd139c700 1 -- 172.21.15.80:0/2308695136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0009470 con 0x7effcc0ff900 2022-09-07T19:42:42.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.350+0000 7effd139c700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc19d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effc400eaf0 tx=0x7effc400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:42.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.351+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4009960 con 0x7effcc0ff900 2022-09-07T19:42:42.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.351+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc19dd70 con 0x7effcc0ff900 2022-09-07T19:42:42.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.351+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7effc400ce70 con 0x7effcc0ff900 2022-09-07T19:42:42.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.351+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4010430 con 0x7effcc0ff900 2022-09-07T19:42:42.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.351+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc19e1d0 con 0x7effcc0ff900 2022-09-07T19:42:42.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.352+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc1094a0 con 0x7effcc0ff900 2022-09-07T19:42:42.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.354+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7effc401e020 con 0x7effcc0ff900 2022-09-07T19:42:42.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.355+0000 7effc9ffb700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7effbc099050 0x7effbc09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:42.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.355+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8726+0+0 (secure 0 0 0) 0x7effc4014070 con 0x7effcc0ff900 2022-09-07T19:42:42.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.356+0000 7effd0b9b700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7effbc099050 0x7effbc09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:42.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.356+0000 7effd0b9b700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7effbc099050 0x7effbc09b500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effc000b4f0 tx=0x7effc0009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:42.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.359+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7effc408ef50 con 0x7effcc0ff900 2022-09-07T19:42:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.558+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effcc05fbb0 con 0x7effbc099050 2022-09-07T19:42:42.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.570+0000 7effc9ffb700 1 -- 172.21.15.80:0/2308695136 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+423147 (secure 0 0 0) 0x7effcc05fbb0 con 0x7effbc099050 2022-09-07T19:42:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7effbc099050 msgr2=0x7effbc09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7effbc099050 0x7effbc09b500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effc000b4f0 tx=0x7effc0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 msgr2=0x7effcc19d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc19d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effc400eaf0 tx=0x7effc400ee00 comp rx=0 tx=0).stop 2022-09-07T19:42:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 shutdown_connections 2022-09-07T19:42:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effcc0ff900 0x7effcc19d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7effbc099050 0x7effbc09b500 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0fdcf0 0x7effcc195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 --2- 172.21.15.80:0/2308695136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc0fef70 0x7effcc196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:42.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 >> 172.21.15.80:0/2308695136 conn(0x7effcc0f93c0 msgr2=0x7effcc104990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:42.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 shutdown_connections 2022-09-07T19:42:42.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:42.576+0000 7effd2dff700 1 -- 172.21.15.80:0/2308695136 wait complete. 2022-09-07T19:42:42.589 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2022-09-07T19:42:42.603 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2022-09-07T19:42:42.522623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620393,"num_objects":62,"num_object_clones":0,"num_object_copies":187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":172,"num_read_kb":173,"num_write":321,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":260,"ondisk_log_size":260,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79444,"kb_used_data":11700,"kb_used_omap":0,"kb_used_meta":67648,"kb_avail":1124862380,"statfs":{"total":1151940427776,"available":1151859077120,"internally_reserved":0,"allocated":11980800,"data_stored":7563770,"data_compressed":247344,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":69271552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25494,"num_objects":38,"num_object_clones":0,"num_object_copies":115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":36,"num_read_kb":54,"num_write":91,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.589994"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385511+0000","last_change":"2022-09-07T19:42:06.951015+0000","last_active":"2022-09-07T19:42:11.385511+0000","last_peered":"2022-09-07T19:42:11.385511+0000","last_clean":"2022-09-07T19:42:11.385511+0000","last_became_active":"2022-09-07T19:42:06.950768+0000","last_became_peered":"2022-09-07T19:42:06.950768+0000","last_unstale":"2022-09-07T19:42:11.385511+0000","last_undegraded":"2022-09-07T19:42:11.385511+0000","last_fullsized":"2022-09-07T19:42:11.385511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:35:45.040811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390979+0000","last_change":"2022-09-07T19:42:06.956370+0000","last_active":"2022-09-07T19:42:11.390979+0000","last_peered":"2022-09-07T19:42:11.390979+0000","last_clean":"2022-09-07T19:42:11.390979+0000","last_became_active":"2022-09-07T19:42:06.955072+0000","last_became_peered":"2022-09-07T19:42:06.955072+0000","last_unstale":"2022-09-07T19:42:11.390979+0000","last_undegraded":"2022-09-07T19:42:11.390979+0000","last_fullsized":"2022-09-07T19:42:11.390979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:01:51.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390716+0000","last_change":"2022-09-07T19:42:06.957647+0000","last_active":"2022-09-07T19:42:11.390716+0000","last_peered":"2022-09-07T19:42:11.390716+0000","last_clean":"2022-09-07T19:42:11.390716+0000","last_became_active":"2022-09-07T19:42:06.956731+0000","last_became_peered":"2022-09-07T19:42:06.956731+0000","last_unstale":"2022-09-07T19:42:11.390716+0000","last_undegraded":"2022-09-07T19:42:11.390716+0000","last_fullsized":"2022-09-07T19:42:11.390716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:13.700278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393361+0000","last_change":"2022-09-07T19:42:06.946811+0000","last_active":"2022-09-07T19:42:11.393361+0000","last_peered":"2022-09-07T19:42:11.393361+0000","last_clean":"2022-09-07T19:42:11.393361+0000","last_became_active":"2022-09-07T19:42:06.946133+0000","last_became_peered":"2022-09-07T19:42:06.946133+0000","last_unstale":"2022-09-07T19:42:11.393361+0000","last_undegraded":"2022-09-07T19:42:11.393361+0000","last_fullsized":"2022-09-07T19:42:11.393361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:17:46.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390177+0000","last_change":"2022-09-07T19:42:06.938599+0000","last_active":"2022-09-07T19:42:11.390177+0000","last_peered":"2022-09-07T19:42:11.390177+0000","last_clean":"2022-09-07T19:42:11.390177+0000","last_became_active":"2022-09-07T19:42:06.938280+0000","last_became_peered":"2022-09-07T19:42:06.938280+0000","last_unstale":"2022-09-07T19:42:11.390177+0000","last_undegraded":"2022-09-07T19:42:11.390177+0000","last_fullsized":"2022-09-07T19:42:11.390177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:41:40.529183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387680+0000","last_change":"2022-09-07T19:42:06.939120+0000","last_active":"2022-09-07T19:42:11.387680+0000","last_peered":"2022-09-07T19:42:11.387680+0000","last_clean":"2022-09-07T19:42:11.387680+0000","last_became_active":"2022-09-07T19:42:06.938805+0000","last_became_peered":"2022-09-07T19:42:06.938805+0000","last_unstale":"2022-09-07T19:42:11.387680+0000","last_undegraded":"2022-09-07T19:42:11.387680+0000","last_fullsized":"2022-09-07T19:42:11.387680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:26:17.772579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394663+0000","last_change":"2022-09-07T19:42:06.935222+0000","last_active":"2022-09-07T19:42:11.394663+0000","last_peered":"2022-09-07T19:42:11.394663+0000","last_clean":"2022-09-07T19:42:11.394663+0000","last_became_active":"2022-09-07T19:42:06.934863+0000","last_became_peered":"2022-09-07T19:42:06.934863+0000","last_unstale":"2022-09-07T19:42:11.394663+0000","last_undegraded":"2022-09-07T19:42:11.394663+0000","last_fullsized":"2022-09-07T19:42:11.394663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:10:12.989147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396711+0000","last_change":"2022-09-07T19:42:06.940593+0000","last_active":"2022-09-07T19:42:11.396711+0000","last_peered":"2022-09-07T19:42:11.396711+0000","last_clean":"2022-09-07T19:42:11.396711+0000","last_became_active":"2022-09-07T19:42:06.940209+0000","last_became_peered":"2022-09-07T19:42:06.940209+0000","last_unstale":"2022-09-07T19:42:11.396711+0000","last_undegraded":"2022-09-07T19:42:11.396711+0000","last_fullsized":"2022-09-07T19:42:11.396711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:45:25.341085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.400890+0000","last_change":"2022-09-07T19:42:06.935215+0000","last_active":"2022-09-07T19:42:11.400890+0000","last_peered":"2022-09-07T19:42:11.400890+0000","last_clean":"2022-09-07T19:42:11.400890+0000","last_became_active":"2022-09-07T19:42:06.934974+0000","last_became_peered":"2022-09-07T19:42:06.934974+0000","last_unstale":"2022-09-07T19:42:11.400890+0000","last_undegraded":"2022-09-07T19:42:11.400890+0000","last_fullsized":"2022-09-07T19:42:11.400890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:01.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.388206+0000","last_change":"2022-09-07T19:42:06.939935+0000","last_active":"2022-09-07T19:42:11.388206+0000","last_peered":"2022-09-07T19:42:11.388206+0000","last_clean":"2022-09-07T19:42:11.388206+0000","last_became_active":"2022-09-07T19:42:06.939160+0000","last_became_peered":"2022-09-07T19:42:06.939160+0000","last_unstale":"2022-09-07T19:42:11.388206+0000","last_undegraded":"2022-09-07T19:42:11.388206+0000","last_fullsized":"2022-09-07T19:42:11.388206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:32.324752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396697+0000","last_change":"2022-09-07T19:42:06.948084+0000","last_active":"2022-09-07T19:42:11.396697+0000","last_peered":"2022-09-07T19:42:11.396697+0000","last_clean":"2022-09-07T19:42:11.396697+0000","last_became_active":"2022-09-07T19:42:06.947552+0000","last_became_peered":"2022-09-07T19:42:06.947552+0000","last_unstale":"2022-09-07T19:42:11.396697+0000","last_undegraded":"2022-09-07T19:42:11.396697+0000","last_fullsized":"2022-09-07T19:42:11.396697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:51:20.247983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393320+0000","last_change":"2022-09-07T19:42:06.947021+0000","last_active":"2022-09-07T19:42:11.393320+0000","last_peered":"2022-09-07T19:42:11.393320+0000","last_clean":"2022-09-07T19:42:11.393320+0000","last_became_active":"2022-09-07T19:42:06.946507+0000","last_became_peered":"2022-09-07T19:42:06.946507+0000","last_unstale":"2022-09-07T19:42:11.393320+0000","last_undegraded":"2022-09-07T19:42:11.393320+0000","last_fullsized":"2022-09-07T19:42:11.393320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:25:15.358991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393713+0000","last_change":"2022-09-07T19:42:06.940573+0000","last_active":"2022-09-07T19:42:11.393713+0000","last_peered":"2022-09-07T19:42:11.393713+0000","last_clean":"2022-09-07T19:42:11.393713+0000","last_became_active":"2022-09-07T19:42:06.940298+0000","last_became_peered":"2022-09-07T19:42:06.940298+0000","last_unstale":"2022-09-07T19:42:11.393713+0000","last_undegraded":"2022-09-07T19:42:11.393713+0000","last_fullsized":"2022-09-07T19:42:11.393713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:41.459964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392730+0000","last_change":"2022-09-07T19:42:06.953348+0000","last_active":"2022-09-07T19:42:11.392730+0000","last_peered":"2022-09-07T19:42:11.392730+0000","last_clean":"2022-09-07T19:42:11.392730+0000","last_became_active":"2022-09-07T19:42:06.952776+0000","last_became_peered":"2022-09-07T19:42:06.952776+0000","last_unstale":"2022-09-07T19:42:11.392730+0000","last_undegraded":"2022-09-07T19:42:11.392730+0000","last_fullsized":"2022-09-07T19:42:11.392730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:58:29.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390619+0000","last_change":"2022-09-07T19:42:06.952737+0000","last_active":"2022-09-07T19:42:11.390619+0000","last_peered":"2022-09-07T19:42:11.390619+0000","last_clean":"2022-09-07T19:42:11.390619+0000","last_became_active":"2022-09-07T19:42:06.950280+0000","last_became_peered":"2022-09-07T19:42:06.950280+0000","last_unstale":"2022-09-07T19:42:11.390619+0000","last_undegraded":"2022-09-07T19:42:11.390619+0000","last_fullsized":"2022-09-07T19:42:11.390619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:08:05.741215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394128+0000","last_change":"2022-09-07T19:42:06.954614+0000","last_active":"2022-09-07T19:42:11.394128+0000","last_peered":"2022-09-07T19:42:11.394128+0000","last_clean":"2022-09-07T19:42:11.394128+0000","last_became_active":"2022-09-07T19:42:06.954312+0000","last_became_peered":"2022-09-07T19:42:06.954312+0000","last_unstale":"2022-09-07T19:42:11.394128+0000","last_undegraded":"2022-09-07T19:42:11.394128+0000","last_fullsized":"2022-09-07T19:42:11.394128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:39:14.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385354+0000","last_change":"2022-09-07T19:42:06.950491+0000","last_active":"2022-09-07T19:42:11.385354+0000","last_peered":"2022-09-07T19:42:11.385354+0000","last_clean":"2022-09-07T19:42:11.385354+0000","last_became_active":"2022-09-07T19:42:06.950164+0000","last_became_peered":"2022-09-07T19:42:06.950164+0000","last_unstale":"2022-09-07T19:42:11.385354+0000","last_undegraded":"2022-09-07T19:42:11.385354+0000","last_fullsized":"2022-09-07T19:42:11.385354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:25.631788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.388547+0000","last_change":"2022-09-07T19:42:06.933766+0000","last_active":"2022-09-07T19:42:11.388547+0000","last_peered":"2022-09-07T19:42:11.388547+0000","last_clean":"2022-09-07T19:42:11.388547+0000","last_became_active":"2022-09-07T19:42:06.933448+0000","last_became_peered":"2022-09-07T19:42:06.933448+0000","last_unstale":"2022-09-07T19:42:11.388547+0000","last_undegraded":"2022-09-07T19:42:11.388547+0000","last_fullsized":"2022-09-07T19:42:11.388547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:10.478403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395066+0000","last_change":"2022-09-07T19:42:06.937141+0000","last_active":"2022-09-07T19:42:11.395066+0000","last_peered":"2022-09-07T19:42:11.395066+0000","last_clean":"2022-09-07T19:42:11.395066+0000","last_became_active":"2022-09-07T19:42:06.936841+0000","last_became_peered":"2022-09-07T19:42:06.936841+0000","last_unstale":"2022-09-07T19:42:11.395066+0000","last_undegraded":"2022-09-07T19:42:11.395066+0000","last_fullsized":"2022-09-07T19:42:11.395066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:57:43.397083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927672+0000","last_change":"2022-09-07T19:42:11.413877+0000","last_active":"2022-09-07T19:42:11.927672+0000","last_peered":"2022-09-07T19:42:11.927672+0000","last_clean":"2022-09-07T19:42:11.927672+0000","last_became_active":"2022-09-07T19:42:11.413419+0000","last_became_peered":"2022-09-07T19:42:11.413419+0000","last_unstale":"2022-09-07T19:42:11.927672+0000","last_undegraded":"2022-09-07T19:42:11.927672+0000","last_fullsized":"2022-09-07T19:42:11.927672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:40:06.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511036+0000","last_change":"2022-09-07T19:42:06.360233+0000","last_active":"2022-09-07T19:42:37.511036+0000","last_peered":"2022-09-07T19:42:37.511036+0000","last_clean":"2022-09-07T19:42:37.511036+0000","last_became_active":"2022-09-07T19:42:06.359937+0000","last_became_peered":"2022-09-07T19:42:06.359937+0000","last_unstale":"2022-09-07T19:42:37.511036+0000","last_undegraded":"2022-09-07T19:42:37.511036+0000","last_fullsized":"2022-09-07T19:42:37.511036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:02.665896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.398633+0000","last_change":"2022-09-07T19:42:06.943068+0000","last_active":"2022-09-07T19:42:11.398633+0000","last_peered":"2022-09-07T19:42:11.398633+0000","last_clean":"2022-09-07T19:42:11.398633+0000","last_became_active":"2022-09-07T19:42:06.942735+0000","last_became_peered":"2022-09-07T19:42:06.942735+0000","last_unstale":"2022-09-07T19:42:11.398633+0000","last_undegraded":"2022-09-07T19:42:11.398633+0000","last_fullsized":"2022-09-07T19:42:11.398633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:20:21.052216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.413185+0000","last_change":"2022-09-07T19:42:11.412836+0000","last_active":"2022-09-07T19:42:11.413185+0000","last_peered":"2022-09-07T19:42:11.413185+0000","last_clean":"2022-09-07T19:42:11.413185+0000","last_became_active":"2022-09-07T19:42:11.412407+0000","last_became_peered":"2022-09-07T19:42:11.412407+0000","last_unstale":"2022-09-07T19:42:11.413185+0000","last_undegraded":"2022-09-07T19:42:11.413185+0000","last_fullsized":"2022-09-07T19:42:11.413185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:40:35.056313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.447116+0000","last_change":"2022-09-07T19:42:06.372498+0000","last_active":"2022-09-07T19:42:12.447116+0000","last_peered":"2022-09-07T19:42:12.447116+0000","last_clean":"2022-09-07T19:42:12.447116+0000","last_became_active":"2022-09-07T19:42:06.372183+0000","last_became_peered":"2022-09-07T19:42:06.372183+0000","last_unstale":"2022-09-07T19:42:12.447116+0000","last_undegraded":"2022-09-07T19:42:12.447116+0000","last_fullsized":"2022-09-07T19:42:12.447116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:00:56.451463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392960+0000","last_change":"2022-09-07T19:42:06.953146+0000","last_active":"2022-09-07T19:42:11.392960+0000","last_peered":"2022-09-07T19:42:11.392960+0000","last_clean":"2022-09-07T19:42:11.392960+0000","last_became_active":"2022-09-07T19:42:06.952824+0000","last_became_peered":"2022-09-07T19:42:06.952824+0000","last_unstale":"2022-09-07T19:42:11.392960+0000","last_undegraded":"2022-09-07T19:42:11.392960+0000","last_fullsized":"2022-09-07T19:42:11.392960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:59:59.989327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.412557+0000","last_change":"2022-09-07T19:42:11.411807+0000","last_active":"2022-09-07T19:42:11.412557+0000","last_peered":"2022-09-07T19:42:11.412557+0000","last_clean":"2022-09-07T19:42:11.412557+0000","last_became_active":"2022-09-07T19:42:11.411392+0000","last_became_peered":"2022-09-07T19:42:11.411392+0000","last_unstale":"2022-09-07T19:42:11.412557+0000","last_undegraded":"2022-09-07T19:42:11.412557+0000","last_fullsized":"2022-09-07T19:42:11.412557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:37:00.477243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.508751+0000","last_change":"2022-09-07T19:42:06.359561+0000","last_active":"2022-09-07T19:42:37.508751+0000","last_peered":"2022-09-07T19:42:37.508751+0000","last_clean":"2022-09-07T19:42:37.508751+0000","last_became_active":"2022-09-07T19:42:06.359200+0000","last_became_peered":"2022-09-07T19:42:06.359200+0000","last_unstale":"2022-09-07T19:42:37.508751+0000","last_undegraded":"2022-09-07T19:42:37.508751+0000","last_fullsized":"2022-09-07T19:42:37.508751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:16:13.894233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393817+0000","last_change":"2022-09-07T19:42:06.943682+0000","last_active":"2022-09-07T19:42:11.393817+0000","last_peered":"2022-09-07T19:42:11.393817+0000","last_clean":"2022-09-07T19:42:11.393817+0000","last_became_active":"2022-09-07T19:42:06.943323+0000","last_became_peered":"2022-09-07T19:42:06.943323+0000","last_unstale":"2022-09-07T19:42:11.393817+0000","last_undegraded":"2022-09-07T19:42:11.393817+0000","last_fullsized":"2022-09-07T19:42:11.393817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:00:26.030438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.403785+0000","last_change":"2022-09-07T19:42:11.403222+0000","last_active":"2022-09-07T19:42:11.403785+0000","last_peered":"2022-09-07T19:42:11.403785+0000","last_clean":"2022-09-07T19:42:11.403785+0000","last_became_active":"2022-09-07T19:42:11.402740+0000","last_became_peered":"2022-09-07T19:42:11.402740+0000","last_unstale":"2022-09-07T19:42:11.403785+0000","last_undegraded":"2022-09-07T19:42:11.403785+0000","last_fullsized":"2022-09-07T19:42:11.403785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:55:07.470945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390960+0000","last_change":"2022-09-07T19:42:06.353930+0000","last_active":"2022-09-07T19:42:11.390960+0000","last_peered":"2022-09-07T19:42:11.390960+0000","last_clean":"2022-09-07T19:42:11.390960+0000","last_became_active":"2022-09-07T19:42:06.353603+0000","last_became_peered":"2022-09-07T19:42:06.353603+0000","last_unstale":"2022-09-07T19:42:11.390960+0000","last_undegraded":"2022-09-07T19:42:11.390960+0000","last_fullsized":"2022-09-07T19:42:11.390960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:50.562667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393675+0000","last_change":"2022-09-07T19:42:06.948086+0000","last_active":"2022-09-07T19:42:11.393675+0000","last_peered":"2022-09-07T19:42:11.393675+0000","last_clean":"2022-09-07T19:42:11.393675+0000","last_became_active":"2022-09-07T19:42:06.947805+0000","last_became_peered":"2022-09-07T19:42:06.947805+0000","last_unstale":"2022-09-07T19:42:11.393675+0000","last_undegraded":"2022-09-07T19:42:11.393675+0000","last_fullsized":"2022-09-07T19:42:11.393675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:36:53.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927837+0000","last_change":"2022-09-07T19:42:11.401915+0000","last_active":"2022-09-07T19:42:11.927837+0000","last_peered":"2022-09-07T19:42:11.927837+0000","last_clean":"2022-09-07T19:42:11.927837+0000","last_became_active":"2022-09-07T19:42:11.401513+0000","last_became_peered":"2022-09-07T19:42:11.401513+0000","last_unstale":"2022-09-07T19:42:11.927837+0000","last_undegraded":"2022-09-07T19:42:11.927837+0000","last_fullsized":"2022-09-07T19:42:11.927837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:42:34.774516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:38.522700+0000","last_change":"2022-09-07T19:42:06.361590+0000","last_active":"2022-09-07T19:42:38.522700+0000","last_peered":"2022-09-07T19:42:38.522700+0000","last_clean":"2022-09-07T19:42:38.522700+0000","last_became_active":"2022-09-07T19:42:06.361278+0000","last_became_peered":"2022-09-07T19:42:06.361278+0000","last_unstale":"2022-09-07T19:42:38.522700+0000","last_undegraded":"2022-09-07T19:42:38.522700+0000","last_fullsized":"2022-09-07T19:42:38.522700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:30.487710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.389805+0000","last_change":"2022-09-07T19:42:06.936076+0000","last_active":"2022-09-07T19:42:11.389805+0000","last_peered":"2022-09-07T19:42:11.389805+0000","last_clean":"2022-09-07T19:42:11.389805+0000","last_became_active":"2022-09-07T19:42:06.935747+0000","last_became_peered":"2022-09-07T19:42:06.935747+0000","last_unstale":"2022-09-07T19:42:11.389805+0000","last_undegraded":"2022-09-07T19:42:11.389805+0000","last_fullsized":"2022-09-07T19:42:11.389805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:20:17.729299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927684+0000","last_change":"2022-09-07T19:42:11.414174+0000","last_active":"2022-09-07T19:42:11.927684+0000","last_peered":"2022-09-07T19:42:11.927684+0000","last_clean":"2022-09-07T19:42:11.927684+0000","last_became_active":"2022-09-07T19:42:11.413798+0000","last_became_peered":"2022-09-07T19:42:11.413798+0000","last_unstale":"2022-09-07T19:42:11.927684+0000","last_undegraded":"2022-09-07T19:42:11.927684+0000","last_fullsized":"2022-09-07T19:42:11.927684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:17.386698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.509341+0000","last_change":"2022-09-07T19:42:06.375593+0000","last_active":"2022-09-07T19:42:37.509341+0000","last_peered":"2022-09-07T19:42:37.509341+0000","last_clean":"2022-09-07T19:42:37.509341+0000","last_became_active":"2022-09-07T19:42:06.375396+0000","last_became_peered":"2022-09-07T19:42:06.375396+0000","last_unstale":"2022-09-07T19:42:37.509341+0000","last_undegraded":"2022-09-07T19:42:37.509341+0000","last_fullsized":"2022-09-07T19:42:37.509341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:00:10.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394799+0000","last_change":"2022-09-07T19:42:06.936369+0000","last_active":"2022-09-07T19:42:11.394799+0000","last_peered":"2022-09-07T19:42:11.394799+0000","last_clean":"2022-09-07T19:42:11.394799+0000","last_became_active":"2022-09-07T19:42:06.936083+0000","last_became_peered":"2022-09-07T19:42:06.936083+0000","last_unstale":"2022-09-07T19:42:11.394799+0000","last_undegraded":"2022-09-07T19:42:11.394799+0000","last_fullsized":"2022-09-07T19:42:11.394799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:50:17.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696090+0000","last_change":"2022-09-07T19:42:11.399043+0000","last_active":"2022-09-07T19:42:12.696090+0000","last_peered":"2022-09-07T19:42:12.696090+0000","last_clean":"2022-09-07T19:42:12.696090+0000","last_became_active":"2022-09-07T19:42:11.398634+0000","last_became_peered":"2022-09-07T19:42:11.398634+0000","last_unstale":"2022-09-07T19:42:12.696090+0000","last_undegraded":"2022-09-07T19:42:12.696090+0000","last_fullsized":"2022-09-07T19:42:12.696090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:30:06.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511366+0000","last_change":"2022-09-07T19:42:06.365700+0000","last_active":"2022-09-07T19:42:37.511366+0000","last_peered":"2022-09-07T19:42:37.511366+0000","last_clean":"2022-09-07T19:42:37.511366+0000","last_became_active":"2022-09-07T19:42:06.365338+0000","last_became_peered":"2022-09-07T19:42:06.365338+0000","last_unstale":"2022-09-07T19:42:37.511366+0000","last_undegraded":"2022-09-07T19:42:37.511366+0000","last_fullsized":"2022-09-07T19:42:37.511366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:18.825477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396628+0000","last_change":"2022-09-07T19:42:06.938275+0000","last_active":"2022-09-07T19:42:11.396628+0000","last_peered":"2022-09-07T19:42:11.396628+0000","last_clean":"2022-09-07T19:42:11.396628+0000","last_became_active":"2022-09-07T19:42:06.937893+0000","last_became_peered":"2022-09-07T19:42:06.937893+0000","last_unstale":"2022-09-07T19:42:11.396628+0000","last_undegraded":"2022-09-07T19:42:11.396628+0000","last_fullsized":"2022-09-07T19:42:11.396628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:42:22.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.792009+0000","last_change":"2022-09-07T19:42:11.406329+0000","last_active":"2022-09-07T19:42:12.792009+0000","last_peered":"2022-09-07T19:42:12.792009+0000","last_clean":"2022-09-07T19:42:12.792009+0000","last_became_active":"2022-09-07T19:42:11.405954+0000","last_became_peered":"2022-09-07T19:42:11.405954+0000","last_unstale":"2022-09-07T19:42:12.792009+0000","last_undegraded":"2022-09-07T19:42:12.792009+0000","last_fullsized":"2022-09-07T19:42:12.792009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:15.735179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.695912+0000","last_change":"2022-09-07T19:42:06.360190+0000","last_active":"2022-09-07T19:42:12.695912+0000","last_peered":"2022-09-07T19:42:12.695912+0000","last_clean":"2022-09-07T19:42:12.695912+0000","last_became_active":"2022-09-07T19:42:06.359893+0000","last_became_peered":"2022-09-07T19:42:06.359893+0000","last_unstale":"2022-09-07T19:42:12.695912+0000","last_undegraded":"2022-09-07T19:42:12.695912+0000","last_fullsized":"2022-09-07T19:42:12.695912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:09:54.310816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387585+0000","last_change":"2022-09-07T19:42:06.931094+0000","last_active":"2022-09-07T19:42:11.387585+0000","last_peered":"2022-09-07T19:42:11.387585+0000","last_clean":"2022-09-07T19:42:11.387585+0000","last_became_active":"2022-09-07T19:42:06.930781+0000","last_became_peered":"2022-09-07T19:42:06.930781+0000","last_unstale":"2022-09-07T19:42:11.387585+0000","last_undegraded":"2022-09-07T19:42:11.387585+0000","last_fullsized":"2022-09-07T19:42:11.387585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:31:17.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.446517+0000","last_change":"2022-09-07T19:42:11.402900+0000","last_active":"2022-09-07T19:42:12.446517+0000","last_peered":"2022-09-07T19:42:12.446517+0000","last_clean":"2022-09-07T19:42:12.446517+0000","last_became_active":"2022-09-07T19:42:11.402553+0000","last_became_peered":"2022-09-07T19:42:11.402553+0000","last_unstale":"2022-09-07T19:42:12.446517+0000","last_undegraded":"2022-09-07T19:42:12.446517+0000","last_fullsized":"2022-09-07T19:42:12.446517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:19:01.667064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:38.520959+0000","last_change":"2022-09-07T19:42:06.363330+0000","last_active":"2022-09-07T19:42:38.520959+0000","last_peered":"2022-09-07T19:42:38.520959+0000","last_clean":"2022-09-07T19:42:38.520959+0000","last_became_active":"2022-09-07T19:42:06.363057+0000","last_became_peered":"2022-09-07T19:42:06.363057+0000","last_unstale":"2022-09-07T19:42:38.520959+0000","last_undegraded":"2022-09-07T19:42:38.520959+0000","last_fullsized":"2022-09-07T19:42:38.520959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:36.386640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394590+0000","last_change":"2022-09-07T19:42:06.943678+0000","last_active":"2022-09-07T19:42:11.394590+0000","last_peered":"2022-09-07T19:42:11.394590+0000","last_clean":"2022-09-07T19:42:11.394590+0000","last_became_active":"2022-09-07T19:42:06.942341+0000","last_became_peered":"2022-09-07T19:42:06.942341+0000","last_unstale":"2022-09-07T19:42:11.394590+0000","last_undegraded":"2022-09-07T19:42:11.394590+0000","last_fullsized":"2022-09-07T19:42:11.394590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:30:24.776240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.926877+0000","last_change":"2022-09-07T19:42:11.410225+0000","last_active":"2022-09-07T19:42:11.926877+0000","last_peered":"2022-09-07T19:42:11.926877+0000","last_clean":"2022-09-07T19:42:11.926877+0000","last_became_active":"2022-09-07T19:42:11.409826+0000","last_became_peered":"2022-09-07T19:42:11.409826+0000","last_unstale":"2022-09-07T19:42:11.926877+0000","last_undegraded":"2022-09-07T19:42:11.926877+0000","last_fullsized":"2022-09-07T19:42:11.926877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:01.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.506957+0000","last_change":"2022-09-07T19:42:06.357384+0000","last_active":"2022-09-07T19:42:36.506957+0000","last_peered":"2022-09-07T19:42:36.506957+0000","last_clean":"2022-09-07T19:42:36.506957+0000","last_became_active":"2022-09-07T19:42:06.357042+0000","last_became_peered":"2022-09-07T19:42:06.357042+0000","last_unstale":"2022-09-07T19:42:36.506957+0000","last_undegraded":"2022-09-07T19:42:36.506957+0000","last_fullsized":"2022-09-07T19:42:36.506957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:36:30.278258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393075+0000","last_change":"2022-09-07T19:42:06.952991+0000","last_active":"2022-09-07T19:42:11.393075+0000","last_peered":"2022-09-07T19:42:11.393075+0000","last_clean":"2022-09-07T19:42:11.393075+0000","last_became_active":"2022-09-07T19:42:06.952650+0000","last_became_peered":"2022-09-07T19:42:06.952650+0000","last_unstale":"2022-09-07T19:42:11.393075+0000","last_undegraded":"2022-09-07T19:42:11.393075+0000","last_fullsized":"2022-09-07T19:42:11.393075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:15:44.166803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.412815+0000","last_change":"2022-09-07T19:42:11.412153+0000","last_active":"2022-09-07T19:42:11.412815+0000","last_peered":"2022-09-07T19:42:11.412815+0000","last_clean":"2022-09-07T19:42:11.412815+0000","last_became_active":"2022-09-07T19:42:11.411371+0000","last_became_peered":"2022-09-07T19:42:11.411371+0000","last_unstale":"2022-09-07T19:42:11.412815+0000","last_undegraded":"2022-09-07T19:42:11.412815+0000","last_fullsized":"2022-09-07T19:42:11.412815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:34:31.765609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.507467+0000","last_change":"2022-09-07T19:42:06.356763+0000","last_active":"2022-09-07T19:42:36.507467+0000","last_peered":"2022-09-07T19:42:36.507467+0000","last_clean":"2022-09-07T19:42:36.507467+0000","last_became_active":"2022-09-07T19:42:06.356155+0000","last_became_peered":"2022-09-07T19:42:06.356155+0000","last_unstale":"2022-09-07T19:42:36.507467+0000","last_undegraded":"2022-09-07T19:42:36.507467+0000","last_fullsized":"2022-09-07T19:42:36.507467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:06:07.941810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394366+0000","last_change":"2022-09-07T19:42:06.940746+0000","last_active":"2022-09-07T19:42:11.394366+0000","last_peered":"2022-09-07T19:42:11.394366+0000","last_clean":"2022-09-07T19:42:11.394366+0000","last_became_active":"2022-09-07T19:42:06.939798+0000","last_became_peered":"2022-09-07T19:42:06.939798+0000","last_unstale":"2022-09-07T19:42:11.394366+0000","last_undegraded":"2022-09-07T19:42:11.394366+0000","last_fullsized":"2022-09-07T19:42:11.394366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:02:25.348841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927169+0000","last_change":"2022-09-07T19:42:11.393014+0000","last_active":"2022-09-07T19:42:11.927169+0000","last_peered":"2022-09-07T19:42:11.927169+0000","last_clean":"2022-09-07T19:42:11.927169+0000","last_became_active":"2022-09-07T19:42:11.392465+0000","last_became_peered":"2022-09-07T19:42:11.392465+0000","last_unstale":"2022-09-07T19:42:11.927169+0000","last_undegraded":"2022-09-07T19:42:11.927169+0000","last_fullsized":"2022-09-07T19:42:11.927169+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:52:11.553583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'19","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:39.523611+0000","last_change":"2022-09-07T19:42:06.364454+0000","last_active":"2022-09-07T19:42:39.523611+0000","last_peered":"2022-09-07T19:42:39.523611+0000","last_clean":"2022-09-07T19:42:39.523611+0000","last_became_active":"2022-09-07T19:42:06.364112+0000","last_became_peered":"2022-09-07T19:42:06.364112+0000","last_unstale":"2022-09-07T19:42:39.523611+0000","last_undegraded":"2022-09-07T19:42:39.523611+0000","last_fullsized":"2022-09-07T19:42:39.523611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:04:50.190357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25650,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":29,"num_write":20,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.390498+0000","last_change":"2022-09-07T19:42:06.942860+0000","last_active":"2022-09-07T19:42:11.390498+0000","last_peered":"2022-09-07T19:42:11.390498+0000","last_clean":"2022-09-07T19:42:11.390498+0000","last_became_active":"2022-09-07T19:42:06.941587+0000","last_became_peered":"2022-09-07T19:42:06.941587+0000","last_unstale":"2022-09-07T19:42:11.390498+0000","last_undegraded":"2022-09-07T19:42:11.390498+0000","last_fullsized":"2022-09-07T19:42:11.390498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:41:45.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.697047+0000","last_change":"2022-09-07T19:42:11.403579+0000","last_active":"2022-09-07T19:42:12.697047+0000","last_peered":"2022-09-07T19:42:12.697047+0000","last_clean":"2022-09-07T19:42:12.697047+0000","last_became_active":"2022-09-07T19:42:11.402923+0000","last_became_peered":"2022-09-07T19:42:11.402923+0000","last_unstale":"2022-09-07T19:42:12.697047+0000","last_undegraded":"2022-09-07T19:42:12.697047+0000","last_fullsized":"2022-09-07T19:42:12.697047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:39:47.178557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.509608+0000","last_change":"2022-09-07T19:42:06.369220+0000","last_active":"2022-09-07T19:42:37.509608+0000","last_peered":"2022-09-07T19:42:37.509608+0000","last_clean":"2022-09-07T19:42:37.509608+0000","last_became_active":"2022-09-07T19:42:06.368957+0000","last_became_peered":"2022-09-07T19:42:06.368957+0000","last_unstale":"2022-09-07T19:42:37.509608+0000","last_undegraded":"2022-09-07T19:42:37.509608+0000","last_fullsized":"2022-09-07T19:42:37.509608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:13:27.882414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392515+0000","last_change":"2022-09-07T19:42:06.942818+0000","last_active":"2022-09-07T19:42:11.392515+0000","last_peered":"2022-09-07T19:42:11.392515+0000","last_clean":"2022-09-07T19:42:11.392515+0000","last_became_active":"2022-09-07T19:42:06.942536+0000","last_became_peered":"2022-09-07T19:42:06.942536+0000","last_unstale":"2022-09-07T19:42:11.392515+0000","last_undegraded":"2022-09-07T19:42:11.392515+0000","last_fullsized":"2022-09-07T19:42:11.392515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:41:05.892343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.695933+0000","last_change":"2022-09-07T19:42:11.401939+0000","last_active":"2022-09-07T19:42:12.695933+0000","last_peered":"2022-09-07T19:42:12.695933+0000","last_clean":"2022-09-07T19:42:12.695933+0000","last_became_active":"2022-09-07T19:42:11.401423+0000","last_became_peered":"2022-09-07T19:42:11.401423+0000","last_unstale":"2022-09-07T19:42:12.695933+0000","last_undegraded":"2022-09-07T19:42:12.695933+0000","last_fullsized":"2022-09-07T19:42:12.695933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:23:58.588767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508420+0000","last_change":"2022-09-07T19:42:06.372606+0000","last_active":"2022-09-07T19:42:36.508420+0000","last_peered":"2022-09-07T19:42:36.508420+0000","last_clean":"2022-09-07T19:42:36.508420+0000","last_became_active":"2022-09-07T19:42:06.372314+0000","last_became_peered":"2022-09-07T19:42:06.372314+0000","last_unstale":"2022-09-07T19:42:36.508420+0000","last_undegraded":"2022-09-07T19:42:36.508420+0000","last_fullsized":"2022-09-07T19:42:36.508420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:57:29.102343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395305+0000","last_change":"2022-09-07T19:42:06.945336+0000","last_active":"2022-09-07T19:42:11.395305+0000","last_peered":"2022-09-07T19:42:11.395305+0000","last_clean":"2022-09-07T19:42:11.395305+0000","last_became_active":"2022-09-07T19:42:06.945056+0000","last_became_peered":"2022-09-07T19:42:06.945056+0000","last_unstale":"2022-09-07T19:42:11.395305+0000","last_undegraded":"2022-09-07T19:42:11.395305+0000","last_fullsized":"2022-09-07T19:42:11.395305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:24.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927155+0000","last_change":"2022-09-07T19:42:11.404998+0000","last_active":"2022-09-07T19:42:11.927155+0000","last_peered":"2022-09-07T19:42:11.927155+0000","last_clean":"2022-09-07T19:42:11.927155+0000","last_became_active":"2022-09-07T19:42:11.404553+0000","last_became_peered":"2022-09-07T19:42:11.404553+0000","last_unstale":"2022-09-07T19:42:11.927155+0000","last_undegraded":"2022-09-07T19:42:11.927155+0000","last_fullsized":"2022-09-07T19:42:11.927155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:36:55.188346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:39.522231+0000","last_change":"2022-09-07T19:42:06.356368+0000","last_active":"2022-09-07T19:42:39.522231+0000","last_peered":"2022-09-07T19:42:39.522231+0000","last_clean":"2022-09-07T19:42:39.522231+0000","last_became_active":"2022-09-07T19:42:06.356036+0000","last_became_peered":"2022-09-07T19:42:06.356036+0000","last_unstale":"2022-09-07T19:42:39.522231+0000","last_undegraded":"2022-09-07T19:42:39.522231+0000","last_fullsized":"2022-09-07T19:42:39.522231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:37.882450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392284+0000","last_change":"2022-09-07T19:42:06.936825+0000","last_active":"2022-09-07T19:42:11.392284+0000","last_peered":"2022-09-07T19:42:11.392284+0000","last_clean":"2022-09-07T19:42:11.392284+0000","last_became_active":"2022-09-07T19:42:06.936512+0000","last_became_peered":"2022-09-07T19:42:06.936512+0000","last_unstale":"2022-09-07T19:42:11.392284+0000","last_undegraded":"2022-09-07T19:42:11.392284+0000","last_fullsized":"2022-09-07T19:42:11.392284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:35:55.141151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.574134+0000","last_change":"2022-09-07T19:42:11.411115+0000","last_active":"2022-09-07T19:42:11.574134+0000","last_peered":"2022-09-07T19:42:11.574134+0000","last_clean":"2022-09-07T19:42:11.574134+0000","last_became_active":"2022-09-07T19:42:11.410742+0000","last_became_peered":"2022-09-07T19:42:11.410742+0000","last_unstale":"2022-09-07T19:42:11.574134+0000","last_undegraded":"2022-09-07T19:42:11.574134+0000","last_fullsized":"2022-09-07T19:42:11.574134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:11:06.320256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.510819+0000","last_change":"2022-09-07T19:42:06.363366+0000","last_active":"2022-09-07T19:42:37.510819+0000","last_peered":"2022-09-07T19:42:37.510819+0000","last_clean":"2022-09-07T19:42:37.510819+0000","last_became_active":"2022-09-07T19:42:06.362993+0000","last_became_peered":"2022-09-07T19:42:06.362993+0000","last_unstale":"2022-09-07T19:42:37.510819+0000","last_undegraded":"2022-09-07T19:42:37.510819+0000","last_fullsized":"2022-09-07T19:42:37.510819+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:31:15.571050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392779+0000","last_change":"2022-09-07T19:42:06.948273+0000","last_active":"2022-09-07T19:42:11.392779+0000","last_peered":"2022-09-07T19:42:11.392779+0000","last_clean":"2022-09-07T19:42:11.392779+0000","last_became_active":"2022-09-07T19:42:06.947701+0000","last_became_peered":"2022-09-07T19:42:06.947701+0000","last_unstale":"2022-09-07T19:42:11.392779+0000","last_undegraded":"2022-09-07T19:42:11.392779+0000","last_fullsized":"2022-09-07T19:42:11.392779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:01:57.543316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696352+0000","last_change":"2022-09-07T19:42:11.403357+0000","last_active":"2022-09-07T19:42:12.696352+0000","last_peered":"2022-09-07T19:42:12.696352+0000","last_clean":"2022-09-07T19:42:12.696352+0000","last_became_active":"2022-09-07T19:42:11.402903+0000","last_became_peered":"2022-09-07T19:42:11.402903+0000","last_unstale":"2022-09-07T19:42:12.696352+0000","last_undegraded":"2022-09-07T19:42:12.696352+0000","last_fullsized":"2022-09-07T19:42:12.696352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:52:19.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.096988+0000","last_change":"2022-09-07T19:42:06.358259+0000","last_active":"2022-09-07T19:42:12.096988+0000","last_peered":"2022-09-07T19:42:12.096988+0000","last_clean":"2022-09-07T19:42:12.096988+0000","last_became_active":"2022-09-07T19:42:06.357963+0000","last_became_peered":"2022-09-07T19:42:06.357963+0000","last_unstale":"2022-09-07T19:42:12.096988+0000","last_undegraded":"2022-09-07T19:42:12.096988+0000","last_fullsized":"2022-09-07T19:42:12.096988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:53:56.014702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385104+0000","last_change":"2022-09-07T19:42:06.942490+0000","last_active":"2022-09-07T19:42:11.385104+0000","last_peered":"2022-09-07T19:42:11.385104+0000","last_clean":"2022-09-07T19:42:11.385104+0000","last_became_active":"2022-09-07T19:42:06.942192+0000","last_became_peered":"2022-09-07T19:42:06.942192+0000","last_unstale":"2022-09-07T19:42:11.385104+0000","last_undegraded":"2022-09-07T19:42:11.385104+0000","last_fullsized":"2022-09-07T19:42:11.385104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:45:56.895458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.030674+0000","last_change":"2022-09-07T19:42:11.405272+0000","last_active":"2022-09-07T19:42:12.030674+0000","last_peered":"2022-09-07T19:42:12.030674+0000","last_clean":"2022-09-07T19:42:12.030674+0000","last_became_active":"2022-09-07T19:42:11.404883+0000","last_became_peered":"2022-09-07T19:42:11.404883+0000","last_unstale":"2022-09-07T19:42:12.030674+0000","last_undegraded":"2022-09-07T19:42:12.030674+0000","last_fullsized":"2022-09-07T19:42:12.030674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:30:29.469763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.388348+0000","last_change":"2022-09-07T19:42:06.358852+0000","last_active":"2022-09-07T19:42:11.388348+0000","last_peered":"2022-09-07T19:42:11.388348+0000","last_clean":"2022-09-07T19:42:11.388348+0000","last_became_active":"2022-09-07T19:42:06.358465+0000","last_became_peered":"2022-09-07T19:42:06.358465+0000","last_unstale":"2022-09-07T19:42:11.388348+0000","last_undegraded":"2022-09-07T19:42:11.388348+0000","last_fullsized":"2022-09-07T19:42:11.388348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:15:57.255952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387955+0000","last_change":"2022-09-07T19:42:06.941011+0000","last_active":"2022-09-07T19:42:11.387955+0000","last_peered":"2022-09-07T19:42:11.387955+0000","last_clean":"2022-09-07T19:42:11.387955+0000","last_became_active":"2022-09-07T19:42:06.940728+0000","last_became_peered":"2022-09-07T19:42:06.940728+0000","last_unstale":"2022-09-07T19:42:11.387955+0000","last_undegraded":"2022-09-07T19:42:11.387955+0000","last_fullsized":"2022-09-07T19:42:11.387955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:57:52.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.574099+0000","last_change":"2022-09-07T19:42:11.405383+0000","last_active":"2022-09-07T19:42:11.574099+0000","last_peered":"2022-09-07T19:42:11.574099+0000","last_clean":"2022-09-07T19:42:11.574099+0000","last_became_active":"2022-09-07T19:42:11.405021+0000","last_became_peered":"2022-09-07T19:42:11.405021+0000","last_unstale":"2022-09-07T19:42:11.574099+0000","last_undegraded":"2022-09-07T19:42:11.574099+0000","last_fullsized":"2022-09-07T19:42:11.574099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:24:30.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927609+0000","last_change":"2022-09-07T19:42:06.365791+0000","last_active":"2022-09-07T19:42:11.927609+0000","last_peered":"2022-09-07T19:42:11.927609+0000","last_clean":"2022-09-07T19:42:11.927609+0000","last_became_active":"2022-09-07T19:42:06.365471+0000","last_became_peered":"2022-09-07T19:42:06.365471+0000","last_unstale":"2022-09-07T19:42:11.927609+0000","last_undegraded":"2022-09-07T19:42:11.927609+0000","last_fullsized":"2022-09-07T19:42:11.927609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:38:03.735263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.387872+0000","last_change":"2022-09-07T19:42:06.951163+0000","last_active":"2022-09-07T19:42:11.387872+0000","last_peered":"2022-09-07T19:42:11.387872+0000","last_clean":"2022-09-07T19:42:11.387872+0000","last_became_active":"2022-09-07T19:42:06.950879+0000","last_became_peered":"2022-09-07T19:42:06.950879+0000","last_unstale":"2022-09-07T19:42:11.387872+0000","last_undegraded":"2022-09-07T19:42:11.387872+0000","last_fullsized":"2022-09-07T19:42:11.387872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:19:17.420880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.574174+0000","last_change":"2022-09-07T19:42:11.402397+0000","last_active":"2022-09-07T19:42:11.574174+0000","last_peered":"2022-09-07T19:42:11.574174+0000","last_clean":"2022-09-07T19:42:11.574174+0000","last_became_active":"2022-09-07T19:42:11.402036+0000","last_became_peered":"2022-09-07T19:42:11.402036+0000","last_unstale":"2022-09-07T19:42:11.574174+0000","last_undegraded":"2022-09-07T19:42:11.574174+0000","last_fullsized":"2022-09-07T19:42:11.574174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:42:53.158561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392161+0000","last_change":"2022-09-07T19:42:06.936405+0000","last_active":"2022-09-07T19:42:11.392161+0000","last_peered":"2022-09-07T19:42:11.392161+0000","last_clean":"2022-09-07T19:42:11.392161+0000","last_became_active":"2022-09-07T19:42:06.936125+0000","last_became_peered":"2022-09-07T19:42:06.936125+0000","last_unstale":"2022-09-07T19:42:11.392161+0000","last_undegraded":"2022-09-07T19:42:11.392161+0000","last_fullsized":"2022-09-07T19:42:11.392161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:47:33.002955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:40.524427+0000","last_change":"2022-09-07T19:42:06.372771+0000","last_active":"2022-09-07T19:42:40.524427+0000","last_peered":"2022-09-07T19:42:40.524427+0000","last_clean":"2022-09-07T19:42:40.524427+0000","last_became_active":"2022-09-07T19:42:06.372498+0000","last_became_peered":"2022-09-07T19:42:06.372498+0000","last_unstale":"2022-09-07T19:42:40.524427+0000","last_undegraded":"2022-09-07T19:42:40.524427+0000","last_fullsized":"2022-09-07T19:42:40.524427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:26:04.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927962+0000","last_change":"2022-09-07T19:42:11.410486+0000","last_active":"2022-09-07T19:42:11.927962+0000","last_peered":"2022-09-07T19:42:11.927962+0000","last_clean":"2022-09-07T19:42:11.927962+0000","last_became_active":"2022-09-07T19:42:11.410195+0000","last_became_peered":"2022-09-07T19:42:11.410195+0000","last_unstale":"2022-09-07T19:42:11.927962+0000","last_undegraded":"2022-09-07T19:42:11.927962+0000","last_fullsized":"2022-09-07T19:42:11.927962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:01:25.927536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.397440+0000","last_change":"2022-09-07T19:42:06.942040+0000","last_active":"2022-09-07T19:42:11.397440+0000","last_peered":"2022-09-07T19:42:11.397440+0000","last_clean":"2022-09-07T19:42:11.397440+0000","last_became_active":"2022-09-07T19:42:06.941732+0000","last_became_peered":"2022-09-07T19:42:06.941732+0000","last_unstale":"2022-09-07T19:42:11.397440+0000","last_undegraded":"2022-09-07T19:42:11.397440+0000","last_fullsized":"2022-09-07T19:42:11.397440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:05:56.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:38.515164+0000","last_change":"2022-09-07T19:42:06.361996+0000","last_active":"2022-09-07T19:42:38.515164+0000","last_peered":"2022-09-07T19:42:38.515164+0000","last_clean":"2022-09-07T19:42:38.515164+0000","last_became_active":"2022-09-07T19:42:06.361658+0000","last_became_peered":"2022-09-07T19:42:06.361658+0000","last_unstale":"2022-09-07T19:42:38.515164+0000","last_undegraded":"2022-09-07T19:42:38.515164+0000","last_fullsized":"2022-09-07T19:42:38.515164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:07:13.180501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":377,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392116+0000","last_change":"2022-09-07T19:40:58.352995+0000","last_active":"2022-09-07T19:42:11.392116+0000","last_peered":"2022-09-07T19:42:11.392116+0000","last_clean":"2022-09-07T19:42:11.392116+0000","last_became_active":"2022-09-07T19:40:58.352548+0000","last_became_peered":"2022-09-07T19:40:58.352548+0000","last_unstale":"2022-09-07T19:42:11.392116+0000","last_undegraded":"2022-09-07T19:42:11.392116+0000","last_fullsized":"2022-09-07T19:42:11.392116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_clean_scrub_stamp":"2022-09-07T19:37:12.654773+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:58:55.796726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696510+0000","last_change":"2022-09-07T19:42:11.404798+0000","last_active":"2022-09-07T19:42:12.696510+0000","last_peered":"2022-09-07T19:42:12.696510+0000","last_clean":"2022-09-07T19:42:12.696510+0000","last_became_active":"2022-09-07T19:42:11.404370+0000","last_became_peered":"2022-09-07T19:42:11.404370+0000","last_unstale":"2022-09-07T19:42:12.696510+0000","last_undegraded":"2022-09-07T19:42:12.696510+0000","last_fullsized":"2022-09-07T19:42:12.696510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:40.619684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392014+0000","last_change":"2022-09-07T19:42:06.943283+0000","last_active":"2022-09-07T19:42:11.392014+0000","last_peered":"2022-09-07T19:42:11.392014+0000","last_clean":"2022-09-07T19:42:11.392014+0000","last_became_active":"2022-09-07T19:42:06.942864+0000","last_became_peered":"2022-09-07T19:42:06.942864+0000","last_unstale":"2022-09-07T19:42:11.392014+0000","last_undegraded":"2022-09-07T19:42:11.392014+0000","last_fullsized":"2022-09-07T19:42:11.392014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:23.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.508311+0000","last_change":"2022-09-07T19:42:06.361341+0000","last_active":"2022-09-07T19:42:37.508311+0000","last_peered":"2022-09-07T19:42:37.508311+0000","last_clean":"2022-09-07T19:42:37.508311+0000","last_became_active":"2022-09-07T19:42:06.361008+0000","last_became_peered":"2022-09-07T19:42:06.361008+0000","last_unstale":"2022-09-07T19:42:37.508311+0000","last_undegraded":"2022-09-07T19:42:37.508311+0000","last_fullsized":"2022-09-07T19:42:37.508311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:08:54.850406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696187+0000","last_change":"2022-09-07T19:42:11.401991+0000","last_active":"2022-09-07T19:42:12.696187+0000","last_peered":"2022-09-07T19:42:12.696187+0000","last_clean":"2022-09-07T19:42:12.696187+0000","last_became_active":"2022-09-07T19:42:11.401129+0000","last_became_peered":"2022-09-07T19:42:11.401129+0000","last_unstale":"2022-09-07T19:42:12.696187+0000","last_undegraded":"2022-09-07T19:42:12.696187+0000","last_fullsized":"2022-09-07T19:42:12.696187+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:11:40.780758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.507449+0000","last_change":"2022-09-07T19:42:06.364282+0000","last_active":"2022-09-07T19:42:36.507449+0000","last_peered":"2022-09-07T19:42:36.507449+0000","last_clean":"2022-09-07T19:42:36.507449+0000","last_became_active":"2022-09-07T19:42:06.364004+0000","last_became_peered":"2022-09-07T19:42:06.364004+0000","last_unstale":"2022-09-07T19:42:36.507449+0000","last_undegraded":"2022-09-07T19:42:36.507449+0000","last_fullsized":"2022-09-07T19:42:36.507449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:16.489787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395908+0000","last_change":"2022-09-07T19:42:06.935556+0000","last_active":"2022-09-07T19:42:11.395908+0000","last_peered":"2022-09-07T19:42:11.395908+0000","last_clean":"2022-09-07T19:42:11.395908+0000","last_became_active":"2022-09-07T19:42:06.935277+0000","last_became_peered":"2022-09-07T19:42:06.935277+0000","last_unstale":"2022-09-07T19:42:11.395908+0000","last_undegraded":"2022-09-07T19:42:11.395908+0000","last_fullsized":"2022-09-07T19:42:11.395908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:52:27.506947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.446499+0000","last_change":"2022-09-07T19:42:11.402833+0000","last_active":"2022-09-07T19:42:12.446499+0000","last_peered":"2022-09-07T19:42:12.446499+0000","last_clean":"2022-09-07T19:42:12.446499+0000","last_became_active":"2022-09-07T19:42:11.402478+0000","last_became_peered":"2022-09-07T19:42:11.402478+0000","last_unstale":"2022-09-07T19:42:12.446499+0000","last_undegraded":"2022-09-07T19:42:12.446499+0000","last_fullsized":"2022-09-07T19:42:12.446499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:58:50.474580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511576+0000","last_change":"2022-09-07T19:42:06.369761+0000","last_active":"2022-09-07T19:42:37.511576+0000","last_peered":"2022-09-07T19:42:37.511576+0000","last_clean":"2022-09-07T19:42:37.511576+0000","last_became_active":"2022-09-07T19:42:06.369366+0000","last_became_peered":"2022-09-07T19:42:06.369366+0000","last_unstale":"2022-09-07T19:42:37.511576+0000","last_undegraded":"2022-09-07T19:42:37.511576+0000","last_fullsized":"2022-09-07T19:42:37.511576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:58.993644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.398303+0000","last_change":"2022-09-07T19:42:06.939822+0000","last_active":"2022-09-07T19:42:11.398303+0000","last_peered":"2022-09-07T19:42:11.398303+0000","last_clean":"2022-09-07T19:42:11.398303+0000","last_became_active":"2022-09-07T19:42:06.939515+0000","last_became_peered":"2022-09-07T19:42:06.939515+0000","last_unstale":"2022-09-07T19:42:11.398303+0000","last_undegraded":"2022-09-07T19:42:11.398303+0000","last_fullsized":"2022-09-07T19:42:11.398303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:32:15.696524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927284+0000","last_change":"2022-09-07T19:42:11.401085+0000","last_active":"2022-09-07T19:42:11.927284+0000","last_peered":"2022-09-07T19:42:11.927284+0000","last_clean":"2022-09-07T19:42:11.927284+0000","last_became_active":"2022-09-07T19:42:11.400594+0000","last_became_peered":"2022-09-07T19:42:11.400594+0000","last_unstale":"2022-09-07T19:42:11.927284+0000","last_undegraded":"2022-09-07T19:42:11.927284+0000","last_fullsized":"2022-09-07T19:42:11.927284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:44:52.837616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508875+0000","last_change":"2022-09-07T19:42:06.365721+0000","last_active":"2022-09-07T19:42:36.508875+0000","last_peered":"2022-09-07T19:42:36.508875+0000","last_clean":"2022-09-07T19:42:36.508875+0000","last_became_active":"2022-09-07T19:42:06.365388+0000","last_became_peered":"2022-09-07T19:42:06.365388+0000","last_unstale":"2022-09-07T19:42:36.508875+0000","last_undegraded":"2022-09-07T19:42:36.508875+0000","last_fullsized":"2022-09-07T19:42:36.508875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:51:57.432567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.391059+0000","last_change":"2022-09-07T19:42:06.959467+0000","last_active":"2022-09-07T19:42:11.391059+0000","last_peered":"2022-09-07T19:42:11.391059+0000","last_clean":"2022-09-07T19:42:11.391059+0000","last_became_active":"2022-09-07T19:42:06.959165+0000","last_became_peered":"2022-09-07T19:42:06.959165+0000","last_unstale":"2022-09-07T19:42:11.391059+0000","last_undegraded":"2022-09-07T19:42:11.391059+0000","last_fullsized":"2022-09-07T19:42:11.391059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:45:54.697717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.414611+0000","last_change":"2022-09-07T19:42:11.414077+0000","last_active":"2022-09-07T19:42:11.414611+0000","last_peered":"2022-09-07T19:42:11.414611+0000","last_clean":"2022-09-07T19:42:11.414611+0000","last_became_active":"2022-09-07T19:42:11.413611+0000","last_became_peered":"2022-09-07T19:42:11.413611+0000","last_unstale":"2022-09-07T19:42:11.414611+0000","last_undegraded":"2022-09-07T19:42:11.414611+0000","last_fullsized":"2022-09-07T19:42:11.414611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:28:23.166148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508469+0000","last_change":"2022-09-07T19:42:06.359443+0000","last_active":"2022-09-07T19:42:36.508469+0000","last_peered":"2022-09-07T19:42:36.508469+0000","last_clean":"2022-09-07T19:42:36.508469+0000","last_became_active":"2022-09-07T19:42:06.359095+0000","last_became_peered":"2022-09-07T19:42:06.359095+0000","last_unstale":"2022-09-07T19:42:36.508469+0000","last_undegraded":"2022-09-07T19:42:36.508469+0000","last_fullsized":"2022-09-07T19:42:36.508469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:36:01.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.389445+0000","last_change":"2022-09-07T19:42:06.933410+0000","last_active":"2022-09-07T19:42:11.389445+0000","last_peered":"2022-09-07T19:42:11.389445+0000","last_clean":"2022-09-07T19:42:11.389445+0000","last_became_active":"2022-09-07T19:42:06.933092+0000","last_became_peered":"2022-09-07T19:42:06.933092+0000","last_unstale":"2022-09-07T19:42:11.389445+0000","last_undegraded":"2022-09-07T19:42:11.389445+0000","last_fullsized":"2022-09-07T19:42:11.389445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:39:51.700247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927287+0000","last_change":"2022-09-07T19:42:11.409290+0000","last_active":"2022-09-07T19:42:11.927287+0000","last_peered":"2022-09-07T19:42:11.927287+0000","last_clean":"2022-09-07T19:42:11.927287+0000","last_became_active":"2022-09-07T19:42:11.408883+0000","last_became_peered":"2022-09-07T19:42:11.408883+0000","last_unstale":"2022-09-07T19:42:11.927287+0000","last_undegraded":"2022-09-07T19:42:11.927287+0000","last_fullsized":"2022-09-07T19:42:11.927287+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:51:39.640794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.508618+0000","last_change":"2022-09-07T19:42:06.377191+0000","last_active":"2022-09-07T19:42:36.508618+0000","last_peered":"2022-09-07T19:42:36.508618+0000","last_clean":"2022-09-07T19:42:36.508618+0000","last_became_active":"2022-09-07T19:42:06.376437+0000","last_became_peered":"2022-09-07T19:42:06.376437+0000","last_unstale":"2022-09-07T19:42:36.508618+0000","last_undegraded":"2022-09-07T19:42:36.508618+0000","last_fullsized":"2022-09-07T19:42:36.508618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:53:44.874088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.384886+0000","last_change":"2022-09-07T19:42:06.954380+0000","last_active":"2022-09-07T19:42:11.384886+0000","last_peered":"2022-09-07T19:42:11.384886+0000","last_clean":"2022-09-07T19:42:11.384886+0000","last_became_active":"2022-09-07T19:42:06.954206+0000","last_became_peered":"2022-09-07T19:42:06.954206+0000","last_unstale":"2022-09-07T19:42:11.384886+0000","last_undegraded":"2022-09-07T19:42:11.384886+0000","last_fullsized":"2022-09-07T19:42:11.384886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:49:23.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.165560+0000","last_change":"2022-09-07T19:42:11.412101+0000","last_active":"2022-09-07T19:42:12.165560+0000","last_peered":"2022-09-07T19:42:12.165560+0000","last_clean":"2022-09-07T19:42:12.165560+0000","last_became_active":"2022-09-07T19:42:11.411528+0000","last_became_peered":"2022-09-07T19:42:11.411528+0000","last_unstale":"2022-09-07T19:42:12.165560+0000","last_undegraded":"2022-09-07T19:42:12.165560+0000","last_fullsized":"2022-09-07T19:42:12.165560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:51:28.248093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.927458+0000","last_change":"2022-09-07T19:42:06.358321+0000","last_active":"2022-09-07T19:42:11.927458+0000","last_peered":"2022-09-07T19:42:11.927458+0000","last_clean":"2022-09-07T19:42:11.927458+0000","last_became_active":"2022-09-07T19:42:06.358016+0000","last_became_peered":"2022-09-07T19:42:06.358016+0000","last_unstale":"2022-09-07T19:42:11.927458+0000","last_undegraded":"2022-09-07T19:42:11.927458+0000","last_fullsized":"2022-09-07T19:42:11.927458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:44:23.140211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.397729+0000","last_change":"2022-09-07T19:42:06.954601+0000","last_active":"2022-09-07T19:42:11.397729+0000","last_peered":"2022-09-07T19:42:11.397729+0000","last_clean":"2022-09-07T19:42:11.397729+0000","last_became_active":"2022-09-07T19:42:06.954220+0000","last_became_peered":"2022-09-07T19:42:06.954220+0000","last_unstale":"2022-09-07T19:42:11.397729+0000","last_undegraded":"2022-09-07T19:42:11.397729+0000","last_fullsized":"2022-09-07T19:42:11.397729+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:21.042536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.407074+0000","last_change":"2022-09-07T19:42:11.406496+0000","last_active":"2022-09-07T19:42:11.407074+0000","last_peered":"2022-09-07T19:42:11.407074+0000","last_clean":"2022-09-07T19:42:11.407074+0000","last_became_active":"2022-09-07T19:42:11.406097+0000","last_became_peered":"2022-09-07T19:42:11.406097+0000","last_unstale":"2022-09-07T19:42:11.407074+0000","last_undegraded":"2022-09-07T19:42:11.407074+0000","last_fullsized":"2022-09-07T19:42:11.407074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:19.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:36.507451+0000","last_change":"2022-09-07T19:42:06.357410+0000","last_active":"2022-09-07T19:42:36.507451+0000","last_peered":"2022-09-07T19:42:36.507451+0000","last_clean":"2022-09-07T19:42:36.507451+0000","last_became_active":"2022-09-07T19:42:06.357016+0000","last_became_peered":"2022-09-07T19:42:06.357016+0000","last_unstale":"2022-09-07T19:42:36.507451+0000","last_undegraded":"2022-09-07T19:42:36.507451+0000","last_fullsized":"2022-09-07T19:42:36.507451+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:10:30.657678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392626+0000","last_change":"2022-09-07T19:42:06.944746+0000","last_active":"2022-09-07T19:42:11.392626+0000","last_peered":"2022-09-07T19:42:11.392626+0000","last_clean":"2022-09-07T19:42:11.392626+0000","last_became_active":"2022-09-07T19:42:06.944324+0000","last_became_peered":"2022-09-07T19:42:06.944324+0000","last_unstale":"2022-09-07T19:42:11.392626+0000","last_undegraded":"2022-09-07T19:42:11.392626+0000","last_fullsized":"2022-09-07T19:42:11.392626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:20:56.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696608+0000","last_change":"2022-09-07T19:42:11.405830+0000","last_active":"2022-09-07T19:42:12.696608+0000","last_peered":"2022-09-07T19:42:12.696608+0000","last_clean":"2022-09-07T19:42:12.696608+0000","last_became_active":"2022-09-07T19:42:11.405375+0000","last_became_peered":"2022-09-07T19:42:11.405375+0000","last_unstale":"2022-09-07T19:42:12.696608+0000","last_undegraded":"2022-09-07T19:42:12.696608+0000","last_fullsized":"2022-09-07T19:42:12.696608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:30:43.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:37.511224+0000","last_change":"2022-09-07T19:42:06.359635+0000","last_active":"2022-09-07T19:42:37.511224+0000","last_peered":"2022-09-07T19:42:37.511224+0000","last_clean":"2022-09-07T19:42:37.511224+0000","last_became_active":"2022-09-07T19:42:06.359349+0000","last_became_peered":"2022-09-07T19:42:06.359349+0000","last_unstale":"2022-09-07T19:42:37.511224+0000","last_undegraded":"2022-09-07T19:42:37.511224+0000","last_fullsized":"2022-09-07T19:42:37.511224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:56.282670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396137+0000","last_change":"2022-09-07T19:42:06.948313+0000","last_active":"2022-09-07T19:42:11.396137+0000","last_peered":"2022-09-07T19:42:11.396137+0000","last_clean":"2022-09-07T19:42:11.396137+0000","last_became_active":"2022-09-07T19:42:06.948008+0000","last_became_peered":"2022-09-07T19:42:06.948008+0000","last_unstale":"2022-09-07T19:42:11.396137+0000","last_undegraded":"2022-09-07T19:42:11.396137+0000","last_fullsized":"2022-09-07T19:42:11.396137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:39:30.575085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.791943+0000","last_change":"2022-09-07T19:42:11.413042+0000","last_active":"2022-09-07T19:42:12.791943+0000","last_peered":"2022-09-07T19:42:12.791943+0000","last_clean":"2022-09-07T19:42:12.791943+0000","last_became_active":"2022-09-07T19:42:11.412658+0000","last_became_peered":"2022-09-07T19:42:11.412658+0000","last_unstale":"2022-09-07T19:42:12.791943+0000","last_undegraded":"2022-09-07T19:42:12.791943+0000","last_fullsized":"2022-09-07T19:42:12.791943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:33:41.892522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.696928+0000","last_change":"2022-09-07T19:42:06.376394+0000","last_active":"2022-09-07T19:42:12.696928+0000","last_peered":"2022-09-07T19:42:12.696928+0000","last_clean":"2022-09-07T19:42:12.696928+0000","last_became_active":"2022-09-07T19:42:06.376141+0000","last_became_peered":"2022-09-07T19:42:06.376141+0000","last_unstale":"2022-09-07T19:42:12.696928+0000","last_undegraded":"2022-09-07T19:42:12.696928+0000","last_fullsized":"2022-09-07T19:42:12.696928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:40:00.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395864+0000","last_change":"2022-09-07T19:42:06.937730+0000","last_active":"2022-09-07T19:42:11.395864+0000","last_peered":"2022-09-07T19:42:11.395864+0000","last_clean":"2022-09-07T19:42:11.395864+0000","last_became_active":"2022-09-07T19:42:06.937387+0000","last_became_peered":"2022-09-07T19:42:06.937387+0000","last_unstale":"2022-09-07T19:42:11.395864+0000","last_undegraded":"2022-09-07T19:42:11.395864+0000","last_fullsized":"2022-09-07T19:42:11.395864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:22:04.045843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2022-09-07T19:42:12.695610+0000","last_change":"2022-09-07T19:42:11.403846+0000","last_active":"2022-09-07T19:42:12.695610+0000","last_peered":"2022-09-07T19:42:12.695610+0000","last_clean":"2022-09-07T19:42:12.695610+0000","last_became_active":"2022-09-07T19:42:11.403096+0000","last_became_peered":"2022-09-07T19:42:11.403096+0000","last_unstale":"2022-09-07T19:42:12.695610+0000","last_undegraded":"2022-09-07T19:42:12.695610+0000","last_fullsized":"2022-09-07T19:42:12.695610+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:37:41.081199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393924+0000","last_change":"2022-09-07T19:42:06.378938+0000","last_active":"2022-09-07T19:42:11.393924+0000","last_peered":"2022-09-07T19:42:11.393924+0000","last_clean":"2022-09-07T19:42:11.393924+0000","last_became_active":"2022-09-07T19:42:06.378545+0000","last_became_peered":"2022-09-07T19:42:06.378545+0000","last_unstale":"2022-09-07T19:42:11.393924+0000","last_undegraded":"2022-09-07T19:42:11.393924+0000","last_fullsized":"2022-09-07T19:42:11.393924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:53.904515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395964+0000","last_change":"2022-09-07T19:42:06.936282+0000","last_active":"2022-09-07T19:42:11.395964+0000","last_peered":"2022-09-07T19:42:11.395964+0000","last_clean":"2022-09-07T19:42:11.395964+0000","last_became_active":"2022-09-07T19:42:06.935916+0000","last_became_peered":"2022-09-07T19:42:06.935916+0000","last_unstale":"2022-09-07T19:42:11.395964+0000","last_undegraded":"2022-09-07T19:42:11.395964+0000","last_fullsized":"2022-09-07T19:42:11.395964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:53:06.657196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.384928+0000","last_change":"2022-09-07T19:42:06.938195+0000","last_active":"2022-09-07T19:42:11.384928+0000","last_peered":"2022-09-07T19:42:11.384928+0000","last_clean":"2022-09-07T19:42:11.384928+0000","last_became_active":"2022-09-07T19:42:06.937916+0000","last_became_peered":"2022-09-07T19:42:06.937916+0000","last_unstale":"2022-09-07T19:42:11.384928+0000","last_undegraded":"2022-09-07T19:42:11.384928+0000","last_fullsized":"2022-09-07T19:42:11.384928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:22:43.390552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.397496+0000","last_change":"2022-09-07T19:42:06.940303+0000","last_active":"2022-09-07T19:42:11.397496+0000","last_peered":"2022-09-07T19:42:11.397496+0000","last_clean":"2022-09-07T19:42:11.397496+0000","last_became_active":"2022-09-07T19:42:06.939974+0000","last_became_peered":"2022-09-07T19:42:06.939974+0000","last_unstale":"2022-09-07T19:42:11.397496+0000","last_undegraded":"2022-09-07T19:42:11.397496+0000","last_fullsized":"2022-09-07T19:42:11.397496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:36:37.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392222+0000","last_change":"2022-09-07T19:42:06.948849+0000","last_active":"2022-09-07T19:42:11.392222+0000","last_peered":"2022-09-07T19:42:11.392222+0000","last_clean":"2022-09-07T19:42:11.392222+0000","last_became_active":"2022-09-07T19:42:06.948263+0000","last_became_peered":"2022-09-07T19:42:06.948263+0000","last_unstale":"2022-09-07T19:42:11.392222+0000","last_undegraded":"2022-09-07T19:42:11.392222+0000","last_fullsized":"2022-09-07T19:42:11.392222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:33:26.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392027+0000","last_change":"2022-09-07T19:42:06.957145+0000","last_active":"2022-09-07T19:42:11.392027+0000","last_peered":"2022-09-07T19:42:11.392027+0000","last_clean":"2022-09-07T19:42:11.392027+0000","last_became_active":"2022-09-07T19:42:06.956769+0000","last_became_peered":"2022-09-07T19:42:06.956769+0000","last_unstale":"2022-09-07T19:42:11.392027+0000","last_undegraded":"2022-09-07T19:42:11.392027+0000","last_fullsized":"2022-09-07T19:42:11.392027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:51:09.154847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395998+0000","last_change":"2022-09-07T19:42:06.954543+0000","last_active":"2022-09-07T19:42:11.395998+0000","last_peered":"2022-09-07T19:42:11.395998+0000","last_clean":"2022-09-07T19:42:11.395998+0000","last_became_active":"2022-09-07T19:42:06.954229+0000","last_became_peered":"2022-09-07T19:42:06.954229+0000","last_unstale":"2022-09-07T19:42:11.395998+0000","last_undegraded":"2022-09-07T19:42:11.395998+0000","last_fullsized":"2022-09-07T19:42:11.395998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:55:48.612830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385125+0000","last_change":"2022-09-07T19:42:06.937808+0000","last_active":"2022-09-07T19:42:11.385125+0000","last_peered":"2022-09-07T19:42:11.385125+0000","last_clean":"2022-09-07T19:42:11.385125+0000","last_became_active":"2022-09-07T19:42:06.937452+0000","last_became_peered":"2022-09-07T19:42:06.937452+0000","last_unstale":"2022-09-07T19:42:11.385125+0000","last_undegraded":"2022-09-07T19:42:11.385125+0000","last_fullsized":"2022-09-07T19:42:11.385125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:56:19.296497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.396244+0000","last_change":"2022-09-07T19:42:06.939519+0000","last_active":"2022-09-07T19:42:11.396244+0000","last_peered":"2022-09-07T19:42:11.396244+0000","last_clean":"2022-09-07T19:42:11.396244+0000","last_became_active":"2022-09-07T19:42:06.939171+0000","last_became_peered":"2022-09-07T19:42:06.939171+0000","last_unstale":"2022-09-07T19:42:11.396244+0000","last_undegraded":"2022-09-07T19:42:11.396244+0000","last_fullsized":"2022-09-07T19:42:11.396244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:12:30.663072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.398396+0000","last_change":"2022-09-07T19:42:06.939331+0000","last_active":"2022-09-07T19:42:11.398396+0000","last_peered":"2022-09-07T19:42:11.398396+0000","last_clean":"2022-09-07T19:42:11.398396+0000","last_became_active":"2022-09-07T19:42:06.939034+0000","last_became_peered":"2022-09-07T19:42:06.939034+0000","last_unstale":"2022-09-07T19:42:11.398396+0000","last_undegraded":"2022-09-07T19:42:11.398396+0000","last_fullsized":"2022-09-07T19:42:11.398396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:14:24.794753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.392377+0000","last_change":"2022-09-07T19:42:06.934403+0000","last_active":"2022-09-07T19:42:11.392377+0000","last_peered":"2022-09-07T19:42:11.392377+0000","last_clean":"2022-09-07T19:42:11.392377+0000","last_became_active":"2022-09-07T19:42:06.934031+0000","last_became_peered":"2022-09-07T19:42:06.934031+0000","last_unstale":"2022-09-07T19:42:11.392377+0000","last_undegraded":"2022-09-07T19:42:11.392377+0000","last_fullsized":"2022-09-07T19:42:11.392377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:44:44.491011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.395716+0000","last_change":"2022-09-07T19:42:06.940112+0000","last_active":"2022-09-07T19:42:11.395716+0000","last_peered":"2022-09-07T19:42:11.395716+0000","last_clean":"2022-09-07T19:42:11.395716+0000","last_became_active":"2022-09-07T19:42:06.939734+0000","last_became_peered":"2022-09-07T19:42:06.939734+0000","last_unstale":"2022-09-07T19:42:11.395716+0000","last_undegraded":"2022-09-07T19:42:11.395716+0000","last_fullsized":"2022-09-07T19:42:11.395716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:17:34.201649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.394343+0000","last_change":"2022-09-07T19:42:06.945504+0000","last_active":"2022-09-07T19:42:11.394343+0000","last_peered":"2022-09-07T19:42:11.394343+0000","last_clean":"2022-09-07T19:42:11.394343+0000","last_became_active":"2022-09-07T19:42:06.945194+0000","last_became_peered":"2022-09-07T19:42:06.945194+0000","last_unstale":"2022-09-07T19:42:11.394343+0000","last_undegraded":"2022-09-07T19:42:11.394343+0000","last_fullsized":"2022-09-07T19:42:11.394343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:54:10.526721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.393627+0000","last_change":"2022-09-07T19:42:06.953952+0000","last_active":"2022-09-07T19:42:11.393627+0000","last_peered":"2022-09-07T19:42:11.393627+0000","last_clean":"2022-09-07T19:42:11.393627+0000","last_became_active":"2022-09-07T19:42:06.953594+0000","last_became_peered":"2022-09-07T19:42:06.953594+0000","last_unstale":"2022-09-07T19:42:11.393627+0000","last_undegraded":"2022-09-07T19:42:11.393627+0000","last_fullsized":"2022-09-07T19:42:11.393627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:52:15.188770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2022-09-07T19:42:11.385233+0000","last_change":"2022-09-07T19:42:06.943804+0000","last_active":"2022-09-07T19:42:11.385233+0000","last_peered":"2022-09-07T19:42:11.385233+0000","last_clean":"2022-09-07T19:42:11.385233+0000","last_became_active":"2022-09-07T19:42:06.943499+0000","last_became_peered":"2022-09-07T19:42:06.943499+0000","last_unstale":"2022-09-07T19:42:11.385233+0000","last_undegraded":"2022-09-07T19:42:11.385233+0000","last_fullsized":"2022-09-07T19:42:11.385233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:20.646159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":20480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281075,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":29902,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":36,"num_read_kb":54,"num_write":139,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":81085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6076,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739076,"statfs":{"total":95995035648,"available":95988813824,"internally_reserved":0,"allocated":970752,"data_stored":480149,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.505},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.442}]},{"osd":1,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59799999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.68899999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":9,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72199999999999998}]},{"osd":10,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68000000000000005}]}]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6364,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738788,"statfs":{"total":95995035648,"available":95988518912,"internally_reserved":0,"allocated":1069056,"data_stored":1088492,"data_compressed":47426,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69799999999999995}]},{"osd":4,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75800000000000001}]},{"osd":9,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.85999999999999999}]},{"osd":11,"last update":"Wed Sep 7 19:42:20 2022","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.878},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.84199999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6216,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738936,"statfs":{"total":95995035648,"available":95988670464,"internally_reserved":0,"allocated":983040,"data_stored":476289,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69299999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.746}]},{"osd":2,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90700000000000003,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98899999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76800000000000002},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89500000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94099999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.621},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80700000000000005,"15min":0.81499999999999995},"min":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.89200000000000002,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.85399999999999998,"15min":0.876},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94199999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.86299999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.76200000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.753}]},{"osd":7,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.98499999999999999,"5min":1.599,"15min":1.599},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.93899999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.95299999999999996,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.86099999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.98799999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0589999999999999,"5min":1.357,"15min":1.357},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.96499999999999997,"15min":0.98899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.03,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.751}]},{"osd":10,"last update":"Wed Sep 7 19:41:56 2022","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6348,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738804,"statfs":{"total":95995035648,"available":95988535296,"internally_reserved":0,"allocated":987136,"data_stored":480305,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76100000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.497},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.55200000000000005},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64000000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.69799999999999995}]},{"osd":2,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.54200000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56799999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82299999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.623}]},{"osd":4,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40600000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.872}]},{"osd":5,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61499999999999999,"5min":0.874,"15min":0.874},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55400000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.748}]},{"osd":6,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78700000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.996,"5min":1.026,"15min":1.026},"last":0.78400000000000003}]},{"osd":7,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76300000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.80100000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.83199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6448,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738704,"statfs":{"total":95995035648,"available":95988432896,"internally_reserved":0,"allocated":1024000,"data_stored":1066995,"data_compressed":47426,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:35 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42099999999999999,"15min":0.41099999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53100000000000003,"5min":1.097,"15min":1.097},"last":0.38},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.623,"5min":0.748,"15min":0.748},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.58499999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68899999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.495},{"interface":"front","average":{"1min":0.443,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.752,"15min":1.752},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.78,"15min":1.78},"last":0.72299999999999998}]},{"osd":6,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65600000000000003}]},{"osd":8,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.57999999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.57999999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77700000000000002}]},{"osd":9,"last update":"Wed Sep 7 19:42:34 2022","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68100000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.627}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495662,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6328,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738824,"statfs":{"total":95995035648,"available":95988555776,"internally_reserved":0,"allocated":966656,"data_stored":475577,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.44600000000000001},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70299999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.41399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63200000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":0.996,"15min":0.996},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97099999999999997,"5min":1.073,"15min":1.073},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0129999999999999,"5min":1.097,"15min":1.097},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.52900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Sep 7 19:42:38 2022","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.626}]},{"osd":8,"last update":"Wed Sep 7 19:42:02 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.754},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.627,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.054,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59599999999999997}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.141,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.032},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84499999999999997}]},{"osd":10,"last update":"Wed Sep 7 19:41:58 2022","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.92300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7232,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737920,"statfs":{"total":95995035648,"available":95987630080,"internally_reserved":0,"allocated":974848,"data_stored":479236,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:58 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55600000000000005,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.877,"5min":1.04,"15min":1.04},"last":0.497}]},{"osd":2,"last update":"Wed Sep 7 19:42:24 2022","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Sep 7 19:41:50 2022","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91400000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.65700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.40400000000000003},"min":{"1min":0.26200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Sep 7 19:42:10 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":1.107,"15min":1.107},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85499999999999998,"5min":0.875,"15min":0.875},"last":0.65800000000000003}]},{"osd":8,"last update":"Wed Sep 7 19:41:58 2022","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81299999999999994}]},{"osd":9,"last update":"Wed Sep 7 19:42:31 2022","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.747,"15min":0.749},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.069,"15min":1.069},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94399999999999995,"5min":1.056,"15min":1.056},"last":0.76300000000000001}]},{"osd":10,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.753},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.77200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7232,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737920,"statfs":{"total":95995035648,"available":95987630080,"internally_reserved":0,"allocated":974848,"data_stored":476165,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 7 19:41:59 2022","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.88500000000000001,"5min":1.77,"15min":1.77},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.86899999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:42:21 2022","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82099999999999995,"5min":1.036,"15min":1.036},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82199999999999995,"5min":1.903,"15min":1.903},"last":0.96399999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:40:50 2022","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78900000000000003,"5min":1.841,"15min":1.841},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94099999999999995,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.244,"15min":1.244},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86099999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Sep 7 19:41:38 2022","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1759999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.69299999999999995},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.88800000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:42:07 2022","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.004,"5min":1.337,"15min":1.337},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":1.042,"15min":1.042},"last":0.70999999999999996}]},{"osd":7,"last update":"Wed Sep 7 19:41:38 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.0069999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:41:59 2022","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.92800000000000005}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1299999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.127,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83799999999999997}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.96799999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:42:18 2022","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.98299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7420,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737732,"statfs":{"total":95995035648,"available":95987437568,"internally_reserved":0,"allocated":1036288,"data_stored":516882,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.42799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79500000000000004,"5min":1.113,"15min":1.113},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81299999999999994,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":2.117,"15min":2.117},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:42:00 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.624},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Sep 7 19:41:12 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.374,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Sep 7 19:42:08 2022","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.754,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 7 19:41:33 2022","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.82499999999999996}]},{"osd":8,"last update":"Wed Sep 7 19:42:00 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.84399999999999997}]},{"osd":9,"last update":"Wed Sep 7 19:42:30 2022","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2},"last":0.69199999999999995}]},{"osd":10,"last update":"Wed Sep 7 19:42:00 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6656,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738496,"statfs":{"total":95995035648,"available":95988219904,"internally_reserved":0,"allocated":974848,"data_stored":475448,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:54 2022","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.436,"15min":0.40999999999999998},"min":{"1min":0.33600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.103,"5min":1.111,"15min":1.111},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed Sep 7 19:41:54 2022","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.49299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89000000000000001,"5min":1.03,"15min":1.03},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.621,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":1.018,"15min":1.018},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:41:54 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67700000000000005,"15min":0.64800000000000002},"min":{"1min":0.61099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.038,"5min":1.288,"15min":1.288},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.46700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Sep 7 19:42:12 2022","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.62},"min":{"1min":0.51300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.746},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.64100000000000001},"min":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Sep 7 19:41:38 2022","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.55100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.63300000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90100000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:42:12 2022","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.93700000000000006,"5min":1.115,"15min":1.115},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91900000000000004,"5min":0.999,"15min":0.999},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Sep 7 19:42:36 2022","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.76600000000000001,"15min":0.73499999999999999},"min":{"1min":0.67500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0529999999999999,"5min":1.173,"15min":1.173},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.61599999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.97499999999999998,"5min":1.075,"15min":1.075},"last":0.80700000000000005}]},{"osd":8,"last update":"Wed Sep 7 19:42:01 2022","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.879}]},{"osd":9,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.91800000000000004,"15min":0.92300000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.1819999999999999,"5min":1.204,"15min":1.204},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.089,"5min":1.143,"15min":1.143},"last":0.67200000000000004}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.016}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6464,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738688,"statfs":{"total":95995035648,"available":95988416512,"internally_reserved":0,"allocated":974848,"data_stored":476476,"data_compressed":11674,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:16 2022","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53800000000000003},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.36499999999999999,"15min":0.34399999999999997},"min":{"1min":0.312,"5min":0.192,"15min":0.192},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.38200000000000001,"15min":0.35999999999999999},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.61899999999999999,"5min":0.753,"15min":0.753},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.4779999999999998,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53900000000000003,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.58499999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed Sep 7 19:41:40 2022","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Sep 7 19:42:17 2022","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.90200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83799999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.752}]},{"osd":7,"last update":"Wed Sep 7 19:41:40 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70699999999999996}]},{"osd":8,"last update":"Wed Sep 7 19:42:01 2022","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.51900000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73699999999999999}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.879,"5min":0.999,"15min":0.999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89900000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77200000000000002}]},{"osd":10,"last update":"Wed Sep 7 19:41:55 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6660,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738492,"statfs":{"total":95995035648,"available":95988215808,"internally_reserved":0,"allocated":1044480,"data_stored":1071756,"data_compressed":47426,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.505}]},{"osd":1,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72999999999999998,"5min":0.754,"15min":0.754},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":1.097},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.53000000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77100000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Sep 7 19:41:37 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66700000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:42:11 2022","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:41:56 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.498}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.69799999999999995}]},{"osd":10,"last update":"Wed Sep 7 19:41:56 2022","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":41395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-07T19:42:42.614 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-09-07T19:42:42.615 INFO:tasks.cephadm:Setting up client nodes... 2022-09-07T19:42:42.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2022-09-07T19:42:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/241687360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]: dispatch 2022-09-07T19:42:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2022-09-07T19:42:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2022-09-07T19:42:42.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2022-09-07T19:42:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2022-09-07T19:42:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2022-09-07T19:42:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2022-09-07T19:42:42.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2022-09-07T19:42:42.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2022-09-07T19:42:42.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:42:42.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:42:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/241687360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:42.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]: dispatch 2022-09-07T19:42:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2022-09-07T19:42:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2022-09-07T19:42:42.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2022-09-07T19:42:42.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2022-09-07T19:42:42.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2022-09-07T19:42:42.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2022-09-07T19:42:42.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2022-09-07T19:42:42.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2022-09-07T19:42:42.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:42:42.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:42:42.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/241687360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]: dispatch 2022-09-07T19:42:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2022-09-07T19:42:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2022-09-07T19:42:42.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2022-09-07T19:42:42.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2022-09-07T19:42:42.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2022-09-07T19:42:42.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2022-09-07T19:42:42.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2022-09-07T19:42:42.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2022-09-07T19:42:42.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:42:42.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:42:43.516 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:43.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: pgmap v319: 129 pgs: 129 active+clean; 605 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2022-09-07T19:42:43.833 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:42:43.833 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2022-09-07T19:42:43.833 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2022-09-07T19:42:43.834 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2022-09-07T19:42:43.834 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2022-09-07T19:42:43.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2022-09-07T19:42:43.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2022-09-07T19:42:43.836 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2022-09-07T19:42:43.836 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2022-09-07T19:42:43.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2022-09-07T19:42:43.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: osdmap e90: 12 total, 12 up, 12 in 2022-09-07T19:42:43.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:43 smithi080 ceph-mon[90124]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:42:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: pgmap v319: 129 pgs: 129 active+clean; 605 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2022-09-07T19:42:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:42:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2022-09-07T19:42:43.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2022-09-07T19:42:43.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2022-09-07T19:42:43.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2022-09-07T19:42:43.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2022-09-07T19:42:43.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2022-09-07T19:42:43.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2022-09-07T19:42:43.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2022-09-07T19:42:43.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2022-09-07T19:42:43.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: osdmap e90: 12 total, 12 up, 12 in 2022-09-07T19:42:43.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:43 smithi154 ceph-mon[96967]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:42:43.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: pgmap v319: 129 pgs: 129 active+clean; 605 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2022-09-07T19:42:43.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:42:43.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2022-09-07T19:42:43.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2022-09-07T19:42:43.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2022-09-07T19:42:43.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2022-09-07T19:42:43.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2022-09-07T19:42:43.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2022-09-07T19:42:43.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2022-09-07T19:42:43.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2022-09-07T19:42:43.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2022-09-07T19:42:43.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: osdmap e90: 12 total, 12 up, 12 in 2022-09-07T19:42:43.949 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:43 smithi155 ceph-mon[97606]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:42:44.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:44 smithi080 ceph-mon[90124]: osdmap e91: 12 total, 12 up, 12 in 2022-09-07T19:42:44.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:44 smithi154 ceph-mon[96967]: osdmap e91: 12 total, 12 up, 12 in 2022-09-07T19:42:44.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:44 smithi155 ceph-mon[97606]: osdmap e91: 12 total, 12 up, 12 in 2022-09-07T19:42:45.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.191+0000 7f065d669700 1 -- 172.21.15.80:0/2795007663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 msgr2=0x7f0658105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:45.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.191+0000 7f065d669700 1 --2- 172.21.15.80:0/2795007663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658105720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f064c009810 tx=0x7f064c009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:45.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 -- 172.21.15.80:0/2795007663 shutdown_connections 2022-09-07T19:42:45.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 --2- 172.21.15.80:0/2795007663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658105c60 0x7f06581080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 --2- 172.21.15.80:0/2795007663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 0x7f0658102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 --2- 172.21.15.80:0/2795007663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658105720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 -- 172.21.15.80:0/2795007663 >> 172.21.15.80:0/2795007663 conn(0x7f06580f8430 msgr2=0x7f06580fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:45.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 -- 172.21.15.80:0/2795007663 shutdown_connections 2022-09-07T19:42:45.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.192+0000 7f065d669700 1 -- 172.21.15.80:0/2795007663 wait complete. 2022-09-07T19:42:45.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.193+0000 7f065d669700 1 Processor -- start 2022-09-07T19:42:45.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.193+0000 7f065d669700 1 -- start start 2022-09-07T19:42:45.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.193+0000 7f065d669700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 0x7f0658195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:45.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.193+0000 7f065d669700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:45.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f065d669700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658105c60 0x7f065819d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:45.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f065d669700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065819d8f0 con 0x7f0658103340 2022-09-07T19:42:45.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f065d669700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065819da60 con 0x7f06580673d0 2022-09-07T19:42:45.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f065d669700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065819dc20 con 0x7f0658105c60 2022-09-07T19:42:45.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f06567fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:45.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f06567fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60928/0 (socket says 172.21.15.80:60928) 2022-09-07T19:42:45.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f06567fc700 1 -- 172.21.15.80:0/3637535104 learned_addr learned my addr 172.21.15.80:0/3637535104 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:45.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f0656ffd700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 0x7f0658195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:45.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f06577fe700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658105c60 0x7f065819d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:45.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f0656ffd700 1 -- 172.21.15.80:0/3637535104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658105c60 msgr2=0x7f065819d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:45.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f0656ffd700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658105c60 0x7f065819d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f0656ffd700 1 -- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 msgr2=0x7f0658196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:45.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f0656ffd700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f0656ffd700 1 -- 172.21.15.80:0/3637535104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009470 con 0x7f06580673d0 2022-09-07T19:42:45.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.194+0000 7f06567fc700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:45.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.195+0000 7f0656ffd700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 0x7f0658195d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0658067180 tx=0x7f064800e9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.195+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648010840 con 0x7f06580673d0 2022-09-07T19:42:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.195+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f0648010e40 con 0x7f06580673d0 2022-09-07T19:42:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.195+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065819df00 con 0x7f06580673d0 2022-09-07T19:42:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.195+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648017630 con 0x7f06580673d0 2022-09-07T19:42:45.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.195+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065819e330 con 0x7f06580673d0 2022-09-07T19:42:45.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.196+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065810b870 con 0x7f06580673d0 2022-09-07T19:42:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.198+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f064800c040 con 0x7f06580673d0 2022-09-07T19:42:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.199+0000 7f063ffff700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06400990d0 0x7f064009b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.200+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f0648014070 con 0x7f06580673d0 2022-09-07T19:42:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.200+0000 7f06567fc700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06400990d0 0x7f064009b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.200+0000 7f06567fc700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06400990d0 0x7f064009b580 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b4f0 tx=0x7f064c005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.204+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f064804fc80 con 0x7f06580673d0 2022-09-07T19:42:45.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.489+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f06580f9e20 con 0x7f06580673d0 2022-09-07T19:42:45.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.497+0000 7f063ffff700 1 -- 172.21.15.80:0/3637535104 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f064808eb30 con 0x7f06580673d0 2022-09-07T19:42:45.497 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2022-09-07T19:42:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQA19Bhj9QdJHRAAOfiuJix9aX7Jy4ip/NBWwg== 2022-09-07T19:42:45.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06400990d0 msgr2=0x7f064009b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:45.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06400990d0 0x7f064009b580 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b4f0 tx=0x7f064c005910 comp rx=0 tx=0).stop 2022-09-07T19:42:45.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 msgr2=0x7f0658195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:45.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 0x7f0658195d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0658067180 tx=0x7f064800e9a0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 shutdown_connections 2022-09-07T19:42:45.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06400990d0 0x7f064009b580 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658105c60 0x7f065819d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06580673d0 0x7f0658195d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 --2- 172.21.15.80:0/3637535104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0658103340 0x7f0658196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:45.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 >> 172.21.15.80:0/3637535104 conn(0x7f06580f8430 msgr2=0x7f0658104000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:45.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 shutdown_connections 2022-09-07T19:42:45.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:45.500+0000 7f065d669700 1 -- 172.21.15.80:0/3637535104 wait complete. 2022-09-07T19:42:45.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:45 smithi080 ceph-mon[90124]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 606 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.5 KiB/s wr, 15 op/s 2022-09-07T19:42:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:45 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3637535104' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-09-07T19:42:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:45 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-09-07T19:42:45.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:45 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-09-07T19:42:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:45 smithi154 ceph-mon[96967]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 606 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.5 KiB/s wr, 15 op/s 2022-09-07T19:42:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:45 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3637535104' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-09-07T19:42:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:45 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-09-07T19:42:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:45 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-09-07T19:42:45.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:45 smithi155 ceph-mon[97606]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 606 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.5 KiB/s wr, 15 op/s 2022-09-07T19:42:45.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:45 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3637535104' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-09-07T19:42:45.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:45 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-09-07T19:42:45.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:45 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-09-07T19:42:45.993 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:42:45.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2022-09-07T19:42:45.994 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-09-07T19:42:46.121 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-09-07T19:42:46.123 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2022-09-07T19:42:46.123 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph mgr dump --format=json 2022-09-07T19:42:47.031 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:47.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:47 smithi080 ceph-mon[90124]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 628 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.7 KiB/s wr, 19 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:47.877 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:47 smithi154 ceph-mon[96967]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 628 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.7 KiB/s wr, 19 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:47.952 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:47 smithi155 ceph-mon[97606]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 628 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.7 KiB/s wr, 19 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 -- 172.21.15.80:0/2781720269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 msgr2=0x7fca10102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 --2- 172.21.15.80:0/2781720269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10102ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009840 tx=0x7fc9f8009b50 comp rx=0 tx=0).stop 2022-09-07T19:42:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 -- 172.21.15.80:0/2781720269 shutdown_connections 2022-09-07T19:42:48.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 --2- 172.21.15.80:0/2781720269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca100fe0d0 0x7fca100fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 --2- 172.21.15.80:0/2781720269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca101031d0 0x7fca1010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 --2- 172.21.15.80:0/2781720269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10102ac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 -- 172.21.15.80:0/2781720269 >> 172.21.15.80:0/2781720269 conn(0x7fca100f9a10 msgr2=0x7fca100fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:48.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 -- 172.21.15.80:0/2781720269 shutdown_connections 2022-09-07T19:42:48.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.583+0000 7fca15f14700 1 -- 172.21.15.80:0/2781720269 wait complete. 2022-09-07T19:42:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.584+0000 7fca15f14700 1 Processor -- start 2022-09-07T19:42:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 -- start start 2022-09-07T19:42:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100fe0d0 0x7fca10070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 0x7fca101a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10071db0 con 0x7fca101031d0 2022-09-07T19:42:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101a23c0 con 0x7fca100fea70 2022-09-07T19:42:48.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca15f14700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101a2500 con 0x7fca100fe0d0 2022-09-07T19:42:48.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 0x7fca101a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:48.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:48.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.585+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 0x7fca101a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60942/0 (socket says 172.21.15.80:60942) 2022-09-07T19:42:48.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca0ffff700 1 -- 172.21.15.80:0/3870927232 learned_addr learned my addr 172.21.15.80:0/3870927232 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:48.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 -- 172.21.15.80:0/3870927232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100fe0d0 msgr2=0x7fca10070fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-09-07T19:42:48.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100fe0d0 0x7fca10070fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 -- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 msgr2=0x7fca101a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:48.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 0x7fca101a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 -- 172.21.15.80:0/3870927232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8009470 con 0x7fca100fea70 2022-09-07T19:42:48.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca0ffff700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 0x7fca101a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:48.593 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.586+0000 7fca07fff700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10071520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006010 tx=0x7fc9f800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:48.593 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.587+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f801d070 con 0x7fca100fea70 2022-09-07T19:42:48.593 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.587+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fc9f800b480 con 0x7fca100fea70 2022-09-07T19:42:48.593 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.587+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8004810 con 0x7fca100fea70 2022-09-07T19:42:48.594 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.587+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca101a2730 con 0x7fca100fea70 2022-09-07T19:42:48.594 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.587+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca101a2b90 con 0x7fca100fea70 2022-09-07T19:42:48.594 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.588+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca10064ea0 con 0x7fca100fea70 2022-09-07T19:42:48.595 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.590+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fc9f8028030 con 0x7fca100fea70 2022-09-07T19:42:48.596 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.591+0000 7fca0d7fa700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc9fc0990d0 0x7fc9fc09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:48.596 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.591+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fc9f80c3190 con 0x7fca100fea70 2022-09-07T19:42:48.596 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.591+0000 7fca0f7fe700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc9fc0990d0 0x7fc9fc09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:48.596 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.592+0000 7fca0f7fe700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc9fc0990d0 0x7fc9fc09b580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca00005fd0 tx=0x7fca00005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:48.597 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.594+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fc9f808f4e0 con 0x7fca100fea70 2022-09-07T19:42:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.858+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fca101a31d0 con 0x7fca100fea70 2022-09-07T19:42:48.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.863+0000 7fca0d7fa700 1 -- 172.21.15.80:0/3870927232 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+246062 (secure 0 0 0) 0x7fc9f8092b00 con 0x7fca100fea70 2022-09-07T19:42:48.877 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc9fc0990d0 msgr2=0x7fc9fc09b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc9fc0990d0 0x7fc9fc09b580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca00005fd0 tx=0x7fca00005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 msgr2=0x7fca10071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10071520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006010 tx=0x7fc9f800f690 comp rx=0 tx=0).stop 2022-09-07T19:42:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 shutdown_connections 2022-09-07T19:42:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca101031d0 0x7fca101a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc9fc0990d0 0x7fc9fc09b580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100fe0d0 0x7fca10070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 --2- 172.21.15.80:0/3870927232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100fea70 0x7fca10071520 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 >> 172.21.15.80:0/3870927232 conn(0x7fca100f9a10 msgr2=0x7fca100fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 shutdown_connections 2022-09-07T19:42:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:48.868+0000 7fca15f14700 1 -- 172.21.15.80:0/3870927232 wait complete. 2022-09-07T19:42:49.402 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":202237256},{"type":"v1","addr":"172.21.15.80:6801","nonce":202237256}]},"active_addr":"172.21.15.80:6801/202237256","active_change":"2022-09-07T19:34:41.782830+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.80:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3130451300}]},{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1718043882}]},{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2250179124}]},{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3533849155}]},{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":112303364}]}]}} 2022-09-07T19:42:49.416 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2022-09-07T19:42:49.416 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2022-09-07T19:42:49.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd dump --format=json 2022-09-07T19:42:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:49 smithi080 ceph-mon[90124]: pgmap v324: 129 pgs: 129 active+clean; 628 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.0 KiB/s wr, 11 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:49.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:49 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3870927232' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-09-07T19:42:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:49 smithi154 ceph-mon[96967]: pgmap v324: 129 pgs: 129 active+clean; 628 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.0 KiB/s wr, 11 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:49 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3870927232' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-09-07T19:42:49.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:49 smithi155 ceph-mon[97606]: pgmap v324: 129 pgs: 129 active+clean; 628 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.0 KiB/s wr, 11 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:49.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:49 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3870927232' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-09-07T19:42:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:51.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 -- 172.21.15.80:0/2356577057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec067880 msgr2=0x7f06ec10ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:51.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 --2- 172.21.15.80:0/2356577057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec067880 0x7f06ec10ae40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009be0 tx=0x7f06e4009ef0 comp rx=0 tx=0).stop 2022-09-07T19:42:51.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 -- 172.21.15.80:0/2356577057 shutdown_connections 2022-09-07T19:42:51.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 --2- 172.21.15.80:0/2356577057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec067880 0x7f06ec10ae40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 --2- 172.21.15.80:0/2356577057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06ec0ffd40 0x7f06ec100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 --2- 172.21.15.80:0/2356577057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec1006e0 0x7f06ec0671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 -- 172.21.15.80:0/2356577057 >> 172.21.15.80:0/2356577057 conn(0x7f06ec073cc0 msgr2=0x7f06ec0740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 -- 172.21.15.80:0/2356577057 shutdown_connections 2022-09-07T19:42:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.853+0000 7f06f3316700 1 -- 172.21.15.80:0/2356577057 wait complete. 2022-09-07T19:42:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.854+0000 7f06f3316700 1 Processor -- start 2022-09-07T19:42:51.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.854+0000 7f06f3316700 1 -- start start 2022-09-07T19:42:51.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f3316700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 0x7f06ec193db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:51.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f3316700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06ec0ffd40 0x7f06ec1942f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:51.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f3316700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1006e0 0x7f06ec198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:51.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f3316700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec198de0 con 0x7f06ec067880 2022-09-07T19:42:51.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f3316700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec198f50 con 0x7f06ec1006e0 2022-09-07T19:42:51.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f3316700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec199110 con 0x7f06ec0ffd40 2022-09-07T19:42:51.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 0x7f06ec193db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 0x7f06ec193db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60962/0 (socket says 172.21.15.80:60962) 2022-09-07T19:42:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 -- 172.21.15.80:0/1977182922 learned_addr learned my addr 172.21.15.80:0/1977182922 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f08b1700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06ec0ffd40 0x7f06ec1942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f18b3700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1006e0 0x7f06ec198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 -- 172.21.15.80:0/1977182922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06ec0ffd40 msgr2=0x7f06ec1942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:51.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06ec0ffd40 0x7f06ec1942f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:51.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 -- 172.21.15.80:0/1977182922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1006e0 msgr2=0x7f06ec198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:51.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1006e0 0x7f06ec198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:51.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.855+0000 7f06f10b2700 1 -- 172.21.15.80:0/1977182922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0093b0 con 0x7f06ec067880 2022-09-07T19:42:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.856+0000 7f06f10b2700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 0x7f06ec193db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f06e800e740 tx=0x7f06e800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.856+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8005220 con 0x7f06ec067880 2022-09-07T19:42:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.856+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f06e8005380 con 0x7f06ec067880 2022-09-07T19:42:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.856+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e40097e0 con 0x7f06ec067880 2022-09-07T19:42:51.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.856+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8004b70 con 0x7f06ec067880 2022-09-07T19:42:51.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.856+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1a0be0 con 0x7f06ec067880 2022-09-07T19:42:51.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.857+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec064ea0 con 0x7f06ec067880 2022-09-07T19:42:51.864 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.859+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f06e801e020 con 0x7f06ec067880 2022-09-07T19:42:51.864 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.860+0000 7f06e27fc700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06d80990d0 0x7f06d809b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:51.865 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.861+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f06e8014070 con 0x7f06ec067880 2022-09-07T19:42:51.865 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.861+0000 7f06f08b1700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06d80990d0 0x7f06d809b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:51.865 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.861+0000 7f06f08b1700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06d80990d0 0x7f06d809b580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06ec1953c0 tx=0x7f06dc005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:51.866 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:51.864+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f06e808ebb0 con 0x7f06ec067880 2022-09-07T19:42:51.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:51 smithi080 ceph-mon[90124]: pgmap v325: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:51 smithi154 ceph-mon[96967]: pgmap v325: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:51.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:51 smithi155 ceph-mon[97606]: pgmap v325: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2022-09-07T19:42:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.077+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06ec1a1190 con 0x7f06ec067880 2022-09-07T19:42:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.078+0000 7f06e27fc700 1 -- 172.21.15.80:0/1977182922 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+23630 (secure 0 0 0) 0x7f06e80921d0 con 0x7f06ec067880 2022-09-07T19:42:52.079 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:52.080 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:43.521940+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06d80990d0 msgr2=0x7f06d809b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06d80990d0 0x7f06d809b580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06ec1953c0 tx=0x7f06dc005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 msgr2=0x7f06ec193db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 0x7f06ec193db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f06e800e740 tx=0x7f06e800ea50 comp rx=0 tx=0).stop 2022-09-07T19:42:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 shutdown_connections 2022-09-07T19:42:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06ec067880 0x7f06ec193db0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f06d80990d0 0x7f06d809b580 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1006e0 0x7f06ec198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 --2- 172.21.15.80:0/1977182922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06ec0ffd40 0x7f06ec1942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:52.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 >> 172.21.15.80:0/1977182922 conn(0x7f06ec073cc0 msgr2=0x7f06ec0fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:52.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 shutdown_connections 2022-09-07T19:42:52.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:52.082+0000 7f06f3316700 1 -- 172.21.15.80:0/1977182922 wait complete. 2022-09-07T19:42:52.571 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2022-09-07T19:42:52.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd dump --format=json 2022-09-07T19:42:52.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:52 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1977182922' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:52.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:52 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1977182922' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:52.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:52 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1977182922' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:53.818 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:53 smithi080 ceph-mon[90124]: pgmap v326: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2022-09-07T19:42:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:53 smithi154 ceph-mon[96967]: pgmap v326: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2022-09-07T19:42:53.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:53 smithi155 ceph-mon[97606]: pgmap v326: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2022-09-07T19:42:54.990 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 -- 172.21.15.80:0/2942273392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 msgr2=0x7fcc240fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:54.991 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 --2- 172.21.15.80:0/2942273392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc240fe4b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009810 tx=0x7fcc14009b20 comp rx=0 tx=0).stop 2022-09-07T19:42:54.991 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 -- 172.21.15.80:0/2942273392 shutdown_connections 2022-09-07T19:42:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 --2- 172.21.15.80:0/2942273392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc241031e0 0x7fcc2410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 --2- 172.21.15.80:0/2942273392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc240fe4b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 --2- 172.21.15.80:0/2942273392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc240fea80 0x7fcc24102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.990+0000 7fcc28890700 1 -- 172.21.15.80:0/2942273392 >> 172.21.15.80:0/2942273392 conn(0x7fcc240f9a20 msgr2=0x7fcc240fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.991+0000 7fcc28890700 1 -- 172.21.15.80:0/2942273392 shutdown_connections 2022-09-07T19:42:54.994 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.991+0000 7fcc28890700 1 -- 172.21.15.80:0/2942273392 wait complete. 2022-09-07T19:42:54.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 Processor -- start 2022-09-07T19:42:54.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 -- start start 2022-09-07T19:42:54.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc24070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 0x7fcc24071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc241031e0 0x7fcc241a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24071db0 con 0x7fcc240fea80 2022-09-07T19:42:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241a2420 con 0x7fcc241031e0 2022-09-07T19:42:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.992+0000 7fcc28890700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241a2560 con 0x7fcc240fe0e0 2022-09-07T19:42:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc21d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 0x7fcc24071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc24070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc21d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 0x7fcc24071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57796/0 (socket says 172.21.15.80:57796) 2022-09-07T19:42:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc21d9b700 1 -- 172.21.15.80:0/126263555 learned_addr learned my addr 172.21.15.80:0/126263555 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:42:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc22d9d700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc241031e0 0x7fcc241a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 -- 172.21.15.80:0/126263555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc241031e0 msgr2=0x7fcc241a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc241031e0 0x7fcc241a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 -- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 msgr2=0x7fcc24071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 0x7fcc24071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 -- 172.21.15.80:0/126263555 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14009470 con 0x7fcc240fe0e0 2022-09-07T19:42:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc22d9d700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc241031e0 0x7fcc241a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc21d9b700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 0x7fcc24071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:42:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.993+0000 7fcc2259c700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc24070fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc14000c00 tx=0x7fcc1400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.994+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1401d070 con 0x7fcc240fe0e0 2022-09-07T19:42:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.994+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcc1400f880 con 0x7fcc240fe0e0 2022-09-07T19:42:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.994+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14004760 con 0x7fcc240fe0e0 2022-09-07T19:42:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.994+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc241a2790 con 0x7fcc240fe0e0 2022-09-07T19:42:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.994+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc241a2bf0 con 0x7fcc240fe0e0 2022-09-07T19:42:55.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.995+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc24064ea0 con 0x7fcc240fe0e0 2022-09-07T19:42:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.997+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fcc14028030 con 0x7fcc240fe0e0 2022-09-07T19:42:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.998+0000 7fcc137fe700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcc0c099050 0x7fcc0c09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:42:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.998+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fcc140c32d0 con 0x7fcc240fe0e0 2022-09-07T19:42:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.999+0000 7fcc21d9b700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcc0c099050 0x7fcc0c09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:42:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:54.999+0000 7fcc21d9b700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcc0c099050 0x7fcc0c09b500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcc240727d0 tx=0x7fcc18005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:42:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.001+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fcc1408f620 con 0x7fcc240fe0e0 2022-09-07T19:42:55.214 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.215+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc2410dce0 con 0x7fcc240fe0e0 2022-09-07T19:42:55.216 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.217+0000 7fcc137fe700 1 -- 172.21.15.80:0/126263555 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+23630 (secure 0 0 0) 0x7fcc14092c40 con 0x7fcc240fe0e0 2022-09-07T19:42:55.217 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:42:55.217 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:43.521940+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:42:55.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcc0c099050 msgr2=0x7fcc0c09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:55.218 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcc0c099050 0x7fcc0c09b500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcc240727d0 tx=0x7fcc18005ea0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 msgr2=0x7fcc24070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:42:55.219 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc24070fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc14000c00 tx=0x7fcc1400f690 comp rx=0 tx=0).stop 2022-09-07T19:42:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 shutdown_connections 2022-09-07T19:42:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcc0c099050 0x7fcc0c09b500 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc241031e0 0x7fcc241a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc240fe0e0 0x7fcc24070fe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 --2- 172.21.15.80:0/126263555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc240fea80 0x7fcc24071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:42:55.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.219+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 >> 172.21.15.80:0/126263555 conn(0x7fcc240f9a20 msgr2=0x7fcc24101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:42:55.222 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.220+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 shutdown_connections 2022-09-07T19:42:55.222 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:42:55.220+0000 7fcc28890700 1 -- 172.21.15.80:0/126263555 wait complete. 2022-09-07T19:42:55.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2022-09-07T19:42:55.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2022-09-07T19:42:55.720 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2022-09-07T19:42:55.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2022-09-07T19:42:55.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2022-09-07T19:42:55.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2022-09-07T19:42:55.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2022-09-07T19:42:55.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2022-09-07T19:42:55.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2022-09-07T19:42:55.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2022-09-07T19:42:55.726 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2022-09-07T19:42:55.726 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2022-09-07T19:42:55.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:55 smithi080 ceph-mon[90124]: pgmap v327: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 11 B/s, 0 objects/s recovering 2022-09-07T19:42:55.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:55 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/126263555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:55 smithi154 ceph-mon[96967]: pgmap v327: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 11 B/s, 0 objects/s recovering 2022-09-07T19:42:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:55 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/126263555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:55.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:55 smithi155 ceph-mon[97606]: pgmap v327: 129 pgs: 129 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 11 B/s, 0 objects/s recovering 2022-09-07T19:42:55.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:55 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/126263555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:42:57.815 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:57.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:57 smithi080 ceph-mon[90124]: pgmap v328: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2022-09-07T19:42:57.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:57 smithi154 ceph-mon[96967]: pgmap v328: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2022-09-07T19:42:57.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:57 smithi155 ceph-mon[97606]: pgmap v328: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2022-09-07T19:42:57.997 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:58.155 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:58.191 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:58.218 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:58.355 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:58.384 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:59.146 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:59.152 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:59.194 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:42:59.852 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:42:59 smithi080 ceph-mon[90124]: pgmap v329: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2022-09-07T19:42:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:42:59 smithi154 ceph-mon[96967]: pgmap v329: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2022-09-07T19:42:59.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:42:59 smithi155 ceph-mon[97606]: pgmap v329: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2022-09-07T19:43:01.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:01 smithi080 ceph-mon[90124]: pgmap v330: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2022-09-07T19:43:01.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:01 smithi154 ceph-mon[96967]: pgmap v330: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2022-09-07T19:43:01.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:01 smithi155 ceph-mon[97606]: pgmap v330: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2022-09-07T19:43:03.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:03 smithi080 ceph-mon[90124]: pgmap v331: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 6 op/s 2022-09-07T19:43:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 -- 172.21.15.80:0/1404933368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 msgr2=0x7f58d0067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1404933368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 0x7f58d0067050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009810 tx=0x7f58c4009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 -- 172.21.15.80:0/1404933368 shutdown_connections 2022-09-07T19:43:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1404933368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d0102d40 0x7f58d00666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:03.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1404933368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d01008d0 0x7f58d0100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:03.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1404933368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 0x7f58d0067050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:03.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 -- 172.21.15.80:0/1404933368 >> 172.21.15.80:0/1404933368 conn(0x7f58d0073cf0 msgr2=0x7f58d00740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:03.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.623+0000 7f58d4d60700 1 -- 172.21.15.80:0/1404933368 shutdown_connections 2022-09-07T19:43:03.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.624+0000 7f58d4d60700 1 -- 172.21.15.80:0/1404933368 wait complete. 2022-09-07T19:43:03.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.625+0000 7f58d4d60700 1 Processor -- start 2022-09-07T19:43:03.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.626+0000 7f58d4d60700 1 -- start start 2022-09-07T19:43:03.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58d4d60700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 0x7f58d019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:03.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58d4d60700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d01008d0 0x7f58d019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:03.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58d4d60700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0102d40 0x7f58d019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:03.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58d4d60700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d019f2c0 con 0x7f58d01008d0 2022-09-07T19:43:03.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58d4d60700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d019f430 con 0x7f58d0066c00 2022-09-07T19:43:03.633 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58d4d60700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d019f5f0 con 0x7f58d0102d40 2022-09-07T19:43:03.633 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58ce59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 0x7f58d019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:03.633 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58ced9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0102d40 0x7f58d019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:03.633 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58ce59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 0x7f58d019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:46414/0 (socket says 172.21.15.80:46414) 2022-09-07T19:43:03.633 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.627+0000 7f58ce59c700 1 -- 172.21.15.80:0/1361805202 learned_addr learned my addr 172.21.15.80:0/1361805202 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:03.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58cdd9b700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d01008d0 0x7f58d019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:03.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58ced9d700 1 -- 172.21.15.80:0/1361805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 msgr2=0x7f58d019a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:03.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58ced9d700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d0066c00 0x7f58d019a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:03.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58ced9d700 1 -- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d01008d0 msgr2=0x7f58d019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:03.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58ced9d700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d01008d0 0x7f58d019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:03.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58ced9d700 1 -- 172.21.15.80:0/1361805202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80093b0 con 0x7f58d0102d40 2022-09-07T19:43:03.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58cdd9b700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d01008d0 0x7f58d019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:43:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58ced9d700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0102d40 0x7f58d019ec30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f58c800e940 tx=0x7f58c800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.628+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8004220 con 0x7f58d0102d40 2022-09-07T19:43:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.629+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c4009470 con 0x7f58d0102d40 2022-09-07T19:43:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.629+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f58c8004380 con 0x7f58d0102d40 2022-09-07T19:43:03.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.629+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8003d50 con 0x7f58d0102d40 2022-09-07T19:43:03.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.629+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d01a70c0 con 0x7f58d0102d40 2022-09-07T19:43:03.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.630+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58d01002c0 con 0x7f58d0102d40 2022-09-07T19:43:03.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.632+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f58c801e020 con 0x7f58d0102d40 2022-09-07T19:43:03.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.633+0000 7f58bf7fe700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f58b8099100 0x7f58b809b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:03.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.633+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f58c8014070 con 0x7f58d0102d40 2022-09-07T19:43:03.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.634+0000 7f58ce59c700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f58b8099100 0x7f58b809b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:03.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.634+0000 7f58bf7fe700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] conn(0x7f58b80a4010 0x7f58b80a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:03.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.634+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 --> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58b80a6b70 con 0x7f58b80a4010 2022-09-07T19:43:03.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.634+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c80c2f20 con 0x7f58d0102d40 2022-09-07T19:43:03.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.634+0000 7f58cdd9b700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] conn(0x7f58b80a4010 0x7f58b80a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:03.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.634+0000 7f58ce59c700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f58b8099100 0x7f58b809b5b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009eb0 tx=0x7f58c0009410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:03.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.635+0000 7f58cdd9b700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] conn(0x7f58b80a4010 0x7f58b80a64a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:03.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.636+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== osd.0 v2:172.21.15.80:6802/2369094167 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f58b80a6b70 con 0x7f58b80a4010 2022-09-07T19:43:03.652 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.653+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 --> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58d0064ea0 con 0x7f58b80a4010 2022-09-07T19:43:03.653 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58bf7fe700 1 -- 172.21.15.80:0/1361805202 <== osd.0 v2:172.21.15.80:6802/2369094167 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58d0064ea0 con 0x7f58b80a4010 2022-09-07T19:43:03.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] conn(0x7f58b80a4010 msgr2=0x7f58b80a64a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:03.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] conn(0x7f58b80a4010 0x7f58b80a64a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:03.655 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f58b8099100 msgr2=0x7f58b809b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:03.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f58b8099100 0x7f58b809b5b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009eb0 tx=0x7f58c0009410 comp rx=0 tx=0).stop 2022-09-07T19:43:03.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0102d40 msgr2=0x7f58d019ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:03.656 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 --2- 172.21.15.80:0/1361805202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0102d40 0x7f58d019ec30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f58c800e940 tx=0x7f58c800ec50 comp rx=0 tx=0).stop 2022-09-07T19:43:03.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58ced9d700 1 -- 172.21.15.80:0/1361805202 reap_dead start 2022-09-07T19:43:03.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 shutdown_connections 2022-09-07T19:43:03.657 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 >> 172.21.15.80:0/1361805202 conn(0x7f58d0073cf0 msgr2=0x7f58d00ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:03.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 shutdown_connections 2022-09-07T19:43:03.658 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:03.654+0000 7f58d4d60700 1 -- 172.21.15.80:0/1361805202 wait complete. 2022-09-07T19:43:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:03 smithi154 ceph-mon[96967]: pgmap v331: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 6 op/s 2022-09-07T19:43:03.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:03 smithi155 ceph-mon[97606]: pgmap v331: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 6 op/s 2022-09-07T19:43:04.732 INFO:teuthology.orchestra.run.smithi080.stdout:34359738450 2022-09-07T19:43:04.733 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.0 2022-09-07T19:43:04.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.758+0000 7f81e46ab700 1 -- 172.21.15.80:0/3169148999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 msgr2=0x7f81dc10a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.758+0000 7f81e46ab700 1 --2- 172.21.15.80:0/3169148999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 0x7f81dc10a4d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009750 tx=0x7f81cc009a60 comp rx=0 tx=0).stop 2022-09-07T19:43:04.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 -- 172.21.15.80:0/3169148999 shutdown_connections 2022-09-07T19:43:04.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 --2- 172.21.15.80:0/3169148999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc10aa10 0x7f81dc10cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 --2- 172.21.15.80:0/3169148999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc0666c0 0x7f81dc066a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 --2- 172.21.15.80:0/3169148999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 0x7f81dc10a4d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 -- 172.21.15.80:0/3169148999 >> 172.21.15.80:0/3169148999 conn(0x7f81dc073cf0 msgr2=0x7f81dc0740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:04.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 -- 172.21.15.80:0/3169148999 shutdown_connections 2022-09-07T19:43:04.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.760+0000 7f81e46ab700 1 -- 172.21.15.80:0/3169148999 wait complete. 2022-09-07T19:43:04.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.761+0000 7f81e46ab700 1 Processor -- start 2022-09-07T19:43:04.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 -- start start 2022-09-07T19:43:04.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc0666c0 0x7f81dc195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:04.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 0x7f81dc1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:04.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc10aa10 0x7f81dc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:04.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc19afa0 con 0x7f81dc066fd0 2022-09-07T19:43:04.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc19b110 con 0x7f81dc0666c0 2022-09-07T19:43:04.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e46ab700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc19b2d0 con 0x7f81dc10aa10 2022-09-07T19:43:04.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e2c48700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc10aa10 0x7f81dc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:04.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc10aa10 0x7f81dc19a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:50960/0 (socket says 172.21.15.80:50960) 2022-09-07T19:43:04.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 -- 172.21.15.80:0/2066419140 learned_addr learned my addr 172.21.15.80:0/2066419140 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:04.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.762+0000 7f81e2447700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc0666c0 0x7f81dc195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:04.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e1c46700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 0x7f81dc1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:04.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 -- 172.21.15.80:0/2066419140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc0666c0 msgr2=0x7f81dc195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:04.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc0666c0 0x7f81dc195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 -- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 msgr2=0x7f81dc1964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:04.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81dc066fd0 0x7f81dc1964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 -- 172.21.15.80:0/2066419140 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009470 con 0x7f81dc10aa10 2022-09-07T19:43:04.779 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.763+0000 7f81e2c48700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc10aa10 0x7f81dc19a910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b9e0 tx=0x7f81d400bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:04.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.764+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400d8e0 con 0x7f81dc10aa10 2022-09-07T19:43:04.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.764+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc0093b0 con 0x7f81dc10aa10 2022-09-07T19:43:04.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.764+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f81d40098a0 con 0x7f81dc10aa10 2022-09-07T19:43:04.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.764+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4014430 con 0x7f81dc10aa10 2022-09-07T19:43:04.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.764+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc068700 con 0x7f81dc10aa10 2022-09-07T19:43:04.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.765+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81dc0fb860 con 0x7f81dc10aa10 2022-09-07T19:43:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.767+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f81d40156b0 con 0x7f81dc10aa10 2022-09-07T19:43:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.768+0000 7f81d37fe700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f81c8099050 0x7f81c809b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.768+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f81d4011070 con 0x7f81dc10aa10 2022-09-07T19:43:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.769+0000 7f81e2447700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f81c8099050 0x7f81c809b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.769+0000 7f81d37fe700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] conn(0x7f81c80a3f60 0x7f81c80a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.769+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 --> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81c80a6ac0 con 0x7f81c80a3f60 2022-09-07T19:43:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.769+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d40c4a10 con 0x7f81dc10aa10 2022-09-07T19:43:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.769+0000 7f81e1c46700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] conn(0x7f81c80a3f60 0x7f81c80a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.769+0000 7f81e2447700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f81c8099050 0x7f81c809b500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009440 tx=0x7f81d8005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.770+0000 7f81e1c46700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] conn(0x7f81c80a3f60 0x7f81c80a63f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.771+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== osd.5 v2:172.21.15.155:6808/181497455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f81c80a6ac0 con 0x7f81c80a3f60 2022-09-07T19:43:04.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.789+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 --> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81dc064ea0 con 0x7f81c80a3f60 2022-09-07T19:43:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.793+0000 7f81d37fe700 1 -- 172.21.15.80:0/2066419140 <== osd.5 v2:172.21.15.155:6808/181497455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f81dc064ea0 con 0x7f81c80a3f60 2022-09-07T19:43:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] conn(0x7f81c80a3f60 msgr2=0x7f81c80a63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] conn(0x7f81c80a3f60 0x7f81c80a63f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f81c8099050 msgr2=0x7f81c809b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:04.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f81c8099050 0x7f81c809b500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009440 tx=0x7f81d8005f60 comp rx=0 tx=0).stop 2022-09-07T19:43:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc10aa10 msgr2=0x7f81dc19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 --2- 172.21.15.80:0/2066419140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81dc10aa10 0x7f81dc19a910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b9e0 tx=0x7f81d400bcf0 comp rx=0 tx=0).stop 2022-09-07T19:43:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e2c48700 1 -- 172.21.15.80:0/2066419140 reap_dead start 2022-09-07T19:43:04.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 shutdown_connections 2022-09-07T19:43:04.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.794+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 >> 172.21.15.80:0/2066419140 conn(0x7f81dc073cf0 msgr2=0x7f81dc0fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:04.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.795+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 shutdown_connections 2022-09-07T19:43:04.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:04.795+0000 7f81e46ab700 1 -- 172.21.15.80:0/2066419140 wait complete. 2022-09-07T19:43:05.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 -- 172.21.15.80:0/1540476960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50111060 msgr2=0x7fcb50113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 --2- 172.21.15.80:0/1540476960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50111060 0x7fcb50113440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009bb0 tx=0x7fcb48009ec0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 -- 172.21.15.80:0/1540476960 shutdown_connections 2022-09-07T19:43:05.669 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 --2- 172.21.15.80:0/1540476960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb50106550 0x7fcb5006f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 --2- 172.21.15.80:0/1540476960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50111060 0x7fcb50113440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 --2- 172.21.15.80:0/1540476960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb501069b0 0x7fcb5006faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.670 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 -- 172.21.15.80:0/1540476960 >> 172.21.15.80:0/1540476960 conn(0x7fcb5006a070 msgr2=0x7fcb5006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:05.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 -- 172.21.15.80:0/1540476960 shutdown_connections 2022-09-07T19:43:05.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.591+0000 7fcb586c0700 1 -- 172.21.15.80:0/1540476960 wait complete. 2022-09-07T19:43:05.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.593+0000 7fcb586c0700 1 Processor -- start 2022-09-07T19:43:05.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 -- start start 2022-09-07T19:43:05.671 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50106550 0x7fcb5019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.672 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb501069b0 0x7fcb5019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.672 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb50111060 0x7fcb501a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.672 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501a1570 con 0x7fcb50111060 2022-09-07T19:43:05.672 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501a16e0 con 0x7fcb50106550 2022-09-07T19:43:05.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.594+0000 7fcb586c0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501a18a0 con 0x7fcb501069b0 2022-09-07T19:43:05.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb5645c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50106550 0x7fcb5019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb5645c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50106550 0x7fcb5019c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:46474/0 (socket says 172.21.15.80:46474) 2022-09-07T19:43:05.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb56c5d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb50111060 0x7fcb501a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb5645c700 1 -- 172.21.15.80:0/2493643804 learned_addr learned my addr 172.21.15.80:0/2493643804 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:05.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb55c5b700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb501069b0 0x7fcb5019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.674 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb56c5d700 1 -- 172.21.15.80:0/2493643804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb501069b0 msgr2=0x7fcb5019ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb56c5d700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb501069b0 0x7fcb5019ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb56c5d700 1 -- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50106550 msgr2=0x7fcb5019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb56c5d700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50106550 0x7fcb5019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb56c5d700 1 -- 172.21.15.80:0/2493643804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480097e0 con 0x7fcb50111060 2022-09-07T19:43:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb55c5b700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb501069b0 0x7fcb5019ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:43:05.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.595+0000 7fcb5645c700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb50106550 0x7fcb5019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:05.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.596+0000 7fcb56c5d700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb50111060 0x7fcb501a0ee0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009fd0 tx=0x7fcb4800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:05.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.596+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48005450 con 0x7fcb50111060 2022-09-07T19:43:05.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.596+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb501a1b20 con 0x7fcb50111060 2022-09-07T19:43:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.596+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcb4800f460 con 0x7fcb50111060 2022-09-07T19:43:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.596+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb480176f0 con 0x7fcb50111060 2022-09-07T19:43:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.596+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb50106fd0 con 0x7fcb50111060 2022-09-07T19:43:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.597+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb5005f460 con 0x7fcb50111060 2022-09-07T19:43:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.601+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fcb4802f070 con 0x7fcb50111060 2022-09-07T19:43:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.602+0000 7fcb477fe700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb3c0990d0 0x7fcb3c09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.603+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fcb48023030 con 0x7fcb50111060 2022-09-07T19:43:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.603+0000 7fcb477fe700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] conn(0x7fcb3c0a3fe0 0x7fcb3c0a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.603+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 --> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb3c0a6b40 con 0x7fcb3c0a3fe0 2022-09-07T19:43:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.603+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb480c83f0 con 0x7fcb50111060 2022-09-07T19:43:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.603+0000 7fcb5645c700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb3c0990d0 0x7fcb3c09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.603+0000 7fcb55c5b700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] conn(0x7fcb3c0a3fe0 0x7fcb3c0a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.604+0000 7fcb55c5b700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] conn(0x7fcb3c0a3fe0 0x7fcb3c0a6470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.604+0000 7fcb5645c700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb3c0990d0 0x7fcb3c09b580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0057d0 tx=0x7fcb4c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.605+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== osd.1 v2:172.21.15.154:6800/406062851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fcb3c0a6b40 con 0x7fcb3c0a3fe0 2022-09-07T19:43:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.622+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 --> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb501a1d70 con 0x7fcb3c0a3fe0 2022-09-07T19:43:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb477fe700 1 -- 172.21.15.80:0/2493643804 <== osd.1 v2:172.21.15.154:6800/406062851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb40009730 con 0x7fcb3c0a3fe0 2022-09-07T19:43:05.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] conn(0x7fcb3c0a3fe0 msgr2=0x7fcb3c0a6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] conn(0x7fcb3c0a3fe0 0x7fcb3c0a6470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb3c0990d0 msgr2=0x7fcb3c09b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.682 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb3c0990d0 0x7fcb3c09b580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0057d0 tx=0x7fcb4c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb50111060 msgr2=0x7fcb501a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 --2- 172.21.15.80:0/2493643804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb50111060 0x7fcb501a0ee0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009fd0 tx=0x7fcb4800b890 comp rx=0 tx=0).stop 2022-09-07T19:43:05.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb56c5d700 1 -- 172.21.15.80:0/2493643804 reap_dead start 2022-09-07T19:43:05.683 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 shutdown_connections 2022-09-07T19:43:05.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.623+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 >> 172.21.15.80:0/2493643804 conn(0x7fcb5006a070 msgr2=0x7fcb50109000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:05.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.624+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 shutdown_connections 2022-09-07T19:43:05.684 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.624+0000 7fcb586c0700 1 -- 172.21.15.80:0/2493643804 wait complete. 2022-09-07T19:43:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 -- 172.21.15.80:0/3208158722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c10aa10 msgr2=0x7fbc5c10cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 --2- 172.21.15.80:0/3208158722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c10aa10 0x7fbc5c10cdf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009b00 tx=0x7fbc54009e10 comp rx=0 tx=0).stop 2022-09-07T19:43:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 -- 172.21.15.80:0/3208158722 shutdown_connections 2022-09-07T19:43:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 --2- 172.21.15.80:0/3208158722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5c0666c0 0x7fbc5c066a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 --2- 172.21.15.80:0/3208158722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c10aa10 0x7fbc5c10cdf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 --2- 172.21.15.80:0/3208158722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc5c066fd0 0x7fbc5c10a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.535+0000 7fbc61258700 1 -- 172.21.15.80:0/3208158722 >> 172.21.15.80:0/3208158722 conn(0x7fbc5c073cf0 msgr2=0x7fbc5c0740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:05.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.536+0000 7fbc61258700 1 -- 172.21.15.80:0/3208158722 shutdown_connections 2022-09-07T19:43:05.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.536+0000 7fbc61258700 1 -- 172.21.15.80:0/3208158722 wait complete. 2022-09-07T19:43:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.537+0000 7fbc61258700 1 Processor -- start 2022-09-07T19:43:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.537+0000 7fbc61258700 1 -- start start 2022-09-07T19:43:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc61258700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c0666c0 0x7fbc5c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc61258700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc5c066fd0 0x7fbc5c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc61258700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5c10aa10 0x7fbc5c19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc61258700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c19aee0 con 0x7fbc5c10aa10 2022-09-07T19:43:05.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc61258700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c19b050 con 0x7fbc5c066fd0 2022-09-07T19:43:05.762 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc61258700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c19b210 con 0x7fbc5c0666c0 2022-09-07T19:43:05.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc5ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c0666c0 0x7fbc5c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.763 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc5a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc5c066fd0 0x7fbc5c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.764 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc5ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c0666c0 0x7fbc5c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:50970/0 (socket says 172.21.15.80:50970) 2022-09-07T19:43:05.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc5ad9d700 1 -- 172.21.15.80:0/549721681 learned_addr learned my addr 172.21.15.80:0/549721681 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:05.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.538+0000 7fbc5b59e700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5c10aa10 0x7fbc5c19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.765 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc5a59c700 1 -- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c0666c0 msgr2=0x7fbc5c195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.766 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc5a59c700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c0666c0 0x7fbc5c195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.766 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc5a59c700 1 -- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5c10aa10 msgr2=0x7fbc5c19a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc5a59c700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5c10aa10 0x7fbc5c19a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc5a59c700 1 -- 172.21.15.80:0/549721681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c009470 con 0x7fbc5c066fd0 2022-09-07T19:43:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc5a59c700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc5c066fd0 0x7fbc5c1963f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000e6c0 tx=0x7fbc5000e9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.539+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50010900 con 0x7fbc5c066fd0 2022-09-07T19:43:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.540+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fbc50018420 con 0x7fbc5c066fd0 2022-09-07T19:43:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.540+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc54009730 con 0x7fbc5c066fd0 2022-09-07T19:43:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.540+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50017610 con 0x7fbc5c066fd0 2022-09-07T19:43:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.540+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c19b690 con 0x7fbc5c066fd0 2022-09-07T19:43:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.541+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc5c0fb8a0 con 0x7fbc5c066fd0 2022-09-07T19:43:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.543+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fbc5000c040 con 0x7fbc5c066fd0 2022-09-07T19:43:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.545+0000 7fbc43fff700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbc44099050 0x7fbc4409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.773 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.545+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fbc50014070 con 0x7fbc5c066fd0 2022-09-07T19:43:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.545+0000 7fbc5ad9d700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbc44099050 0x7fbc4409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.546+0000 7fbc43fff700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] conn(0x7fbc440a3f60 0x7fbc440a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.546+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 --> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc440a6ac0 con 0x7fbc440a3f60 2022-09-07T19:43:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.546+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc500c28d0 con 0x7fbc5c066fd0 2022-09-07T19:43:05.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.546+0000 7fbc5ad9d700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbc44099050 0x7fbc4409b500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c005b90 tx=0x7fbc4c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:05.776 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.546+0000 7fbc5b59e700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] conn(0x7fbc440a3f60 0x7fbc440a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:05.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.547+0000 7fbc5b59e700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] conn(0x7fbc440a3f60 0x7fbc440a63f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:05.777 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.548+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== osd.2 v2:172.21.15.155:6800/612567913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fbc440a6ac0 con 0x7fbc440a3f60 2022-09-07T19:43:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.568+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 --> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc5c064ea0 con 0x7fbc440a3f60 2022-09-07T19:43:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.569+0000 7fbc43fff700 1 -- 172.21.15.80:0/549721681 <== osd.2 v2:172.21.15.155:6800/612567913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc5c064ea0 con 0x7fbc440a3f60 2022-09-07T19:43:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] conn(0x7fbc440a3f60 msgr2=0x7fbc440a63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc61258700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] conn(0x7fbc440a3f60 0x7fbc440a63f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbc44099050 msgr2=0x7fbc4409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc61258700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbc44099050 0x7fbc4409b500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c005b90 tx=0x7fbc4c005f60 comp rx=0 tx=0).stop 2022-09-07T19:43:05.781 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc5c066fd0 msgr2=0x7fbc5c1963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc61258700 1 --2- 172.21.15.80:0/549721681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc5c066fd0 0x7fbc5c1963f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000e6c0 tx=0x7fbc5000e9d0 comp rx=0 tx=0).stop 2022-09-07T19:43:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.570+0000 7fbc5b59e700 1 -- 172.21.15.80:0/549721681 reap_dead start 2022-09-07T19:43:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.571+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 shutdown_connections 2022-09-07T19:43:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.571+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 >> 172.21.15.80:0/549721681 conn(0x7fbc5c073cf0 msgr2=0x7fbc5c0fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.572+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 shutdown_connections 2022-09-07T19:43:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:05.572+0000 7fbc61258700 1 -- 172.21.15.80:0/549721681 wait complete. 2022-09-07T19:43:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:05 smithi080 ceph-mon[90124]: pgmap v332: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 5 op/s 2022-09-07T19:43:05.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:05 smithi154 ceph-mon[96967]: pgmap v332: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 5 op/s 2022-09-07T19:43:05.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:05 smithi155 ceph-mon[97606]: pgmap v332: 129 pgs: 129 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 5 op/s 2022-09-07T19:43:06.703 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 -- 172.21.15.80:0/4153701817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 msgr2=0x7f54f410e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:06.703 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 --2- 172.21.15.80:0/4153701817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f410e9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009810 tx=0x7f54e0009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:06.703 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 -- 172.21.15.80:0/4153701817 shutdown_connections 2022-09-07T19:43:06.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 --2- 172.21.15.80:0/4153701817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f410ef00 0x7f54f41112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 --2- 172.21.15.80:0/4153701817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f4071080 0x7f54f4071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 --2- 172.21.15.80:0/4153701817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f410e9c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 -- 172.21.15.80:0/4153701817 >> 172.21.15.80:0/4153701817 conn(0x7f54f40f9a10 msgr2=0x7f54f40fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:06.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.120+0000 7f54faabc700 1 -- 172.21.15.80:0/4153701817 shutdown_connections 2022-09-07T19:43:06.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.121+0000 7f54faabc700 1 -- 172.21.15.80:0/4153701817 wait complete. 2022-09-07T19:43:06.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 Processor -- start 2022-09-07T19:43:06.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 -- start start 2022-09-07T19:43:06.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f4071080 0x7f54f419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:06.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:06.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f410ef00 0x7f54f419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:06.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f419f340 con 0x7f54f4071990 2022-09-07T19:43:06.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f419f4b0 con 0x7f54f410ef00 2022-09-07T19:43:06.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.122+0000 7f54faabc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f419f670 con 0x7f54f4071080 2022-09-07T19:43:06.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f9059700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f410ef00 0x7f54f419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f8858700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f4071080 0x7f54f419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f419a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47640/0 (socket says 172.21.15.80:47640) 2022-09-07T19:43:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 -- 172.21.15.80:0/3155864613 learned_addr learned my addr 172.21.15.80:0/3155864613 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 -- 172.21.15.80:0/3155864613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f4071080 msgr2=0x7f54f419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f4071080 0x7f54f419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 -- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f410ef00 msgr2=0x7f54f419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f410ef00 0x7f54f419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f3fff700 1 -- 172.21.15.80:0/3155864613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009470 con 0x7f54f4071990 2022-09-07T19:43:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.123+0000 7f54f9059700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f410ef00 0x7f54f419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.124+0000 7f54f3fff700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f419a850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54e00059c0 tx=0x7f54e000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.124+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e001d070 con 0x7f54f4071990 2022-09-07T19:43:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.124+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f54e000f800 con 0x7f54f4071990 2022-09-07T19:43:06.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.124+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00047f0 con 0x7f54f4071990 2022-09-07T19:43:06.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.124+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f419f8f0 con 0x7f54f4071990 2022-09-07T19:43:06.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.124+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f41a7140 con 0x7f54f4071990 2022-09-07T19:43:06.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.125+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54f405f3e0 con 0x7f54f4071990 2022-09-07T19:43:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.127+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f54e0028030 con 0x7f54f4071990 2022-09-07T19:43:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.128+0000 7f54f1ffb700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f54e40990d0 0x7f54e409b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.128+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f54e00c3b00 con 0x7f54f4071990 2022-09-07T19:43:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.128+0000 7f54f8858700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f54e40990d0 0x7f54e409b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.128+0000 7f54f1ffb700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] conn(0x7f54e40a3fe0 0x7f54e40a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.128+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 --> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54e40a6b40 con 0x7f54e40a3fe0 2022-09-07T19:43:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.128+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54e00c3e70 con 0x7f54f4071990 2022-09-07T19:43:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.129+0000 7f54f9059700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] conn(0x7f54e40a3fe0 0x7f54e40a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.129+0000 7f54f8858700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f54e40990d0 0x7f54e409b580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54e8005fd0 tx=0x7f54e8005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.129+0000 7f54f9059700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] conn(0x7f54e40a3fe0 0x7f54e40a6470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.130+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== osd.10 v2:172.21.15.154:6824/1234206337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f54e40a6b40 con 0x7f54e40a3fe0 2022-09-07T19:43:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.147+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 --> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54f4064ea0 con 0x7f54e40a3fe0 2022-09-07T19:43:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.147+0000 7f54f1ffb700 1 -- 172.21.15.80:0/3155864613 <== osd.10 v2:172.21.15.154:6824/1234206337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f54f4064ea0 con 0x7f54e40a3fe0 2022-09-07T19:43:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] conn(0x7f54e40a3fe0 msgr2=0x7f54e40a6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] conn(0x7f54e40a3fe0 0x7f54e40a6470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f54e40990d0 msgr2=0x7f54e409b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:06.716 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f54e40990d0 0x7f54e409b580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54e8005fd0 tx=0x7f54e8005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:06.716 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 msgr2=0x7f54f419a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:06.716 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 --2- 172.21.15.80:0/3155864613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54f4071990 0x7f54f419a850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54e00059c0 tx=0x7f54e000f690 comp rx=0 tx=0).stop 2022-09-07T19:43:06.716 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54f9059700 1 -- 172.21.15.80:0/3155864613 reap_dead start 2022-09-07T19:43:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 shutdown_connections 2022-09-07T19:43:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 >> 172.21.15.80:0/3155864613 conn(0x7f54f40f9a10 msgr2=0x7f54f40fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.148+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 shutdown_connections 2022-09-07T19:43:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:06.149+0000 7f54faabc700 1 -- 172.21.15.80:0/3155864613 wait complete. 2022-09-07T19:43:07.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 -- 172.21.15.80:0/3902662507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed41081e0 msgr2=0x7f4ed410a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:07.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/3902662507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed41081e0 0x7f4ed410a600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009b00 tx=0x7f4ecc009e10 comp rx=0 tx=0).stop 2022-09-07T19:43:07.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 -- 172.21.15.80:0/3902662507 shutdown_connections 2022-09-07T19:43:07.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/3902662507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed41081e0 0x7f4ed410a600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/3902662507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ed40fee10 0x7f4ed40ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/3902662507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 0x7f4ed4107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 -- 172.21.15.80:0/3902662507 >> 172.21.15.80:0/3902662507 conn(0x7f4ed40f8710 msgr2=0x7f4ed40fab20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 -- 172.21.15.80:0/3902662507 shutdown_connections 2022-09-07T19:43:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.194+0000 7f4edb1fe700 1 -- 172.21.15.80:0/3902662507 wait complete. 2022-09-07T19:43:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.195+0000 7f4edb1fe700 1 Processor -- start 2022-09-07T19:43:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 -- start start 2022-09-07T19:43:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed40fee10 0x7f4ed419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 0x7f4ed419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ed41081e0 0x7f4ed4195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41962e0 con 0x7f4ed40ff720 2022-09-07T19:43:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4196450 con 0x7f4ed40fee10 2022-09-07T19:43:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4edb1fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4196610 con 0x7f4ed41081e0 2022-09-07T19:43:07.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.196+0000 7f4ed99fb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 0x7f4ed419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:07.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4eda1fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed40fee10 0x7f4ed419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:07.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 0x7f4ed419c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47660/0 (socket says 172.21.15.80:47660) 2022-09-07T19:43:07.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 -- 172.21.15.80:0/948622153 learned_addr learned my addr 172.21.15.80:0/948622153 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4eda9fd700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ed41081e0 0x7f4ed4195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 -- 172.21.15.80:0/948622153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ed41081e0 msgr2=0x7f4ed4195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ed41081e0 0x7f4ed4195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 -- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed40fee10 msgr2=0x7f4ed419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed40fee10 0x7f4ed419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 -- 172.21.15.80:0/948622153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc009730 con 0x7f4ed40ff720 2022-09-07T19:43:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.197+0000 7f4ed99fb700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 0x7f4ed419c010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009fd0 tx=0x7f4ec400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.198+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4005220 con 0x7f4ed40ff720 2022-09-07T19:43:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.198+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f4ec4005380 con 0x7f4ed40ff720 2022-09-07T19:43:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.198+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed41968f0 con 0x7f4ed40ff720 2022-09-07T19:43:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.198+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004b20 con 0x7f4ed40ff720 2022-09-07T19:43:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.198+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed41a2b10 con 0x7f4ed40ff720 2022-09-07T19:43:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.199+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ed40fe580 con 0x7f4ed40ff720 2022-09-07T19:43:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.201+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f4ec401e020 con 0x7f4ed40ff720 2022-09-07T19:43:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.202+0000 7f4ecb7fe700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ec0099050 0x7f4ec009b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.202+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f4ec4014070 con 0x7f4ed40ff720 2022-09-07T19:43:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.202+0000 7f4eda1fc700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ec0099050 0x7f4ec009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.202+0000 7f4ecb7fe700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] conn(0x7f4ec00a3f60 0x7f4ec00a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.202+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 --> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ec00a6ac0 con 0x7f4ec00a3f60 2022-09-07T19:43:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.202+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ec40c2f00 con 0x7f4ed40ff720 2022-09-07T19:43:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.203+0000 7f4eda9fd700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] conn(0x7f4ec00a3f60 0x7f4ec00a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.203+0000 7f4eda1fc700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ec0099050 0x7f4ec009b500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005fd0 tx=0x7f4ed0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.203+0000 7f4eda9fd700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] conn(0x7f4ec00a3f60 0x7f4ec00a63f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.204+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== osd.4 v2:172.21.15.154:6808/4252118090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f4ec00a6ac0 con 0x7f4ec00a3f60 2022-09-07T19:43:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.221+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 --> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ed419c6a0 con 0x7f4ec00a3f60 2022-09-07T19:43:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4ecb7fe700 1 -- 172.21.15.80:0/948622153 <== osd.4 v2:172.21.15.154:6808/4252118090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4ecc00b7d0 con 0x7f4ec00a3f60 2022-09-07T19:43:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] conn(0x7f4ec00a3f60 msgr2=0x7f4ec00a63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] conn(0x7f4ec00a3f60 0x7f4ec00a63f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ec0099050 msgr2=0x7f4ec009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ec0099050 0x7f4ec009b500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005fd0 tx=0x7f4ed0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 msgr2=0x7f4ed419c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4edb1fe700 1 --2- 172.21.15.80:0/948622153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed40ff720 0x7f4ed419c010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009fd0 tx=0x7f4ec400e9a0 comp rx=0 tx=0).stop 2022-09-07T19:43:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.222+0000 7f4eda9fd700 1 -- 172.21.15.80:0/948622153 reap_dead start 2022-09-07T19:43:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.223+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 shutdown_connections 2022-09-07T19:43:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.223+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 >> 172.21.15.80:0/948622153 conn(0x7f4ed40f8710 msgr2=0x7f4ed410a340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.223+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 shutdown_connections 2022-09-07T19:43:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:07.223+0000 7f4edb1fe700 1 -- 172.21.15.80:0/948622153 wait complete. 2022-09-07T19:43:07.252 INFO:teuthology.orchestra.run.smithi080.stdout:55834574925 2022-09-07T19:43:07.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.1 2022-09-07T19:43:07.302 INFO:teuthology.orchestra.run.smithi080.stdout:163208757306 2022-09-07T19:43:07.302 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.5 2022-09-07T19:43:07.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:07 smithi080 ceph-mon[90124]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2022-09-07T19:43:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:07 smithi154 ceph-mon[96967]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2022-09-07T19:43:07.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:07 smithi155 ceph-mon[97606]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2022-09-07T19:43:08.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 -- 172.21.15.80:0/3335760319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc100ca0 msgr2=0x7f4ebc104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 --2- 172.21.15.80:0/3335760319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc104cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009780 tx=0x7f4eb0009a90 comp rx=0 tx=0).stop 2022-09-07T19:43:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 -- 172.21.15.80:0/3335760319 shutdown_connections 2022-09-07T19:43:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 --2- 172.21.15.80:0/3335760319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100300 0x7f4ebc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 --2- 172.21.15.80:0/3335760319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ebc105400 0x7f4ebc10cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 --2- 172.21.15.80:0/3335760319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc104cf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.397+0000 7f4ec263c700 1 -- 172.21.15.80:0/3335760319 >> 172.21.15.80:0/3335760319 conn(0x7f4ebc0fbc20 msgr2=0x7f4ebc0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.398+0000 7f4ec263c700 1 -- 172.21.15.80:0/3335760319 shutdown_connections 2022-09-07T19:43:08.400 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.398+0000 7f4ec263c700 1 -- 172.21.15.80:0/3335760319 wait complete. 2022-09-07T19:43:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.399+0000 7f4ec263c700 1 Processor -- start 2022-09-07T19:43:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.399+0000 7f4ec263c700 1 -- start start 2022-09-07T19:43:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec263c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ebc100300 0x7f4ebc195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec263c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec263c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc105400 0x7f4ebc19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec263c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc19af80 con 0x7f4ebc100ca0 2022-09-07T19:43:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec263c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc19b0f0 con 0x7f4ebc105400 2022-09-07T19:43:08.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec263c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc19b2b0 con 0x7f4ebc100300 2022-09-07T19:43:08.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ebb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:08.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec0bd9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc105400 0x7f4ebc19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:08.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec0bd9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc105400 0x7f4ebc19a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:46522/0 (socket says 172.21.15.80:46522) 2022-09-07T19:43:08.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ec0bd9700 1 -- 172.21.15.80:0/674663275 learned_addr learned my addr 172.21.15.80:0/674663275 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:08.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ebb7fe700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47680/0 (socket says 172.21.15.80:47680) 2022-09-07T19:43:08.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.400+0000 7f4ebbfff700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ebc100300 0x7f4ebc195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:08.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebb7fe700 1 -- 172.21.15.80:0/674663275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ebc100300 msgr2=0x7f4ebc195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebb7fe700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ebc100300 0x7f4ebc195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebb7fe700 1 -- 172.21.15.80:0/674663275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc105400 msgr2=0x7f4ebc19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebb7fe700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc105400 0x7f4ebc19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebb7fe700 1 -- 172.21.15.80:0/674663275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0093b0 con 0x7f4ebc100ca0 2022-09-07T19:43:08.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebbfff700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ebc100300 0x7f4ebc195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ebb7fe700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc196490 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009e20 tx=0x7f4eb0018630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb001d070 con 0x7f4ebc100ca0 2022-09-07T19:43:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb00093b0 con 0x7f4ebc100ca0 2022-09-07T19:43:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f4eb0018820 con 0x7f4ebc100ca0 2022-09-07T19:43:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0004760 con 0x7f4ebc100ca0 2022-09-07T19:43:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.401+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc1a2ba0 con 0x7f4ebc100ca0 2022-09-07T19:43:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.402+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ebc0fd120 con 0x7f4ebc100ca0 2022-09-07T19:43:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.404+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f4eb000c040 con 0x7f4ebc100ca0 2022-09-07T19:43:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4eb97fa700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ea4099050 0x7f4ea409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f4eb00c39e0 con 0x7f4ebc100ca0 2022-09-07T19:43:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4ebbfff700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ea4099050 0x7f4ea409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4eb97fa700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] conn(0x7f4ea40a3f60 0x7f4ea40a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 --> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ea40a6ac0 con 0x7f4ea40a3f60 2022-09-07T19:43:08.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4eb00c3db0 con 0x7f4ebc100ca0 2022-09-07T19:43:08.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.406+0000 7f4ec0bd9700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] conn(0x7f4ea40a3f60 0x7f4ea40a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.407+0000 7f4ebbfff700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ea4099050 0x7f4ea409b500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4eac005fd0 tx=0x7f4eac005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.407+0000 7f4ec0bd9700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] conn(0x7f4ea40a3f60 0x7f4ea40a63f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.408+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== osd.9 v2:172.21.15.80:6826/3406803388 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f4ea40a6ac0 con 0x7f4ea40a3f60 2022-09-07T19:43:08.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.425+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 --> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ebc064ea0 con 0x7f4ea40a3f60 2022-09-07T19:43:08.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.425+0000 7f4eb97fa700 1 -- 172.21.15.80:0/674663275 <== osd.9 v2:172.21.15.80:6826/3406803388 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4ebc064ea0 con 0x7f4ea40a3f60 2022-09-07T19:43:08.426 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] conn(0x7f4ea40a3f60 msgr2=0x7f4ea40a63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.426 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] conn(0x7f4ea40a3f60 0x7f4ea40a63f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ea4099050 msgr2=0x7f4ea409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f4ea4099050 0x7f4ea409b500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4eac005fd0 tx=0x7f4eac005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100ca0 msgr2=0x7f4ebc196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 --2- 172.21.15.80:0/674663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ebc100ca0 0x7f4ebc196490 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009e20 tx=0x7f4eb0018630 comp rx=0 tx=0).stop 2022-09-07T19:43:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec0bd9700 1 -- 172.21.15.80:0/674663275 reap_dead start 2022-09-07T19:43:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 shutdown_connections 2022-09-07T19:43:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 >> 172.21.15.80:0/674663275 conn(0x7f4ebc0fbc20 msgr2=0x7f4ebc0fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 shutdown_connections 2022-09-07T19:43:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.426+0000 7f4ec263c700 1 -- 172.21.15.80:0/674663275 wait complete. 2022-09-07T19:43:08.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 -- 172.21.15.80:0/2337966249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 msgr2=0x7f3b10104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:08.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 --2- 172.21.15.80:0/2337966249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 0x7f3b10104cd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009810 tx=0x7f3b00009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:08.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 -- 172.21.15.80:0/2337966249 shutdown_connections 2022-09-07T19:43:08.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 --2- 172.21.15.80:0/2337966249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 0x7f3b101006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 --2- 172.21.15.80:0/2337966249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b101053e0 0x7f3b1010cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 --2- 172.21.15.80:0/2337966249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 0x7f3b10104cd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:08.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 -- 172.21.15.80:0/2337966249 >> 172.21.15.80:0/2337966249 conn(0x7f3b100fbc20 msgr2=0x7f3b100fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:08.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 -- 172.21.15.80:0/2337966249 shutdown_connections 2022-09-07T19:43:08.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.864+0000 7f3b1839f700 1 -- 172.21.15.80:0/2337966249 wait complete. 2022-09-07T19:43:08.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.865+0000 7f3b1839f700 1 Processor -- start 2022-09-07T19:43:09.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.865+0000 7f3b1839f700 1 -- start start 2022-09-07T19:43:09.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1839f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 0x7f3b10195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1839f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 0x7f3b101963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.001 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1839f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b101053e0 0x7f3b1019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1839f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1019ae90 con 0x7f3b101002e0 2022-09-07T19:43:09.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1839f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1019b000 con 0x7f3b101053e0 2022-09-07T19:43:09.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1839f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1019b1c0 con 0x7f3b10100c80 2022-09-07T19:43:09.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1613b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 0x7f3b10195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1613b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 0x7f3b10195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47688/0 (socket says 172.21.15.80:47688) 2022-09-07T19:43:09.004 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1613b700 1 -- 172.21.15.80:0/597609847 learned_addr learned my addr 172.21.15.80:0/597609847 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:09.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1693c700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b101053e0 0x7f3b1019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.005 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.866+0000 7f3b1593a700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 0x7f3b101963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1613b700 1 -- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 msgr2=0x7f3b101963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1613b700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b10100c80 0x7f3b101963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.006 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1613b700 1 -- 172.21.15.80:0/597609847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b101053e0 msgr2=0x7f3b1019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1613b700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b101053e0 0x7f3b1019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1613b700 1 -- 172.21.15.80:0/597609847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0093b0 con 0x7f3b101002e0 2022-09-07T19:43:09.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1613b700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 0x7f3b10195e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00e9c0 tx=0x7f3b0c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:09.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0097b0 con 0x7f3b101002e0 2022-09-07T19:43:09.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b00009470 con 0x7f3b101002e0 2022-09-07T19:43:09.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3b0c00ce70 con 0x7f3b101002e0 2022-09-07T19:43:09.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c003cf0 con 0x7f3b101002e0 2022-09-07T19:43:09.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.867+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1019b640 con 0x7f3b101002e0 2022-09-07T19:43:09.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.868+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b100fd160 con 0x7f3b101002e0 2022-09-07T19:43:09.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.870+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f3b0c01e020 con 0x7f3b101002e0 2022-09-07T19:43:09.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.871+0000 7f3b077fe700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3afc099050 0x7f3afc09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.871+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f3b0c014070 con 0x7f3b101002e0 2022-09-07T19:43:09.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.872+0000 7f3b1593a700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3afc099050 0x7f3afc09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.872+0000 7f3b077fe700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] conn(0x7f3afc0a3f60 0x7f3afc0a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.872+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 --> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3afc0a6ac0 con 0x7f3afc0a3f60 2022-09-07T19:43:09.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.872+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b0c0c3060 con 0x7f3b101002e0 2022-09-07T19:43:09.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.872+0000 7f3b1693c700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] conn(0x7f3afc0a3f60 0x7f3afc0a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.872+0000 7f3b1593a700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3afc099050 0x7f3afc09b500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b10197470 tx=0x7f3b00009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:09.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.873+0000 7f3b1693c700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] conn(0x7f3afc0a3f60 0x7f3afc0a63f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:09.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.874+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== osd.8 v2:172.21.15.155:6816/2568819573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f3afc0a6ac0 con 0x7f3afc0a3f60 2022-09-07T19:43:09.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.893+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 --> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b10064ea0 con 0x7f3afc0a3f60 2022-09-07T19:43:09.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b077fe700 1 -- 172.21.15.80:0/597609847 <== osd.8 v2:172.21.15.155:6816/2568819573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3b10064ea0 con 0x7f3afc0a3f60 2022-09-07T19:43:09.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] conn(0x7f3afc0a3f60 msgr2=0x7f3afc0a63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1839f700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] conn(0x7f3afc0a3f60 0x7f3afc0a63f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3afc099050 msgr2=0x7f3afc09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1839f700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3afc099050 0x7f3afc09b500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b10197470 tx=0x7f3b00009e70 comp rx=0 tx=0).stop 2022-09-07T19:43:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 msgr2=0x7f3b10195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1839f700 1 --2- 172.21.15.80:0/597609847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b101002e0 0x7f3b10195e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00e9c0 tx=0x7f3b0c00ecd0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.894+0000 7f3b1693c700 1 -- 172.21.15.80:0/597609847 reap_dead start 2022-09-07T19:43:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.895+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 shutdown_connections 2022-09-07T19:43:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.895+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 >> 172.21.15.80:0/597609847 conn(0x7f3b100fbc20 msgr2=0x7f3b100fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:09.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.895+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 shutdown_connections 2022-09-07T19:43:09.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:08.895+0000 7f3b1839f700 1 -- 172.21.15.80:0/597609847 wait complete. 2022-09-07T19:43:09.024 INFO:teuthology.orchestra.run.smithi080.stdout:77309411401 2022-09-07T19:43:09.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.2 2022-09-07T19:43:09.037 INFO:teuthology.orchestra.run.smithi080.stdout:141733920829 2022-09-07T19:43:09.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.4 2022-09-07T19:43:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 -- 172.21.15.80:0/746746574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 msgr2=0x7f6a3410ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/746746574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 0x7f6a3410ad70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009b30 tx=0x7f6a2c009e40 comp rx=0 tx=0).stop 2022-09-07T19:43:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 -- 172.21.15.80:0/746746574 shutdown_connections 2022-09-07T19:43:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/746746574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 0x7f6a3410ad70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/746746574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fe0d0 0x7f6a340fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/746746574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340fea70 0x7f6a34102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 -- 172.21.15.80:0/746746574 >> 172.21.15.80:0/746746574 conn(0x7f6a340f9a10 msgr2=0x7f6a340fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:09.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 -- 172.21.15.80:0/746746574 shutdown_connections 2022-09-07T19:43:09.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.257+0000 7f6a3c34c700 1 -- 172.21.15.80:0/746746574 wait complete. 2022-09-07T19:43:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.259+0000 7f6a3c34c700 1 Processor -- start 2022-09-07T19:43:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.259+0000 7f6a3c34c700 1 -- start start 2022-09-07T19:43:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3c34c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340fe0d0 0x7f6a34195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3c34c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fea70 0x7f6a341963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3c34c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 0x7f6a3419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3c34c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3419aed0 con 0x7f6a340fe0d0 2022-09-07T19:43:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3c34c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3419b040 con 0x7f6a341031d0 2022-09-07T19:43:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3c34c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3419b200 con 0x7f6a340fea70 2022-09-07T19:43:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a398e7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fea70 0x7f6a341963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.260+0000 7f6a3a8e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 0x7f6a3419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a398e7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fea70 0x7f6a341963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51094/0 (socket says 172.21.15.80:51094) 2022-09-07T19:43:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a398e7700 1 -- 172.21.15.80:0/1035252164 learned_addr learned my addr 172.21.15.80:0/1035252164 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a0e8700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340fe0d0 0x7f6a34195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a8e9700 1 -- 172.21.15.80:0/1035252164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fea70 msgr2=0x7f6a341963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a8e9700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fea70 0x7f6a341963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a8e9700 1 -- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340fe0d0 msgr2=0x7f6a34195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a8e9700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340fe0d0 0x7f6a34195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.266 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a8e9700 1 -- 172.21.15.80:0/1035252164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009730 con 0x7f6a341031d0 2022-09-07T19:43:09.266 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a398e7700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a340fea70 0x7f6a341963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:09.266 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.261+0000 7f6a3a8e9700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 0x7f6a3419a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009fd0 tx=0x7f6a2c00b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:09.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.262+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c01c070 con 0x7f6a341031d0 2022-09-07T19:43:09.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.262+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3419b480 con 0x7f6a341031d0 2022-09-07T19:43:09.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.262+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6a2c00be00 con 0x7f6a341031d0 2022-09-07T19:43:09.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.262+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c005700 con 0x7f6a341031d0 2022-09-07T19:43:09.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.262+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a341a2cd0 con 0x7f6a341031d0 2022-09-07T19:43:09.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.264+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a34072260 con 0x7f6a341031d0 2022-09-07T19:43:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.265+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f6a2c00c040 con 0x7f6a341031d0 2022-09-07T19:43:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.267+0000 7f6a2b7fe700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6a20099150 0x7f6a2009b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.267+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f6a2c0c38c0 con 0x7f6a341031d0 2022-09-07T19:43:09.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.267+0000 7f6a3a0e8700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6a20099150 0x7f6a2009b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.267+0000 7f6a2b7fe700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] conn(0x7f6a200a4060 0x7f6a200a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:09.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.267+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 --> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a200a6bc0 con 0x7f6a200a4060 2022-09-07T19:43:09.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.267+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a2c0c8280 con 0x7f6a341031d0 2022-09-07T19:43:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.268+0000 7f6a398e7700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] conn(0x7f6a200a4060 0x7f6a200a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.268+0000 7f6a3a0e8700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6a20099150 0x7f6a2009b600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005fd0 tx=0x7f6a30005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.268+0000 7f6a398e7700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] conn(0x7f6a200a4060 0x7f6a200a64f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.270+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== osd.3 v2:172.21.15.80:6810/362298487 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f6a200a6bc0 con 0x7f6a200a4060 2022-09-07T19:43:09.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.297+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 --> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a34064ea0 con 0x7f6a200a4060 2022-09-07T19:43:09.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.298+0000 7f6a2b7fe700 1 -- 172.21.15.80:0/1035252164 <== osd.3 v2:172.21.15.80:6810/362298487 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6a34064ea0 con 0x7f6a200a4060 2022-09-07T19:43:09.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] conn(0x7f6a200a4060 msgr2=0x7f6a200a64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] conn(0x7f6a200a4060 0x7f6a200a64f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6a20099150 msgr2=0x7f6a2009b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6a20099150 0x7f6a2009b600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005fd0 tx=0x7f6a30005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 msgr2=0x7f6a3419a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:09.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 --2- 172.21.15.80:0/1035252164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a341031d0 0x7f6a3419a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009fd0 tx=0x7f6a2c00b9c0 comp rx=0 tx=0).stop 2022-09-07T19:43:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3a8e9700 1 -- 172.21.15.80:0/1035252164 reap_dead start 2022-09-07T19:43:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 shutdown_connections 2022-09-07T19:43:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 >> 172.21.15.80:0/1035252164 conn(0x7f6a340f9a10 msgr2=0x7f6a340fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:09.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 shutdown_connections 2022-09-07T19:43:09.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:09.299+0000 7f6a3c34c700 1 -- 172.21.15.80:0/1035252164 wait complete. 2022-09-07T19:43:09.791 INFO:teuthology.orchestra.run.smithi080.stdout:309237645341 2022-09-07T19:43:09.792 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.10 2022-09-07T19:43:09.863 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:09 smithi080 ceph-mon[90124]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2022-09-07T19:43:09.865 INFO:teuthology.orchestra.run.smithi080.stdout:287762808867 2022-09-07T19:43:09.866 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.9 2022-09-07T19:43:09.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:09 smithi154 ceph-mon[96967]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2022-09-07T19:43:09.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:09 smithi155 ceph-mon[97606]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2022-09-07T19:43:10.049 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.048+0000 7faa7a4d0700 1 -- 172.21.15.80:0/4013965357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 msgr2=0x7faa7410a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.049 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.048+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/4013965357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 0x7faa7410a620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b00 tx=0x7faa6c009e10 comp rx=0 tx=0).stop 2022-09-07T19:43:10.050 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 -- 172.21.15.80:0/4013965357 shutdown_connections 2022-09-07T19:43:10.050 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/4013965357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa740fee70 0x7faa740ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.050 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/4013965357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 0x7faa7410a620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.051 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/4013965357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa740ff780 0x7faa74107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.051 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 -- 172.21.15.80:0/4013965357 >> 172.21.15.80:0/4013965357 conn(0x7faa740f8710 msgr2=0x7faa740fab20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:10.052 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 -- 172.21.15.80:0/4013965357 shutdown_connections 2022-09-07T19:43:10.052 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.049+0000 7faa7a4d0700 1 -- 172.21.15.80:0/4013965357 wait complete. 2022-09-07T19:43:10.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.050+0000 7faa7a4d0700 1 Processor -- start 2022-09-07T19:43:10.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.050+0000 7faa7a4d0700 1 -- start start 2022-09-07T19:43:10.055 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa7a4d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa740fee70 0x7faa74106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa7a4d0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa740ff780 0x7faa741070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa7a4d0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 0x7faa741ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa7a4d0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa741aed10 con 0x7faa740fee70 2022-09-07T19:43:10.056 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa7a4d0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa741aee50 con 0x7faa740ff780 2022-09-07T19:43:10.057 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa7a4d0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa741aef90 con 0x7faa74108240 2022-09-07T19:43:10.057 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa794ce700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa740fee70 0x7faa74106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.057 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa79ccf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 0x7faa741ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.057 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa794ce700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa740fee70 0x7faa74106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47712/0 (socket says 172.21.15.80:47712) 2022-09-07T19:43:10.057 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.051+0000 7faa794ce700 1 -- 172.21.15.80:0/3792459178 learned_addr learned my addr 172.21.15.80:0/3792459178 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:10.058 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa78ccd700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa740ff780 0x7faa741070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.058 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa79ccf700 1 -- 172.21.15.80:0/3792459178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa740ff780 msgr2=0x7faa741070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.058 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa79ccf700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa740ff780 0x7faa741070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.058 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa79ccf700 1 -- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa740fee70 msgr2=0x7faa74106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa79ccf700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa740fee70 0x7faa74106b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa79ccf700 1 -- 172.21.15.80:0/3792459178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009470 con 0x7faa74108240 2022-09-07T19:43:10.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.052+0000 7faa79ccf700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 0x7faa741ae7d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b00 tx=0x7faa6c00bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:10.059 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.053+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00f5d0 con 0x7faa74108240 2022-09-07T19:43:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.053+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7faa6c00fbd0 con 0x7faa74108240 2022-09-07T19:43:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.053+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c017400 con 0x7faa74108240 2022-09-07T19:43:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.054+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c009730 con 0x7faa74108240 2022-09-07T19:43:10.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.054+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa741af4b0 con 0x7faa74108240 2022-09-07T19:43:10.061 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.055+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa740fe580 con 0x7faa74108240 2022-09-07T19:43:10.062 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.057+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7faa6c00c040 con 0x7faa74108240 2022-09-07T19:43:10.063 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.059+0000 7faa6a7fc700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faa600990d0 0x7faa6009b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.059+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7faa6c0c3fa0 con 0x7faa74108240 2022-09-07T19:43:10.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.059+0000 7faa794ce700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faa600990d0 0x7faa6009b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.064 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.059+0000 7faa6a7fc700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] conn(0x7faa600a3fe0 0x7faa600a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.059+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 --> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa600a6b40 con 0x7faa600a3fe0 2022-09-07T19:43:10.065 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.059+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6c0c4350 con 0x7faa74108240 2022-09-07T19:43:10.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.060+0000 7faa78ccd700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] conn(0x7faa600a3fe0 0x7faa600a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.066 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.060+0000 7faa794ce700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faa600990d0 0x7faa6009b580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faa74107bf0 tx=0x7faa70005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:10.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.061+0000 7faa78ccd700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] conn(0x7faa600a3fe0 0x7faa600a6470 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:10.067 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.062+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== osd.11 v2:172.21.15.155:6824/137888946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7faa600a6b40 con 0x7faa600a3fe0 2022-09-07T19:43:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.083+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 --> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa7404d480 con 0x7faa600a3fe0 2022-09-07T19:43:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.084+0000 7faa6a7fc700 1 -- 172.21.15.80:0/3792459178 <== osd.11 v2:172.21.15.155:6824/137888946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faa7404d480 con 0x7faa600a3fe0 2022-09-07T19:43:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] conn(0x7faa600a3fe0 msgr2=0x7faa600a6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] conn(0x7faa600a3fe0 0x7faa600a6470 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faa600990d0 msgr2=0x7faa6009b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faa600990d0 0x7faa6009b580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faa74107bf0 tx=0x7faa70005f60 comp rx=0 tx=0).stop 2022-09-07T19:43:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 msgr2=0x7faa741ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 --2- 172.21.15.80:0/3792459178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74108240 0x7faa741ae7d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b00 tx=0x7faa6c00bb40 comp rx=0 tx=0).stop 2022-09-07T19:43:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa79ccf700 1 -- 172.21.15.80:0/3792459178 reap_dead start 2022-09-07T19:43:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 shutdown_connections 2022-09-07T19:43:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 >> 172.21.15.80:0/3792459178 conn(0x7faa740f8710 msgr2=0x7faa7410a340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.085+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 shutdown_connections 2022-09-07T19:43:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.086+0000 7faa7a4d0700 1 -- 172.21.15.80:0/3792459178 wait complete. 2022-09-07T19:43:10.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.191+0000 7f5b734d6700 1 -- 172.21.15.80:0/3984963514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 msgr2=0x7f5b6c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.191 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.191+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3984963514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 0x7f5b6c10e860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009810 tx=0x7f5b5c009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:10.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 -- 172.21.15.80:0/3984963514 shutdown_connections 2022-09-07T19:43:10.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3984963514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b6c10eda0 0x7f5b6c111180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.192 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3984963514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c073210 0x7f5b6c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3984963514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 0x7f5b6c10e860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.193 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 -- 172.21.15.80:0/3984963514 >> 172.21.15.80:0/3984963514 conn(0x7f5b6c0fbc20 msgr2=0x7f5b6c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:10.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 -- 172.21.15.80:0/3984963514 shutdown_connections 2022-09-07T19:43:10.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.192+0000 7f5b734d6700 1 -- 172.21.15.80:0/3984963514 wait complete. 2022-09-07T19:43:10.194 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.194+0000 7f5b734d6700 1 Processor -- start 2022-09-07T19:43:10.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 -- start start 2022-09-07T19:43:10.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b6c073210 0x7f5b6c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 0x7f5b6c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c10eda0 0x7f5b6c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c19f310 con 0x7f5b6c073210 2022-09-07T19:43:10.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c19f480 con 0x7f5b6c073b20 2022-09-07T19:43:10.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.195+0000 7f5b734d6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c19f640 con 0x7f5b6c10eda0 2022-09-07T19:43:10.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.196+0000 7f5b71a73700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c10eda0 0x7f5b6c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.196+0000 7f5b71a73700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c10eda0 0x7f5b6c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51132/0 (socket says 172.21.15.80:51132) 2022-09-07T19:43:10.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.196+0000 7f5b71a73700 1 -- 172.21.15.80:0/3955099340 learned_addr learned my addr 172.21.15.80:0/3955099340 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:10.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.196+0000 7f5b71272700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b6c073210 0x7f5b6c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.196+0000 7f5b70a71700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 0x7f5b6c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b70a71700 1 -- 172.21.15.80:0/3955099340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c10eda0 msgr2=0x7f5b6c19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b70a71700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c10eda0 0x7f5b6c19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b70a71700 1 -- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b6c073210 msgr2=0x7f5b6c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b70a71700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b6c073210 0x7f5b6c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b70a71700 1 -- 172.21.15.80:0/3955099340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009470 con 0x7f5b6c073b20 2022-09-07T19:43:10.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b71a73700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b6c10eda0 0x7f5b6c19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:10.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.197+0000 7f5b70a71700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 0x7f5b6c19a820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006010 tx=0x7f5b5c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:10.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.198+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c01d070 con 0x7f5b6c073b20 2022-09-07T19:43:10.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.198+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f5b5c003500 con 0x7f5b6c073b20 2022-09-07T19:43:10.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.198+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c19f8c0 con 0x7f5b6c073b20 2022-09-07T19:43:10.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.198+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c1a7110 con 0x7f5b6c073b20 2022-09-07T19:43:10.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.198+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c004500 con 0x7f5b6c073b20 2022-09-07T19:43:10.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.199+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b54000ff0 con 0x7f5b6c073b20 2022-09-07T19:43:10.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.201+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f5b5c028030 con 0x7f5b6c073b20 2022-09-07T19:43:10.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.203+0000 7f5b627fc700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5b580990d0 0x7f5b5809b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.204+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f5b5c0c3230 con 0x7f5b6c073b20 2022-09-07T19:43:10.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.204+0000 7f5b627fc700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] conn(0x7f5b580a3fe0 0x7f5b580a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:10.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.204+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 --> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b580a6b40 con 0x7f5b580a3fe0 2022-09-07T19:43:10.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.204+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b5c0c35a0 con 0x7f5b6c073b20 2022-09-07T19:43:10.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.204+0000 7f5b71272700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5b580990d0 0x7f5b5809b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.205+0000 7f5b71a73700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] conn(0x7f5b580a3fe0 0x7f5b580a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:10.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.205+0000 7f5b71272700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5b580990d0 0x7f5b5809b580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800baf0 tx=0x7f5b6800b2e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:10.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.206+0000 7f5b71a73700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] conn(0x7f5b580a3fe0 0x7f5b580a6470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:10.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.207+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== osd.7 v2:172.21.15.154:6816/1270586283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f5b580a6b40 con 0x7f5b580a3fe0 2022-09-07T19:43:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.232+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 --> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b54002bf0 con 0x7f5b580a3fe0 2022-09-07T19:43:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.235+0000 7f5b627fc700 1 -- 172.21.15.80:0/3955099340 <== osd.7 v2:172.21.15.154:6816/1270586283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5b54002bf0 con 0x7f5b580a3fe0 2022-09-07T19:43:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] conn(0x7f5b580a3fe0 msgr2=0x7f5b580a6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] conn(0x7f5b580a3fe0 0x7f5b580a6470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5b580990d0 msgr2=0x7f5b5809b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5b580990d0 0x7f5b5809b580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800baf0 tx=0x7f5b6800b2e0 comp rx=0 tx=0).stop 2022-09-07T19:43:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 msgr2=0x7f5b6c19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 --2- 172.21.15.80:0/3955099340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c073b20 0x7f5b6c19a820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006010 tx=0x7f5b5c00f690 comp rx=0 tx=0).stop 2022-09-07T19:43:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b71a73700 1 -- 172.21.15.80:0/3955099340 reap_dead start 2022-09-07T19:43:10.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 shutdown_connections 2022-09-07T19:43:10.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.236+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 >> 172.21.15.80:0/3955099340 conn(0x7f5b6c0fbc20 msgr2=0x7f5b6c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.238+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 shutdown_connections 2022-09-07T19:43:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:10.238+0000 7f5b734d6700 1 -- 172.21.15.80:0/3955099340 wait complete. 2022-09-07T19:43:10.659 INFO:teuthology.orchestra.run.smithi080.stdout:343597383704 2022-09-07T19:43:10.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.11 2022-09-07T19:43:10.987 INFO:teuthology.orchestra.run.smithi080.stdout:219043332141 2022-09-07T19:43:10.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.7 2022-09-07T19:43:11.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:11 smithi080 ceph-mon[90124]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:43:11.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:43:11.370 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:43:11.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:11 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:43:11.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:11 smithi155 ceph-mon[97606]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:43:11.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:43:11.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:43:11.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:11 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:43:11.448 INFO:teuthology.orchestra.run.smithi080.stdout:253403070504 2022-09-07T19:43:11.449 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.8 2022-09-07T19:43:11.567 INFO:teuthology.orchestra.run.smithi080.stdout:107374182466 2022-09-07T19:43:11.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.3 2022-09-07T19:43:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:11 smithi154 ceph-mon[96967]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:43:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:43:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:43:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:11 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:43:11.636 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 -- 172.21.15.80:0/3985383668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d80fe840 msgr2=0x7f20d8102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:11.636 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 --2- 172.21.15.80:0/3985383668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d80fe840 0x7f20d8102890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009810 tx=0x7f20cc009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:11.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 -- 172.21.15.80:0/3985383668 shutdown_connections 2022-09-07T19:43:11.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 --2- 172.21.15.80:0/3985383668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 0x7f20d80fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:11.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 --2- 172.21.15.80:0/3985383668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d8102fa0 0x7f20d810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:11.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 --2- 172.21.15.80:0/3985383668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d80fe840 0x7f20d8102890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:11.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 -- 172.21.15.80:0/3985383668 >> 172.21.15.80:0/3985383668 conn(0x7f20d80f9800 msgr2=0x7f20d80fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:11.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 -- 172.21.15.80:0/3985383668 shutdown_connections 2022-09-07T19:43:11.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.611+0000 7f20dcac6700 1 -- 172.21.15.80:0/3985383668 wait complete. 2022-09-07T19:43:11.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.613+0000 7f20dcac6700 1 Processor -- start 2022-09-07T19:43:11.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.613+0000 7f20dcac6700 1 -- start start 2022-09-07T19:43:11.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20dcac6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 0x7f20d8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:11.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20dcac6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d80fe840 0x7f20d8199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:11.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20dcac6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d8102fa0 0x7f20d81938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:11.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20dcac6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8194070 con 0x7f20d80fdea0 2022-09-07T19:43:11.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20dcac6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81941e0 con 0x7f20d80fe840 2022-09-07T19:43:11.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20dcac6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81943a0 con 0x7f20d8102fa0 2022-09-07T19:43:11.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20d77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 0x7f20d8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:11.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20d77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 0x7f20d8199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47756/0 (socket says 172.21.15.80:47756) 2022-09-07T19:43:11.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20d77fe700 1 -- 172.21.15.80:0/2120440707 learned_addr learned my addr 172.21.15.80:0/2120440707 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:11.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.614+0000 7f20d6ffd700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d80fe840 0x7f20d8199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:11.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d7fff700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d8102fa0 0x7f20d81938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:11.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d77fe700 1 -- 172.21.15.80:0/2120440707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d8102fa0 msgr2=0x7f20d81938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:11.642 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d77fe700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d8102fa0 0x7f20d81938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:11.642 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d77fe700 1 -- 172.21.15.80:0/2120440707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d80fe840 msgr2=0x7f20d8199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:11.642 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d77fe700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d80fe840 0x7f20d8199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:11.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d77fe700 1 -- 172.21.15.80:0/2120440707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009470 con 0x7f20d80fdea0 2022-09-07T19:43:11.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.615+0000 7f20d77fe700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 0x7f20d8199860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d700 tx=0x7f20c800da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:11.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.616+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800f890 con 0x7f20d80fdea0 2022-09-07T19:43:11.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.616+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d8194680 con 0x7f20d80fdea0 2022-09-07T19:43:11.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.616+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f20c800fe90 con 0x7f20d80fdea0 2022-09-07T19:43:11.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.616+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8019360 con 0x7f20d80fdea0 2022-09-07T19:43:11.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.616+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d81a0900 con 0x7f20d80fdea0 2022-09-07T19:43:11.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.617+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20d80fad30 con 0x7f20d80fdea0 2022-09-07T19:43:11.645 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.619+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f20c8022070 con 0x7f20d80fdea0 2022-09-07T19:43:11.645 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.620+0000 7f20d4ff9700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f20c00990d0 0x7f20c009b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:11.645 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.621+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f20c80c28e0 con 0x7f20d80fdea0 2022-09-07T19:43:11.645 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.621+0000 7f20d6ffd700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f20c00990d0 0x7f20c009b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:11.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.621+0000 7f20d4ff9700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] conn(0x7f20c00a3fe0 0x7f20c00a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:11.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.621+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 --> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20c00a6b40 con 0x7f20c00a3fe0 2022-09-07T19:43:11.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.621+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20c80c2c50 con 0x7f20d80fdea0 2022-09-07T19:43:11.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.622+0000 7f20d7fff700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] conn(0x7f20c00a3fe0 0x7f20c00a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:11.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.622+0000 7f20d6ffd700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f20c00990d0 0x7f20c009b580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f20d80f9cd0 tx=0x7f20cc009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:11.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.622+0000 7f20d7fff700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] conn(0x7f20c00a3fe0 0x7f20c00a6470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:11.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.623+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== osd.6 v2:172.21.15.80:6818/2212671377 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f20c00a6b40 con 0x7f20c00a3fe0 2022-09-07T19:43:11.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.643+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 --> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20d804d480 con 0x7f20c00a3fe0 2022-09-07T19:43:11.649 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.644+0000 7f20d4ff9700 1 -- 172.21.15.80:0/2120440707 <== osd.6 v2:172.21.15.80:6818/2212671377 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f20d804d480 con 0x7f20c00a3fe0 2022-09-07T19:43:11.649 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] conn(0x7f20c00a3fe0 msgr2=0x7f20c00a6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:11.649 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] conn(0x7f20c00a3fe0 0x7f20c00a6470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:11.649 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f20c00990d0 msgr2=0x7f20c009b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:11.650 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f20c00990d0 0x7f20c009b580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f20d80f9cd0 tx=0x7f20cc009e70 comp rx=0 tx=0).stop 2022-09-07T19:43:11.650 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 msgr2=0x7f20d8199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:11.650 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 --2- 172.21.15.80:0/2120440707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20d80fdea0 0x7f20d8199860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d700 tx=0x7f20c800da10 comp rx=0 tx=0).stop 2022-09-07T19:43:11.650 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20d7fff700 1 -- 172.21.15.80:0/2120440707 reap_dead start 2022-09-07T19:43:11.651 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 shutdown_connections 2022-09-07T19:43:11.651 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 >> 172.21.15.80:0/2120440707 conn(0x7f20d80f9800 msgr2=0x7f20d80fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:11.651 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 shutdown_connections 2022-09-07T19:43:11.651 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:11.645+0000 7f20dcac6700 1 -- 172.21.15.80:0/2120440707 wait complete. 2022-09-07T19:43:11.664 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:12.332 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:12.374 INFO:teuthology.orchestra.run.smithi080.stdout:197568495669 2022-09-07T19:43:12.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph osd last-stat-seq osd.6 2022-09-07T19:43:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:12.416 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:13.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:13 smithi080 ceph-mon[90124]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2022-09-07T19:43:13.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:13 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:13 smithi155 ceph-mon[97606]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2022-09-07T19:43:13.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:13 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:13 smithi154 ceph-mon[96967]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2022-09-07T19:43:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:13 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:14.694 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:15.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:15 smithi080 ceph-mon[90124]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2022-09-07T19:43:15.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:15 smithi155 ceph-mon[97606]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2022-09-07T19:43:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:15 smithi154 ceph-mon[96967]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2022-09-07T19:43:16.516 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.516+0000 7f503ef94700 1 -- 172.21.15.80:0/4226357318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5038102fa0 msgr2=0x7f503810ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:16.517 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.516+0000 7f503ef94700 1 --2- 172.21.15.80:0/4226357318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5038102fa0 0x7f503810ab40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5030009bb0 tx=0x7f5030009ec0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 -- 172.21.15.80:0/4226357318 shutdown_connections 2022-09-07T19:43:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 --2- 172.21.15.80:0/4226357318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50380fdea0 0x7f50380fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 --2- 172.21.15.80:0/4226357318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5038102fa0 0x7f503810ab40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 --2- 172.21.15.80:0/4226357318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 0x7f5038102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 -- 172.21.15.80:0/4226357318 >> 172.21.15.80:0/4226357318 conn(0x7f50380f9800 msgr2=0x7f50380fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:16.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 -- 172.21.15.80:0/4226357318 shutdown_connections 2022-09-07T19:43:16.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.517+0000 7f503ef94700 1 -- 172.21.15.80:0/4226357318 wait complete. 2022-09-07T19:43:16.524 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.518+0000 7f503ef94700 1 Processor -- start 2022-09-07T19:43:16.525 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 -- start start 2022-09-07T19:43:16.525 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50380fdea0 0x7f5038070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:16.525 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 0x7f5038071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:16.525 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5038102fa0 0x7f50381a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:16.526 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038071db0 con 0x7f5038102fa0 2022-09-07T19:43:16.526 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50381a21b0 con 0x7f50380fe840 2022-09-07T19:43:16.526 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.519+0000 7f503ef94700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50381a22f0 con 0x7f50380fdea0 2022-09-07T19:43:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503d791700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 0x7f5038071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50380fdea0 0x7f5038070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503d791700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 0x7f5038071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:52394/0 (socket says 172.21.15.80:52394) 2022-09-07T19:43:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503d791700 1 -- 172.21.15.80:0/1957351109 learned_addr learned my addr 172.21.15.80:0/1957351109 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503e793700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5038102fa0 0x7f50381a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 -- 172.21.15.80:0/1957351109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 msgr2=0x7f5038071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 0x7f5038071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 -- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5038102fa0 msgr2=0x7f50381a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:16.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5038102fa0 0x7f50381a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 -- 172.21.15.80:0/1957351109 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340093b0 con 0x7f50380fdea0 2022-09-07T19:43:16.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.520+0000 7f503df92700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50380fdea0 0x7f5038070fe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f503400e9c0 tx=0x7f503400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:16.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.521+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400cbd0 con 0x7f50380fdea0 2022-09-07T19:43:16.530 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.521+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f503400eeb0 con 0x7f50380fdea0 2022-09-07T19:43:16.530 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.521+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034018680 con 0x7f50380fdea0 2022-09-07T19:43:16.530 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.521+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50300097e0 con 0x7f50380fdea0 2022-09-07T19:43:16.531 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.521+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50381a28b0 con 0x7f50380fdea0 2022-09-07T19:43:16.531 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.522+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503804d480 con 0x7f50380fdea0 2022-09-07T19:43:16.531 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.524+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f503400c040 con 0x7f50380fdea0 2022-09-07T19:43:16.533 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.525+0000 7f502effd700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5024099050 0x7f502409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:16.534 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.525+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f5034014070 con 0x7f50380fdea0 2022-09-07T19:43:16.534 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.526+0000 7f503d791700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5024099050 0x7f502409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:16.534 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.527+0000 7f503d791700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5024099050 0x7f502409b500 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f50380727d0 tx=0x7f5028005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:16.535 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.527+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f503408f290 con 0x7f50380fdea0 2022-09-07T19:43:16.785 INFO:teuthology.orchestra.run.smithi080.stdout:34359738452 2022-09-07T19:43:16.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.782+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f503810dac0 con 0x7f50380fdea0 2022-09-07T19:43:16.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.783+0000 7f502effd700 1 -- 172.21.15.80:0/1957351109 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50340928b0 con 0x7f50380fdea0 2022-09-07T19:43:16.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5024099050 msgr2=0x7f502409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:16.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5024099050 0x7f502409b500 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f50380727d0 tx=0x7f5028005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50380fdea0 msgr2=0x7f5038070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:16.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50380fdea0 0x7f5038070fe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f503400e9c0 tx=0x7f503400ecd0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 shutdown_connections 2022-09-07T19:43:16.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5038102fa0 0x7f50381a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5024099050 0x7f502409b500 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50380fdea0 0x7f5038070fe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 --2- 172.21.15.80:0/1957351109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50380fe840 0x7f5038071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.786+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 >> 172.21.15.80:0/1957351109 conn(0x7f50380f9800 msgr2=0x7f50380fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:16.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.787+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 shutdown_connections 2022-09-07T19:43:16.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:16.787+0000 7f503ef94700 1 -- 172.21.15.80:0/1957351109 wait complete. 2022-09-07T19:43:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.006+0000 7fad0bd27700 1 -- 172.21.15.80:0/3501025559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad041002e0 msgr2=0x7fad041006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.006+0000 7fad0bd27700 1 --2- 172.21.15.80:0/3501025559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad041002e0 0x7fad041006b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad00009810 tx=0x7fad00009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 -- 172.21.15.80:0/3501025559 shutdown_connections 2022-09-07T19:43:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 --2- 172.21.15.80:0/3501025559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad041053e0 0x7fad0410cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 --2- 172.21.15.80:0/3501025559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad041002e0 0x7fad041006b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 --2- 172.21.15.80:0/3501025559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04100c80 0x7fad04104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 -- 172.21.15.80:0/3501025559 >> 172.21.15.80:0/3501025559 conn(0x7fad040fbc20 msgr2=0x7fad040fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 -- 172.21.15.80:0/3501025559 shutdown_connections 2022-09-07T19:43:17.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.007+0000 7fad0bd27700 1 -- 172.21.15.80:0/3501025559 wait complete. 2022-09-07T19:43:17.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.008+0000 7fad0bd27700 1 Processor -- start 2022-09-07T19:43:17.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.008+0000 7fad0bd27700 1 -- start start 2022-09-07T19:43:17.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.009+0000 7fad0bd27700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad041002e0 0x7fad040731f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.009+0000 7fad0bd27700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04100c80 0x7fad04073730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.009+0000 7fad0bd27700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad041053e0 0x7fad04073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.009+0000 7fad0bd27700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041a65a0 con 0x7fad041002e0 2022-09-07T19:43:17.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.009+0000 7fad0bd27700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041a6710 con 0x7fad041053e0 2022-09-07T19:43:17.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.009+0000 7fad0bd27700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041a68d0 con 0x7fad04100c80 2022-09-07T19:43:17.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad092c2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04100c80 0x7fad04073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad0a2c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad041053e0 0x7fad04073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad092c2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04100c80 0x7fad04073730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:49326/0 (socket says 172.21.15.80:49326) 2022-09-07T19:43:17.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad092c2700 1 -- 172.21.15.80:0/963049357 learned_addr learned my addr 172.21.15.80:0/963049357 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:17.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad09ac3700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad041002e0 0x7fad040731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad0a2c4700 1 -- 172.21.15.80:0/963049357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04100c80 msgr2=0x7fad04073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad0a2c4700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04100c80 0x7fad04073730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad0a2c4700 1 -- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad041002e0 msgr2=0x7fad040731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad0a2c4700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad041002e0 0x7fad040731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.010+0000 7fad0a2c4700 1 -- 172.21.15.80:0/963049357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40093b0 con 0x7fad041053e0 2022-09-07T19:43:17.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.011+0000 7fad0a2c4700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad041053e0 0x7fad04073c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7facfc00eb10 tx=0x7facfc00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:17.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.011+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00cbd0 con 0x7fad041053e0 2022-09-07T19:43:17.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.011+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7facfc00cd30 con 0x7fad041053e0 2022-09-07T19:43:17.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.011+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc009730 con 0x7fad041053e0 2022-09-07T19:43:17.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.011+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc010430 con 0x7fad041053e0 2022-09-07T19:43:17.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.011+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad00009470 con 0x7fad041053e0 2022-09-07T19:43:17.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.014+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad04064ea0 con 0x7fad041053e0 2022-09-07T19:43:17.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.017+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7facfc01e020 con 0x7fad041053e0 2022-09-07T19:43:17.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.018+0000 7facfaffd700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7facf0099050 0x7facf009b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.018+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7facfc014070 con 0x7fad041053e0 2022-09-07T19:43:17.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.019+0000 7fad09ac3700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7facf0099050 0x7facf009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.020+0000 7fad09ac3700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7facf0099050 0x7facf009b500 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad00009760 tx=0x7fad00005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:17.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.023+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7facfc08f030 con 0x7fad041053e0 2022-09-07T19:43:17.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3090331385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073b20 msgr2=0x7f46b410e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3090331385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073b20 0x7f46b410e6c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009810 tx=0x7f46a0009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:17.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3090331385 shutdown_connections 2022-09-07T19:43:17.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3090331385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b410ec00 0x7f46b4110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3090331385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4073210 0x7f46b40735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3090331385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073b20 0x7f46b410e6c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3090331385 >> 172.21.15.80:0/3090331385 conn(0x7f46b40fba20 msgr2=0x7f46b40fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3090331385 shutdown_connections 2022-09-07T19:43:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.191+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3090331385 wait complete. 2022-09-07T19:43:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.192+0000 7f46b9c1a700 1 Processor -- start 2022-09-07T19:43:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 -- start start 2022-09-07T19:43:17.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 0x7f46b419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b4073b20 0x7f46b419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b410ec00 0x7f46b419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419f170 con 0x7f46b4073b20 2022-09-07T19:43:17.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419f2e0 con 0x7f46b410ec00 2022-09-07T19:43:17.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.193+0000 7f46b9c1a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419f4a0 con 0x7f46b4073210 2022-09-07T19:43:17.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 0x7f46b419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b4073b20 0x7f46b419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 0x7f46b419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:49340/0 (socket says 172.21.15.80:49340) 2022-09-07T19:43:17.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 -- 172.21.15.80:0/3356755364 learned_addr learned my addr 172.21.15.80:0/3356755364 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:17.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b9419700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b410ec00 0x7f46b419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 -- 172.21.15.80:0/3356755364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b410ec00 msgr2=0x7f46b419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b410ec00 0x7f46b419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 -- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b4073b20 msgr2=0x7f46b419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b4073b20 0x7f46b419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 -- 172.21.15.80:0/3356755364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009470 con 0x7f46b4073210 2022-09-07T19:43:17.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b3fff700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b4073b20 0x7f46b419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:17.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.194+0000 7f46b8c18700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 0x7f46b419a140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46a800e740 tx=0x7f46a800ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:17.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.195+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8005220 con 0x7f46b4073210 2022-09-07T19:43:17.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.195+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b419f780 con 0x7f46b4073210 2022-09-07T19:43:17.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.195+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f46a8005380 con 0x7f46b4073210 2022-09-07T19:43:17.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.195+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8004b70 con 0x7f46b4073210 2022-09-07T19:43:17.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.195+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b41a6fc0 con 0x7f46b4073210 2022-09-07T19:43:17.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.196+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b404d480 con 0x7f46b4073210 2022-09-07T19:43:17.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.198+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f46a801e020 con 0x7f46b4073210 2022-09-07T19:43:17.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.199+0000 7f46b1ffb700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f46a40990d0 0x7f46a409b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.199+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f46a8014070 con 0x7f46b4073210 2022-09-07T19:43:17.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.199+0000 7f46b3fff700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f46a40990d0 0x7f46a409b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.210 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.200+0000 7f46b3fff700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f46a40990d0 0x7f46a409b580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f46b419b750 tx=0x7f46a0009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:17.211 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.203+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f46a808eb60 con 0x7f46b4073210 2022-09-07T19:43:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.297+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fad041a73f0 con 0x7fad041053e0 2022-09-07T19:43:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.298+0000 7facfaffd700 1 -- 172.21.15.80:0/963049357 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facfc092650 con 0x7fad041053e0 2022-09-07T19:43:17.298 INFO:teuthology.orchestra.run.smithi080.stdout:141733920831 2022-09-07T19:43:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7facf0099050 msgr2=0x7facf009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7facf0099050 0x7facf009b500 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad00009760 tx=0x7fad00005910 comp rx=0 tx=0).stop 2022-09-07T19:43:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad041053e0 msgr2=0x7fad04073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad041053e0 0x7fad04073c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7facfc00eb10 tx=0x7facfc00ee20 comp rx=0 tx=0).stop 2022-09-07T19:43:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 shutdown_connections 2022-09-07T19:43:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad041002e0 0x7fad040731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7facf0099050 0x7facf009b500 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad041053e0 0x7fad04073c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 --2- 172.21.15.80:0/963049357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04100c80 0x7fad04073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.300+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 >> 172.21.15.80:0/963049357 conn(0x7fad040fbc20 msgr2=0x7fad04103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.301+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 shutdown_connections 2022-09-07T19:43:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.301+0000 7fad0bd27700 1 -- 172.21.15.80:0/963049357 wait complete. 2022-09-07T19:43:17.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:17 smithi155 ceph-mon[97606]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:43:17.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:17 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1957351109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-09-07T19:43:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.472+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f46b4114140 con 0x7f46b4073210 2022-09-07T19:43:17.476 INFO:teuthology.orchestra.run.smithi080.stdout:343597383705 2022-09-07T19:43:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.473+0000 7f46b1ffb700 1 -- 172.21.15.80:0/3356755364 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f46a8092180 con 0x7f46b4073210 2022-09-07T19:43:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f46a40990d0 msgr2=0x7f46a409b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f46a40990d0 0x7f46a409b580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f46b419b750 tx=0x7f46a0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 msgr2=0x7f46b419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 0x7f46b419a140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46a800e740 tx=0x7f46a800ea50 comp rx=0 tx=0).stop 2022-09-07T19:43:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 shutdown_connections 2022-09-07T19:43:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f46a40990d0 0x7f46a409b580 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b410ec00 0x7f46b419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b4073210 0x7f46b419a140 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 --2- 172.21.15.80:0/3356755364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46b4073b20 0x7f46b419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.477+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 >> 172.21.15.80:0/3356755364 conn(0x7f46b40fba20 msgr2=0x7f46b40fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.478+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 shutdown_connections 2022-09-07T19:43:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.478+0000 7f46b9c1a700 1 -- 172.21.15.80:0/3356755364 wait complete. 2022-09-07T19:43:17.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:17 smithi080 ceph-mon[90124]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:43:17.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:17 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1957351109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-09-07T19:43:17.555 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.516+0000 7f51c941e700 1 -- 172.21.15.80:0/813876831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 msgr2=0x7f51c4066a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.516+0000 7f51c941e700 1 --2- 172.21.15.80:0/813876831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 0x7f51c4066a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009810 tx=0x7f51b4009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 -- 172.21.15.80:0/813876831 shutdown_connections 2022-09-07T19:43:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 --2- 172.21.15.80:0/813876831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c410aa10 0x7f51c410cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 --2- 172.21.15.80:0/813876831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 0x7f51c4066a90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 --2- 172.21.15.80:0/813876831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c410a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 -- 172.21.15.80:0/813876831 >> 172.21.15.80:0/813876831 conn(0x7f51c4073cf0 msgr2=0x7f51c40740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 -- 172.21.15.80:0/813876831 shutdown_connections 2022-09-07T19:43:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.517+0000 7f51c941e700 1 -- 172.21.15.80:0/813876831 wait complete. 2022-09-07T19:43:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.519+0000 7f51c941e700 1 Processor -- start 2022-09-07T19:43:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.519+0000 7f51c941e700 1 -- start start 2022-09-07T19:43:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.520+0000 7f51c941e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 0x7f51c4069250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.520+0000 7f51c941e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.520+0000 7f51c941e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c410aa10 0x7f51c406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.520+0000 7f51c941e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c406d2c0 con 0x7f51c410aa10 2022-09-07T19:43:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.520+0000 7f51c941e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c406d430 con 0x7f51c40666c0 2022-09-07T19:43:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.520+0000 7f51c941e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c406d5f0 con 0x7f51c4066fd0 2022-09-07T19:43:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.522+0000 7f51c27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.523+0000 7f51c37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c410aa10 0x7f51c406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.523+0000 7f51c27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c40697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:49364/0 (socket says 172.21.15.80:49364) 2022-09-07T19:43:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.523+0000 7f51c27fc700 1 -- 172.21.15.80:0/1821091136 learned_addr learned my addr 172.21.15.80:0/1821091136 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.524+0000 7f51c27fc700 1 -- 172.21.15.80:0/1821091136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 msgr2=0x7f51c4069250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.524+0000 7f51c27fc700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 0x7f51c4069250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.524+0000 7f51c27fc700 1 -- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c410aa10 msgr2=0x7f51c406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.524+0000 7f51c27fc700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c410aa10 0x7f51c406cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.524+0000 7f51c27fc700 1 -- 172.21.15.80:0/1821091136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009470 con 0x7f51c4066fd0 2022-09-07T19:43:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.524+0000 7f51c27fc700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c40697d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51b800e740 tx=0x7f51b800eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.525+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8005220 con 0x7f51c4066fd0 2022-09-07T19:43:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.525+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f51b8005380 con 0x7f51c4066fd0 2022-09-07T19:43:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.525+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004c70 con 0x7f51c4066fd0 2022-09-07T19:43:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.526+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c406d8d0 con 0x7f51c4066fd0 2022-09-07T19:43:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.526+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c406ddf0 con 0x7f51c4066fd0 2022-09-07T19:43:17.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.531+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f51b801e020 con 0x7f51c4066fd0 2022-09-07T19:43:17.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.531+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c4064ea0 con 0x7f51c4066fd0 2022-09-07T19:43:17.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.533+0000 7f51a7fff700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f51ac0990d0 0x7f51ac09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.533+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f51b8014070 con 0x7f51c4066fd0 2022-09-07T19:43:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.534+0000 7f51c2ffd700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f51ac0990d0 0x7f51ac09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.536+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f51b808ecd0 con 0x7f51c4066fd0 2022-09-07T19:43:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.536+0000 7f51c2ffd700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f51ac0990d0 0x7f51ac09b580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51b40056d0 tx=0x7f51b4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:17.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:17 smithi154 ceph-mon[96967]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:43:17.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:17 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1957351109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-09-07T19:43:17.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.826+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f51c406da60 con 0x7f51c4066fd0 2022-09-07T19:43:17.827 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.826+0000 7f51a7fff700 1 -- 172.21.15.80:0/1821091136 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b80922f0 con 0x7f51c4066fd0 2022-09-07T19:43:17.828 INFO:teuthology.orchestra.run.smithi080.stdout:287762808869 2022-09-07T19:43:17.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f51ac0990d0 msgr2=0x7f51ac09b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f51ac0990d0 0x7f51ac09b580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51b40056d0 tx=0x7f51b4000bc0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.830 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 msgr2=0x7f51c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:17.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c40697d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51b800e740 tx=0x7f51b800eb00 comp rx=0 tx=0).stop 2022-09-07T19:43:17.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 shutdown_connections 2022-09-07T19:43:17.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c410aa10 0x7f51c406cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.831 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f51ac0990d0 0x7f51ac09b580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51c40666c0 0x7f51c4069250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 --2- 172.21.15.80:0/1821091136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51c4066fd0 0x7f51c40697d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:17.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.830+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 >> 172.21.15.80:0/1821091136 conn(0x7f51c4073cf0 msgr2=0x7f51c40fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:17.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.831+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 shutdown_connections 2022-09-07T19:43:17.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:17.831+0000 7f51c941e700 1 -- 172.21.15.80:0/1821091136 wait complete. 2022-09-07T19:43:18.433 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:18 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/963049357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-09-07T19:43:18.434 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:18 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3356755364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2022-09-07T19:43:18.434 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:18 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1821091136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2022-09-07T19:43:18.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:18 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/963049357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-09-07T19:43:18.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:18 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3356755364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2022-09-07T19:43:18.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:18 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1821091136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2022-09-07T19:43:18.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738450 got 34359738452 for osd.0 2022-09-07T19:43:18.458 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:18.576 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 -- 172.21.15.80:0/1147327617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644100ca0 msgr2=0x7f5644104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:18.576 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 --2- 172.21.15.80:0/1147327617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644100ca0 0x7f5644104cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5634009840 tx=0x7f5634009b50 comp rx=0 tx=0).stop 2022-09-07T19:43:18.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 -- 172.21.15.80:0/1147327617 shutdown_connections 2022-09-07T19:43:18.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 --2- 172.21.15.80:0/1147327617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644105400 0x7f564410cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 --2- 172.21.15.80:0/1147327617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100300 0x7f56441006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 --2- 172.21.15.80:0/1147327617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644100ca0 0x7f5644104cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 -- 172.21.15.80:0/1147327617 >> 172.21.15.80:0/1147327617 conn(0x7f56440fbc20 msgr2=0x7f56440fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:18.579 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 -- 172.21.15.80:0/1147327617 shutdown_connections 2022-09-07T19:43:18.579 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.131+0000 7f564c717700 1 -- 172.21.15.80:0/1147327617 wait complete. 2022-09-07T19:43:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.132+0000 7f564c717700 1 Processor -- start 2022-09-07T19:43:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 -- start start 2022-09-07T19:43:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 0x7f5644195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100ca0 0x7f5644196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644105400 0x7f564419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564419af00 con 0x7f5644100300 2022-09-07T19:43:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564419b070 con 0x7f5644105400 2022-09-07T19:43:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564c717700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564419b230 con 0x7f5644100ca0 2022-09-07T19:43:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564a4b3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 0x7f5644195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564a4b3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 0x7f5644195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51680/0 (socket says 172.21.15.80:51680) 2022-09-07T19:43:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f564a4b3700 1 -- 172.21.15.80:0/3691897918 learned_addr learned my addr 172.21.15.80:0/3691897918 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.133+0000 7f5649cb2700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100ca0 0x7f5644196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564acb4700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644105400 0x7f564419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564a4b3700 1 -- 172.21.15.80:0/3691897918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100ca0 msgr2=0x7f5644196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564a4b3700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100ca0 0x7f5644196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564a4b3700 1 -- 172.21.15.80:0/3691897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644105400 msgr2=0x7f564419a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564a4b3700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644105400 0x7f564419a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564a4b3700 1 -- 172.21.15.80:0/3691897918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634009470 con 0x7f5644100300 2022-09-07T19:43:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f5649cb2700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100ca0 0x7f5644196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.134+0000 7f564a4b3700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 0x7f5644195ed0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f564000e740 tx=0x7f564000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.135+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640005220 con 0x7f5644100300 2022-09-07T19:43:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.135+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564419b510 con 0x7f5644100300 2022-09-07T19:43:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.135+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f5640005380 con 0x7f5644100300 2022-09-07T19:43:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.135+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640004b70 con 0x7f5644100300 2022-09-07T19:43:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.135+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56441a2d00 con 0x7f5644100300 2022-09-07T19:43:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.136+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5644064ea0 con 0x7f5644100300 2022-09-07T19:43:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.140+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f564001e020 con 0x7f5644100300 2022-09-07T19:43:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.141+0000 7f563b7fe700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5630099050 0x7f563009b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.141+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f5640014070 con 0x7f5644100300 2022-09-07T19:43:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.142+0000 7f5649cb2700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5630099050 0x7f563009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.142+0000 7f5649cb2700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5630099050 0x7f563009b500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5634009810 tx=0x7f5634000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.144+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f564008eff0 con 0x7f5644100300 2022-09-07T19:43:18.589 INFO:teuthology.orchestra.run.smithi080.stdout:77309411404 2022-09-07T19:43:18.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.389+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f564410fec0 con 0x7f5644100300 2022-09-07T19:43:18.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.390+0000 7f563b7fe700 1 -- 172.21.15.80:0/3691897918 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5640092610 con 0x7f5644100300 2022-09-07T19:43:18.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5630099050 msgr2=0x7f563009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:18.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5630099050 0x7f563009b500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5634009810 tx=0x7f5634000bc0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 msgr2=0x7f5644195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 0x7f5644195ed0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f564000e740 tx=0x7f564000ea50 comp rx=0 tx=0).stop 2022-09-07T19:43:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 shutdown_connections 2022-09-07T19:43:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5644100300 0x7f5644195ed0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5630099050 0x7f563009b500 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5644105400 0x7f564419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 --2- 172.21.15.80:0/3691897918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5644100ca0 0x7f5644196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 >> 172.21.15.80:0/3691897918 conn(0x7f56440fbc20 msgr2=0x7f56440fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 shutdown_connections 2022-09-07T19:43:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:18.392+0000 7f564c717700 1 -- 172.21.15.80:0/3691897918 wait complete. 2022-09-07T19:43:18.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:18 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/963049357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-09-07T19:43:18.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:18 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3356755364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2022-09-07T19:43:18.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:18 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1821091136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2022-09-07T19:43:18.655 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383704 got 343597383705 for osd.11 2022-09-07T19:43:18.656 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:18.664 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:18.917 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920829 got 141733920831 for osd.4 2022-09-07T19:43:18.918 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:19.206 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808867 got 287762808869 for osd.9 2022-09-07T19:43:19.207 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:19.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:19 smithi080 ceph-mon[90124]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:43:19.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:19 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3691897918' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-09-07T19:43:19.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:19 smithi155 ceph-mon[97606]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:43:19.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:19 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3691897918' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-09-07T19:43:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:19 smithi154 ceph-mon[96967]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:43:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:19 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3691897918' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-09-07T19:43:20.007 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.007+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/1632638222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81002e0 msgr2=0x7fa9d81006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.007+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/1632638222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81002e0 0x7fa9d81006b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009840 tx=0x7fa9c8009b50 comp rx=0 tx=0).stop 2022-09-07T19:43:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/1632638222 shutdown_connections 2022-09-07T19:43:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/1632638222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81002e0 0x7fa9d81006b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/1632638222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81053e0 0x7fa9d810cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/1632638222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d8100c80 0x7fa9d8104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/1632638222 >> 172.21.15.80:0/1632638222 conn(0x7fa9d80fbc20 msgr2=0x7fa9d80fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/1632638222 shutdown_connections 2022-09-07T19:43:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.008+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/1632638222 wait complete. 2022-09-07T19:43:20.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.009+0000 7fa9dcfbf700 1 Processor -- start 2022-09-07T19:43:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.009+0000 7fa9dcfbf700 1 -- start start 2022-09-07T19:43:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.009+0000 7fa9dcfbf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 0x7fa9d8195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9dcfbf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d8100c80 0x7fa9d81963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9dcfbf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81053e0 0x7fa9d819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9dcfbf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d819aec0 con 0x7fa9d81053e0 2022-09-07T19:43:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9dcfbf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d819b030 con 0x7fa9d81002e0 2022-09-07T19:43:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9dcfbf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d819b1f0 con 0x7fa9d8100c80 2022-09-07T19:43:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9d659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 0x7fa9d8195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9d659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 0x7fa9d8195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:52492/0 (socket says 172.21.15.80:52492) 2022-09-07T19:43:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9d659c700 1 -- 172.21.15.80:0/3219260911 learned_addr learned my addr 172.21.15.80:0/3219260911 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9d6d9d700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81053e0 0x7fa9d819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9d5d9b700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d8100c80 0x7fa9d81963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.010+0000 7fa9d659c700 1 -- 172.21.15.80:0/3219260911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d8100c80 msgr2=0x7fa9d81963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9d659c700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d8100c80 0x7fa9d81963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9d659c700 1 -- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81053e0 msgr2=0x7fa9d819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9d659c700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81053e0 0x7fa9d819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9d659c700 1 -- 172.21.15.80:0/3219260911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8009470 con 0x7fa9d81002e0 2022-09-07T19:43:20.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9d659c700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 0x7fa9d8195e90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009760 tx=0x7fa9c800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:20.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c801d070 con 0x7fa9d81002e0 2022-09-07T19:43:20.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d819b470 con 0x7fa9d81002e0 2022-09-07T19:43:20.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fa9c800be50 con 0x7fa9d81002e0 2022-09-07T19:43:20.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8004760 con 0x7fa9d81002e0 2022-09-07T19:43:20.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.011+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d81a2cc0 con 0x7fa9d81002e0 2022-09-07T19:43:20.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.012+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d8064ea0 con 0x7fa9d81002e0 2022-09-07T19:43:20.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.014+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fa9c8028020 con 0x7fa9d81002e0 2022-09-07T19:43:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.016+0000 7fa9c77fe700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa9c00990d0 0x7fa9c009b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.016+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fa9c80c38d0 con 0x7fa9d81002e0 2022-09-07T19:43:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.016+0000 7fa9d5d9b700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa9c00990d0 0x7fa9c009b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.017+0000 7fa9d5d9b700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa9c00990d0 0x7fa9c009b580 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9d81974a0 tx=0x7fa9cc00b2e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.018+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa9c808fc20 con 0x7fa9d81002e0 2022-09-07T19:43:20.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.276+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa9d81972b0 con 0x7fa9d81002e0 2022-09-07T19:43:20.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.277+0000 7fa9c77fe700 1 -- 172.21.15.80:0/3219260911 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9c8093240 con 0x7fa9d81002e0 2022-09-07T19:43:20.277 INFO:teuthology.orchestra.run.smithi080.stdout:163208757309 2022-09-07T19:43:20.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa9c00990d0 msgr2=0x7fa9c009b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:20.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa9c00990d0 0x7fa9c009b580 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9d81974a0 tx=0x7fa9cc00b2e0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 msgr2=0x7fa9d8195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:20.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 0x7fa9d8195e90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009760 tx=0x7fa9c800f690 comp rx=0 tx=0).stop 2022-09-07T19:43:20.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 shutdown_connections 2022-09-07T19:43:20.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9d81053e0 0x7fa9d819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa9c00990d0 0x7fa9c009b580 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d81002e0 0x7fa9d8195e90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 --2- 172.21.15.80:0/3219260911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d8100c80 0x7fa9d81963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:20.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.279+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 >> 172.21.15.80:0/3219260911 conn(0x7fa9d80fbc20 msgr2=0x7fa9d80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:20.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.280+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 shutdown_connections 2022-09-07T19:43:20.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:20.280+0000 7fa9dcfbf700 1 -- 172.21.15.80:0/3219260911 wait complete. 2022-09-07T19:43:20.683 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:21.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:21 smithi080 ceph-mon[90124]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:21.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:21 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3219260911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-09-07T19:43:21.414 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757309 for osd.5 2022-09-07T19:43:21.414 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:21.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:21 smithi155 ceph-mon[97606]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:21.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:21 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3219260911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-09-07T19:43:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:21 smithi154 ceph-mon[96967]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:21 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3219260911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-09-07T19:43:21.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.698+0000 7f739f770700 1 -- 172.21.15.80:0/188410095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 msgr2=0x7f739810a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.698+0000 7f739f770700 1 --2- 172.21.15.80:0/188410095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 0x7f739810a4d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7388009810 tx=0x7f7388009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 -- 172.21.15.80:0/188410095 shutdown_connections 2022-09-07T19:43:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 --2- 172.21.15.80:0/188410095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f739810aa10 0x7f739810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 --2- 172.21.15.80:0/188410095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73980666c0 0x7f7398066a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 --2- 172.21.15.80:0/188410095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 0x7f739810a4d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 -- 172.21.15.80:0/188410095 >> 172.21.15.80:0/188410095 conn(0x7f7398073cf0 msgr2=0x7f73980740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 -- 172.21.15.80:0/188410095 shutdown_connections 2022-09-07T19:43:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.699+0000 7f739f770700 1 -- 172.21.15.80:0/188410095 wait complete. 2022-09-07T19:43:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.700+0000 7f739f770700 1 Processor -- start 2022-09-07T19:43:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.700+0000 7f739f770700 1 -- start start 2022-09-07T19:43:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.700+0000 7f739f770700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73980666c0 0x7f7398195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739f770700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 0x7f73981964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739f770700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 0x7f739819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739f770700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739819afa0 con 0x7f7398066fd0 2022-09-07T19:43:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739f770700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739819b110 con 0x7f73980666c0 2022-09-07T19:43:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739f770700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739819b2d0 con 0x7f739810aa10 2022-09-07T19:43:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739d50c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73980666c0 0x7f7398195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739dd0d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 0x7f739819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739d50c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73980666c0 0x7f7398195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:52536/0 (socket says 172.21.15.80:52536) 2022-09-07T19:43:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739d50c700 1 -- 172.21.15.80:0/2155300252 learned_addr learned my addr 172.21.15.80:0/2155300252 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739dd0d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 0x7f739819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:49424/0 (socket says 172.21.15.80:49424) 2022-09-07T19:43:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.701+0000 7f739cd0b700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 0x7f73981964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739dd0d700 1 -- 172.21.15.80:0/2155300252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73980666c0 msgr2=0x7f7398195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739dd0d700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73980666c0 0x7f7398195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739dd0d700 1 -- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 msgr2=0x7f73981964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739dd0d700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 0x7f73981964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739dd0d700 1 -- 172.21.15.80:0/2155300252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009470 con 0x7f739810aa10 2022-09-07T19:43:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739dd0d700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 0x7f739819a910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f739000ea80 tx=0x7f739000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900098c0 con 0x7f739810aa10 2022-09-07T19:43:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739819b5b0 con 0x7f739810aa10 2022-09-07T19:43:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f739000ce10 con 0x7f739810aa10 2022-09-07T19:43:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390004280 con 0x7f739810aa10 2022-09-07T19:43:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.702+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73981a2df0 con 0x7f739810aa10 2022-09-07T19:43:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.703+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7398064ea0 con 0x7f739810aa10 2022-09-07T19:43:21.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.705+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f739000c040 con 0x7f739810aa10 2022-09-07T19:43:21.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.706+0000 7f738e7fc700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7384099050 0x7f738409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.707+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f7390014070 con 0x7f739810aa10 2022-09-07T19:43:21.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.707+0000 7f739d50c700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7384099050 0x7f738409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.708+0000 7f739d50c700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7384099050 0x7f738409b500 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73940057d0 tx=0x7f7394005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:21.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.710+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f739008eb90 con 0x7f739810aa10 2022-09-07T19:43:21.865 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411401 got 77309411404 for osd.2 2022-09-07T19:43:21.866 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:21.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 -- 172.21.15.80:0/3579930313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 msgr2=0x7f38a4066a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 --2- 172.21.15.80:0/3579930313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 0x7f38a4066a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3894009810 tx=0x7f3894009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 -- 172.21.15.80:0/3579930313 shutdown_connections 2022-09-07T19:43:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 --2- 172.21.15.80:0/3579930313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 0x7f38a4066a90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 --2- 172.21.15.80:0/3579930313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38a410aa10 0x7f38a410cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 --2- 172.21.15.80:0/3579930313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a410a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.408+0000 7f38a9c70700 1 -- 172.21.15.80:0/3579930313 >> 172.21.15.80:0/3579930313 conn(0x7f38a4073cf0 msgr2=0x7f38a40740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:21.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.409+0000 7f38a9c70700 1 -- 172.21.15.80:0/3579930313 shutdown_connections 2022-09-07T19:43:21.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.409+0000 7f38a9c70700 1 -- 172.21.15.80:0/3579930313 wait complete. 2022-09-07T19:43:21.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.410+0000 7f38a9c70700 1 Processor -- start 2022-09-07T19:43:21.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.410+0000 7f38a9c70700 1 -- start start 2022-09-07T19:43:21.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.411+0000 7f38a9c70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 0x7f38a40ff140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.411+0000 7f38a9c70700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a40ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.411+0000 7f38a9c70700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38a410aa10 0x7f38a40ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.411+0000 7f38a9c70700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41a6650 con 0x7f38a40666c0 2022-09-07T19:43:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.411+0000 7f38a9c70700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41a67c0 con 0x7f38a410aa10 2022-09-07T19:43:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.411+0000 7f38a9c70700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41a6980 con 0x7f38a4066fd0 2022-09-07T19:43:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a40ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a40ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:49408/0 (socket says 172.21.15.80:49408) 2022-09-07T19:43:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 -- 172.21.15.80:0/2133704765 learned_addr learned my addr 172.21.15.80:0/2133704765 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a3fff700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38a410aa10 0x7f38a40ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a37fe700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 0x7f38a40ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 -- 172.21.15.80:0/2133704765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38a410aa10 msgr2=0x7f38a40ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38a410aa10 0x7f38a40ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 -- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 msgr2=0x7f38a40ff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 0x7f38a40ff140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.915 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 -- 172.21.15.80:0/2133704765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894009470 con 0x7f38a4066fd0 2022-09-07T19:43:21.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.412+0000 7f38a2ffd700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a40ff680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f389800e740 tx=0x7f389800eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:21.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.413+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898005220 con 0x7f38a4066fd0 2022-09-07T19:43:21.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.413+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3898005380 con 0x7f38a4066fd0 2022-09-07T19:43:21.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.413+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a41a6c60 con 0x7f38a4066fd0 2022-09-07T19:43:21.916 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.413+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898004c10 con 0x7f38a4066fd0 2022-09-07T19:43:21.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.413+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a41a71c0 con 0x7f38a4066fd0 2022-09-07T19:43:21.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.415+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a4064ea0 con 0x7f38a4066fd0 2022-09-07T19:43:21.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.418+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f389801e020 con 0x7f38a4066fd0 2022-09-07T19:43:21.917 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.420+0000 7f38a0ff9700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f388c099150 0x7f388c09b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:21.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.420+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f3898014070 con 0x7f38a4066fd0 2022-09-07T19:43:21.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.421+0000 7f38a37fe700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f388c099150 0x7f388c09b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:21.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.422+0000 7f38a37fe700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f388c099150 0x7f388c09b600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3894009760 tx=0x7f3894009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:21.918 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.423+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f389808ec90 con 0x7f38a4066fd0 2022-09-07T19:43:21.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.711+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f38a410ff00 con 0x7f38a4066fd0 2022-09-07T19:43:21.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.711+0000 7f38a0ff9700 1 -- 172.21.15.80:0/2133704765 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38980922b0 con 0x7f38a4066fd0 2022-09-07T19:43:21.919 INFO:teuthology.orchestra.run.smithi080.stdout:219043332143 2022-09-07T19:43:21.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f388c099150 msgr2=0x7f388c09b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f388c099150 0x7f388c09b600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3894009760 tx=0x7f3894009e70 comp rx=0 tx=0).stop 2022-09-07T19:43:21.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 msgr2=0x7f38a40ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a40ff680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f389800e740 tx=0x7f389800eb00 comp rx=0 tx=0).stop 2022-09-07T19:43:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 shutdown_connections 2022-09-07T19:43:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a40666c0 0x7f38a40ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f388c099150 0x7f388c09b600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38a410aa10 0x7f38a40ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 --2- 172.21.15.80:0/2133704765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38a4066fd0 0x7f38a40ff680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 >> 172.21.15.80:0/2133704765 conn(0x7f38a4073cf0 msgr2=0x7f38a40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 shutdown_connections 2022-09-07T19:43:21.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.714+0000 7f38a9c70700 1 -- 172.21.15.80:0/2133704765 wait complete. 2022-09-07T19:43:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.955+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f73981a3460 con 0x7f739810aa10 2022-09-07T19:43:21.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.956+0000 7f738e7fc700 1 -- 172.21.15.80:0/2155300252 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f739001c090 con 0x7f739810aa10 2022-09-07T19:43:21.957 INFO:teuthology.orchestra.run.smithi080.stdout:309237645344 2022-09-07T19:43:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7384099050 msgr2=0x7f738409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7384099050 0x7f738409b500 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73940057d0 tx=0x7f7394005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 msgr2=0x7f739819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 0x7f739819a910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f739000ea80 tx=0x7f739000ed90 comp rx=0 tx=0).stop 2022-09-07T19:43:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 shutdown_connections 2022-09-07T19:43:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f7384099050 0x7f738409b500 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739810aa10 0x7f739819a910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73980666c0 0x7f7398195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 --2- 172.21.15.80:0/2155300252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7398066fd0 0x7f73981964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 >> 172.21.15.80:0/2155300252 conn(0x7f7398073cf0 msgr2=0x7f73980fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 shutdown_connections 2022-09-07T19:43:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:21.959+0000 7f739f770700 1 -- 172.21.15.80:0/2155300252 wait complete. 2022-09-07T19:43:22.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:22 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2133704765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2022-09-07T19:43:22.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:22 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2155300252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2022-09-07T19:43:22.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:22 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2133704765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2022-09-07T19:43:22.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:22 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2155300252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2022-09-07T19:43:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:22.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:22 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2133704765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2022-09-07T19:43:22.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:22 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2155300252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2022-09-07T19:43:23.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 -- 172.21.15.80:0/532516363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 msgr2=0x7f8ecc1006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:23.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/532516363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc1006b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009840 tx=0x7f8ebc009b50 comp rx=0 tx=0).stop 2022-09-07T19:43:23.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 -- 172.21.15.80:0/532516363 shutdown_connections 2022-09-07T19:43:23.365 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/532516363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ecc1053e0 0x7f8ecc10cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/532516363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc1006b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/532516363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc100c80 0x7f8ecc104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.366 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 -- 172.21.15.80:0/532516363 >> 172.21.15.80:0/532516363 conn(0x7f8ecc0fbc20 msgr2=0x7f8ecc0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:23.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.364+0000 7f8ed1d98700 1 -- 172.21.15.80:0/532516363 shutdown_connections 2022-09-07T19:43:23.367 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.365+0000 7f8ed1d98700 1 -- 172.21.15.80:0/532516363 wait complete. 2022-09-07T19:43:23.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.366+0000 7f8ed1d98700 1 Processor -- start 2022-09-07T19:43:23.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.366+0000 7f8ed1d98700 1 -- start start 2022-09-07T19:43:23.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.366+0000 7f8ed1d98700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:23.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.366+0000 7f8ed1d98700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ecc100c80 0x7f8ecc1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:23.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ed1d98700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc1053e0 0x7f8ecc19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:23.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ed1d98700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19aed0 con 0x7f8ecc1053e0 2022-09-07T19:43:23.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ed1d98700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19b040 con 0x7f8ecc1002e0 2022-09-07T19:43:23.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ed1d98700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19b200 con 0x7f8ecc100c80 2022-09-07T19:43:23.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:23.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:40518/0 (socket says 172.21.15.80:40518) 2022-09-07T19:43:23.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 -- 172.21.15.80:0/1036566848 learned_addr learned my addr 172.21.15.80:0/1036566848 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:23.371 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ecc100c80 0x7f8ecc1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:23.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc1053e0 0x7f8ecc19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:23.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 -- 172.21.15.80:0/1036566848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ecc100c80 msgr2=0x7f8ecc1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:23.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ecc100c80 0x7f8ecc1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.372 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 -- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc1053e0 msgr2=0x7f8ecc19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:23.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc1053e0 0x7f8ecc19a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.367+0000 7f8ecb7fe700 1 -- 172.21.15.80:0/1036566848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009470 con 0x7f8ecc1002e0 2022-09-07T19:43:23.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.368+0000 7f8ecb7fe700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc195ea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009810 tx=0x7f8ebc00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:23.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.368+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc01d070 con 0x7f8ecc1002e0 2022-09-07T19:43:23.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.368+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc19b480 con 0x7f8ecc1002e0 2022-09-07T19:43:23.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.368+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f8ebc005880 con 0x7f8ecc1002e0 2022-09-07T19:43:23.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.368+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc1a2cd0 con 0x7f8ecc1002e0 2022-09-07T19:43:23.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.368+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0047f0 con 0x7f8ecc1002e0 2022-09-07T19:43:23.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.369+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc064ea0 con 0x7f8ecc1002e0 2022-09-07T19:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.372+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f8ebc028030 con 0x7f8ecc1002e0 2022-09-07T19:43:23.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.373+0000 7f8ec8ff9700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8eb40990d0 0x7f8eb409b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:23.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.373+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f8ebc0c3230 con 0x7f8ecc1002e0 2022-09-07T19:43:23.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.373+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8eb40990d0 0x7f8eb409b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:23.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.374+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8eb40990d0 0x7f8eb409b580 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc1974b0 tx=0x7f8ec0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:23.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.375+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f8ebc08f580 con 0x7f8ecc1002e0 2022-09-07T19:43:23.424 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:23 smithi080 ceph-mon[90124]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2022-09-07T19:43:23.425 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:23 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:23.425 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:23 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:23.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:23 smithi155 ceph-mon[97606]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2022-09-07T19:43:23.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:23 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:23.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:23 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:23.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645341 got 309237645344 for osd.10 2022-09-07T19:43:23.459 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:23 smithi154 ceph-mon[96967]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2022-09-07T19:43:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:23 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:23 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.624+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ecc10fed0 con 0x7f8ecc1002e0 2022-09-07T19:43:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.625+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/1036566848 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ebc026020 con 0x7f8ecc1002e0 2022-09-07T19:43:23.625 INFO:teuthology.orchestra.run.smithi080.stdout:107374182469 2022-09-07T19:43:23.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.627+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8eb40990d0 msgr2=0x7f8eb409b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:23.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.627+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8eb40990d0 0x7f8eb409b580 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc1974b0 tx=0x7f8ec0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.627+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 msgr2=0x7f8ecc195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:23.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.627+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc195ea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009810 tx=0x7f8ebc00f690 comp rx=0 tx=0).stop 2022-09-07T19:43:23.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 shutdown_connections 2022-09-07T19:43:23.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc1053e0 0x7f8ecc19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8eb40990d0 0x7f8eb409b580 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc1002e0 0x7f8ecc195ea0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 --2- 172.21.15.80:0/1036566848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ecc100c80 0x7f8ecc1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 >> 172.21.15.80:0/1036566848 conn(0x7f8ecc0fbc20 msgr2=0x7f8ecc103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 shutdown_connections 2022-09-07T19:43:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:23.628+0000 7f8ed1d98700 1 -- 172.21.15.80:0/1036566848 wait complete. 2022-09-07T19:43:23.994 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332141 got 219043332143 for osd.7 2022-09-07T19:43:23.995 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:24.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/2066854547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 msgr2=0x7f6db80fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:24.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/2066854547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db80fe4a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009840 tx=0x7f6da8009b50 comp rx=0 tx=0).stop 2022-09-07T19:43:24.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/2066854547 shutdown_connections 2022-09-07T19:43:24.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/2066854547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db80fe4a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/2066854547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db81031d0 0x7f6db810ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/2066854547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db80fea70 0x7f6db8102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/2066854547 >> 172.21.15.80:0/2066854547 conn(0x7f6db80f9a10 msgr2=0x7f6db80fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:24.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/2066854547 shutdown_connections 2022-09-07T19:43:24.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.302+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/2066854547 wait complete. 2022-09-07T19:43:24.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.304+0000 7f6dbd6bc700 1 Processor -- start 2022-09-07T19:43:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.304+0000 7f6dbd6bc700 1 -- start start 2022-09-07T19:43:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6dbd6bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db8195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6dbd6bc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db80fea70 0x7f6db81963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6dbd6bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db81031d0 0x7f6db819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6dbd6bc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db819aea0 con 0x7f6db80fe0d0 2022-09-07T19:43:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6dbd6bc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db819b010 con 0x7f6db81031d0 2022-09-07T19:43:24.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6dbd6bc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db819b1d0 con 0x7f6db80fea70 2022-09-07T19:43:24.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6db6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db8195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:24.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6db6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db8195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57152/0 (socket says 172.21.15.80:57152) 2022-09-07T19:43:24.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6db77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db81031d0 0x7f6db819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6db6ffd700 1 -- 172.21.15.80:0/773418866 learned_addr learned my addr 172.21.15.80:0/773418866 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.305+0000 7f6db67fc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db80fea70 0x7f6db81963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db67fc700 1 -- 172.21.15.80:0/773418866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db81031d0 msgr2=0x7f6db819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db67fc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db81031d0 0x7f6db819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db67fc700 1 -- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 msgr2=0x7f6db8195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db67fc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db8195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db67fc700 1 -- 172.21.15.80:0/773418866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0093b0 con 0x7f6db80fea70 2022-09-07T19:43:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db6ffd700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db8195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6db67fc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db80fea70 0x7f6db81963b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00e9c0 tx=0x7f6dac00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac004220 con 0x7f6db80fea70 2022-09-07T19:43:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da8009470 con 0x7f6db80fea70 2022-09-07T19:43:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6dac004380 con 0x7f6db80fea70 2022-09-07T19:43:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac003cf0 con 0x7f6db80fea70 2022-09-07T19:43:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.306+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db81a2ca0 con 0x7f6db80fea70 2022-09-07T19:43:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.307+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db8064ea0 con 0x7f6db80fea70 2022-09-07T19:43:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.309+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f6dac01e020 con 0x7f6db80fea70 2022-09-07T19:43:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.310+0000 7f6d9ffff700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6da0099050 0x7f6da009b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.311+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f6dac014070 con 0x7f6db80fea70 2022-09-07T19:43:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.311+0000 7f6db6ffd700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6da0099050 0x7f6da009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.311+0000 7f6db6ffd700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6da0099050 0x7f6da009b500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6da800b600 tx=0x7f6da8005930 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.315+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f6dac08eeb0 con 0x7f6db80fea70 2022-09-07T19:43:24.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:24 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1036566848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-09-07T19:43:24.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:24 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:24.539 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.538+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f6db81a3250 con 0x7f6db80fea70 2022-09-07T19:43:24.540 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.539+0000 7f6d9ffff700 1 -- 172.21.15.80:0/773418866 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dac0924d0 con 0x7f6db80fea70 2022-09-07T19:43:24.541 INFO:teuthology.orchestra.run.smithi080.stdout:253403070507 2022-09-07T19:43:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6da0099050 msgr2=0x7f6da009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6da0099050 0x7f6da009b500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6da800b600 tx=0x7f6da8005930 comp rx=0 tx=0).stop 2022-09-07T19:43:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db80fea70 msgr2=0x7f6db81963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db80fea70 0x7f6db81963b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00e9c0 tx=0x7f6dac00ecd0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 shutdown_connections 2022-09-07T19:43:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db80fe0d0 0x7f6db8195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6da0099050 0x7f6da009b500 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db81031d0 0x7f6db819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 --2- 172.21.15.80:0/773418866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db80fea70 0x7f6db81963b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.541+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 >> 172.21.15.80:0/773418866 conn(0x7f6db80f9a10 msgr2=0x7f6db80fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.542+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 shutdown_connections 2022-09-07T19:43:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:24.542+0000 7f6dbd6bc700 1 -- 172.21.15.80:0/773418866 wait complete. 2022-09-07T19:43:24.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:24 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1036566848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-09-07T19:43:24.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:24 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:24.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:24 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1036566848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-09-07T19:43:24.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:24 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' 2022-09-07T19:43:24.702 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182466 got 107374182469 for osd.3 2022-09-07T19:43:24.702 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:25.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:25 smithi080 ceph-mon[90124]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:43:25.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:25 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/773418866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2022-09-07T19:43:25.415 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070504 got 253403070507 for osd.8 2022-09-07T19:43:25.415 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:25.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.431+0000 7efe4121a700 1 -- 172.21.15.80:0/42159843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c066c00 msgr2=0x7efe3c067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.431+0000 7efe4121a700 1 --2- 172.21.15.80:0/42159843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c066c00 0x7efe3c067050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe30009810 tx=0x7efe30009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 -- 172.21.15.80:0/42159843 shutdown_connections 2022-09-07T19:43:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 --2- 172.21.15.80:0/42159843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 0x7efe3c0666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 --2- 172.21.15.80:0/42159843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe3c1008d0 0x7efe3c100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 --2- 172.21.15.80:0/42159843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c066c00 0x7efe3c067050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 -- 172.21.15.80:0/42159843 >> 172.21.15.80:0/42159843 conn(0x7efe3c073cf0 msgr2=0x7efe3c0740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 -- 172.21.15.80:0/42159843 shutdown_connections 2022-09-07T19:43:25.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.432+0000 7efe4121a700 1 -- 172.21.15.80:0/42159843 wait complete. 2022-09-07T19:43:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.433+0000 7efe4121a700 1 Processor -- start 2022-09-07T19:43:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 -- start start 2022-09-07T19:43:25.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe3c066c00 0x7efe3c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 0x7efe3c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 0x7efe3c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19f250 con 0x7efe3c102d40 2022-09-07T19:43:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19f3c0 con 0x7efe3c1008d0 2022-09-07T19:43:25.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.434+0000 7efe4121a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19f580 con 0x7efe3c066c00 2022-09-07T19:43:25.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3b59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 0x7efe3c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 0x7efe3c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe3c066c00 0x7efe3c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3b59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 0x7efe3c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57170/0 (socket says 172.21.15.80:57170) 2022-09-07T19:43:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 0x7efe3c19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:40560/0 (socket says 172.21.15.80:40560) 2022-09-07T19:43:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3b59e700 1 -- 172.21.15.80:0/2047108371 learned_addr learned my addr 172.21.15.80:0/2047108371 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 -- 172.21.15.80:0/2047108371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe3c066c00 msgr2=0x7efe3c19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe3c066c00 0x7efe3c19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 -- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 msgr2=0x7efe3c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 0x7efe3c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 -- 172.21.15.80:0/2047108371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30009470 con 0x7efe3c1008d0 2022-09-07T19:43:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.435+0000 7efe3a59c700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 0x7efe3c19a7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe300059c0 tx=0x7efe3000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.436+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3001d070 con 0x7efe3c1008d0 2022-09-07T19:43:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.436+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efe3000f880 con 0x7efe3c1008d0 2022-09-07T19:43:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.436+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c19f860 con 0x7efe3c1008d0 2022-09-07T19:43:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.436+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30004760 con 0x7efe3c1008d0 2022-09-07T19:43:25.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.436+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c1a7050 con 0x7efe3c1008d0 2022-09-07T19:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.437+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c064ea0 con 0x7efe3c1008d0 2022-09-07T19:43:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.439+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7efe30028030 con 0x7efe3c1008d0 2022-09-07T19:43:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.440+0000 7efe23fff700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efe24099050 0x7efe2409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.440+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7efe300c31f0 con 0x7efe3c1008d0 2022-09-07T19:43:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.441+0000 7efe3ad9d700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efe24099050 0x7efe2409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.441+0000 7efe3ad9d700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efe24099050 0x7efe2409b500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe2c005fd0 tx=0x7efe2c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:25.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.442+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7efe3008f540 con 0x7efe3c1008d0 2022-09-07T19:43:25.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:25 smithi155 ceph-mon[97606]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:43:25.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:25 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/773418866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2022-09-07T19:43:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:25 smithi154 ceph-mon[96967]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:43:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:25 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/773418866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2022-09-07T19:43:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.673+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe3c114280 con 0x7efe3c1008d0 2022-09-07T19:43:25.673 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.673+0000 7efe23fff700 1 -- 172.21.15.80:0/2047108371 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe30026020 con 0x7efe3c1008d0 2022-09-07T19:43:25.673 INFO:teuthology.orchestra.run.smithi080.stdout:55834574929 2022-09-07T19:43:25.675 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efe24099050 msgr2=0x7efe2409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efe24099050 0x7efe2409b500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe2c005fd0 tx=0x7efe2c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 msgr2=0x7efe3c19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 0x7efe3c19a7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe300059c0 tx=0x7efe3000f690 comp rx=0 tx=0).stop 2022-09-07T19:43:25.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 shutdown_connections 2022-09-07T19:43:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c102d40 0x7efe3c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efe24099050 0x7efe2409b500 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe3c066c00 0x7efe3c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 --2- 172.21.15.80:0/2047108371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe3c1008d0 0x7efe3c19a7b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 >> 172.21.15.80:0/2047108371 conn(0x7efe3c073cf0 msgr2=0x7efe3c0ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 shutdown_connections 2022-09-07T19:43:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.676+0000 7efe4121a700 1 -- 172.21.15.80:0/2047108371 wait complete. 2022-09-07T19:43:25.934 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 -- 172.21.15.80:0/1583809642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fca20 msgr2=0x7f299c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1583809642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fca20 0x7f299c0fcdf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f298c009810 tx=0x7f298c009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 -- 172.21.15.80:0/1583809642 shutdown_connections 2022-09-07T19:43:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1583809642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fca20 0x7f299c0fcdf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1583809642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c10a5d0 0x7f299c10c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1583809642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f299c0fd330 0x7f299c10a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 -- 172.21.15.80:0/1583809642 >> 172.21.15.80:0/1583809642 conn(0x7f299c0f8710 msgr2=0x7f299c0fab20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 -- 172.21.15.80:0/1583809642 shutdown_connections 2022-09-07T19:43:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.935+0000 7f29a14b6700 1 -- 172.21.15.80:0/1583809642 wait complete. 2022-09-07T19:43:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.936+0000 7f29a14b6700 1 Processor -- start 2022-09-07T19:43:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.936+0000 7f29a14b6700 1 -- start start 2022-09-07T19:43:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a14b6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 0x7f299c195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a14b6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fd330 0x7f299c1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a14b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f299c10a5d0 0x7f299c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a14b6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c199c00 con 0x7f299c0fd330 2022-09-07T19:43:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a14b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c199d70 con 0x7f299c10a5d0 2022-09-07T19:43:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a14b6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c199f30 con 0x7f299c0fca20 2022-09-07T19:43:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fd330 0x7f299c1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f299bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 0x7f299c195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f299bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 0x7f299c195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51556/0 (socket says 172.21.15.80:51556) 2022-09-07T19:43:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fd330 0x7f299c1961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57182/0 (socket says 172.21.15.80:57182) 2022-09-07T19:43:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f299bfff700 1 -- 172.21.15.80:0/1132479135 learned_addr learned my addr 172.21.15.80:0/1132479135 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.937+0000 7f29a0cb5700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f299c10a5d0 0x7f299c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f299bfff700 1 -- 172.21.15.80:0/1132479135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f299c10a5d0 msgr2=0x7f299c1995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f299bfff700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f299c10a5d0 0x7f299c1995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f299bfff700 1 -- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fd330 msgr2=0x7f299c1961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f299bfff700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fd330 0x7f299c1961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f299bfff700 1 -- 172.21.15.80:0/1132479135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900093b0 con 0x7f299c0fca20 2022-09-07T19:43:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f299bfff700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 0x7f299c195cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f298c0059c0 tx=0x7f298c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c01d070 con 0x7f299c0fca20 2022-09-07T19:43:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c009470 con 0x7f299c0fca20 2022-09-07T19:43:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f298c00f800 con 0x7f299c0fca20 2022-09-07T19:43:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.938+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c004740 con 0x7f299c0fca20 2022-09-07T19:43:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.939+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1a2930 con 0x7f299c0fca20 2022-09-07T19:43:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.940+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c04d480 con 0x7f299c0fca20 2022-09-07T19:43:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.942+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f298c028030 con 0x7f299c0fca20 2022-09-07T19:43:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.943+0000 7f29997fa700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2984099050 0x7f298409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.944+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f298c0c3730 con 0x7f299c0fca20 2022-09-07T19:43:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.944+0000 7f299b7fe700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2984099050 0x7f298409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.944+0000 7f299b7fe700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2984099050 0x7f298409b500 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f299c197280 tx=0x7f2990005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:25.945+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f298c08fa80 con 0x7f299c0fca20 2022-09-07T19:43:26.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.166+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f299c1a2ee0 con 0x7f299c0fca20 2022-09-07T19:43:26.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.167+0000 7f29997fa700 1 -- 172.21.15.80:0/1132479135 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f298c026090 con 0x7f299c0fca20 2022-09-07T19:43:26.166 INFO:teuthology.orchestra.run.smithi080.stdout:197568495671 2022-09-07T19:43:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2984099050 msgr2=0x7f298409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2984099050 0x7f298409b500 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f299c197280 tx=0x7f2990005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 msgr2=0x7f299c195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 0x7f299c195cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f298c0059c0 tx=0x7f298c00f690 comp rx=0 tx=0).stop 2022-09-07T19:43:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 shutdown_connections 2022-09-07T19:43:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2984099050 0x7f298409b500 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f299c10a5d0 0x7f299c1995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f299c0fca20 0x7f299c195cb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 --2- 172.21.15.80:0/1132479135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c0fd330 0x7f299c1961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 >> 172.21.15.80:0/1132479135 conn(0x7f299c0f8710 msgr2=0x7f299c10c780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 shutdown_connections 2022-09-07T19:43:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:26.169+0000 7f29a14b6700 1 -- 172.21.15.80:0/1132479135 wait complete. 2022-09-07T19:43:26.279 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574929 for osd.1 2022-09-07T19:43:26.280 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:26.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:26 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2047108371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-09-07T19:43:26.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:26 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1132479135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2022-09-07T19:43:26.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:26 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2047108371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-09-07T19:43:26.605 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:26 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1132479135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2022-09-07T19:43:26.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:26 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2047108371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-09-07T19:43:26.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:26 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1132479135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2022-09-07T19:43:26.637 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495669 got 197568495671 for osd.6 2022-09-07T19:43:26.638 DEBUG:teuthology.parallel:result is None 2022-09-07T19:43:26.638 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2022-09-07T19:43:26.639 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph pg dump --format=json 2022-09-07T19:43:27.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:27 smithi155 ceph-mon[97606]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2022-09-07T19:43:27.517 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:27 smithi080 ceph-mon[90124]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2022-09-07T19:43:27.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:27 smithi154 ceph-mon[96967]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2022-09-07T19:43:29.072 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 -- 172.21.15.80:0/3409396452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9134102fa0 msgr2=0x7f913410ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:29.072 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 --2- 172.21.15.80:0/3409396452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9134102fa0 0x7f913410ab40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f912c009be0 tx=0x7f912c009ef0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.073 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 -- 172.21.15.80:0/3409396452 shutdown_connections 2022-09-07T19:43:29.073 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 --2- 172.21.15.80:0/3409396452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9134102fa0 0x7f913410ab40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 --2- 172.21.15.80:0/3409396452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f91340fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.074 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 --2- 172.21.15.80:0/3409396452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91340fe840 0x7f9134102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 -- 172.21.15.80:0/3409396452 >> 172.21.15.80:0/3409396452 conn(0x7f91340f9800 msgr2=0x7f91340fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:29.075 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 -- 172.21.15.80:0/3409396452 shutdown_connections 2022-09-07T19:43:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.072+0000 7f9133fff700 1 -- 172.21.15.80:0/3409396452 wait complete. 2022-09-07T19:43:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.073+0000 7f9133fff700 1 Processor -- start 2022-09-07T19:43:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 -- start start 2022-09-07T19:43:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f913419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91340fe840 0x7f913419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9134102fa0 0x7f9134195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91341962f0 con 0x7f91340fe840 2022-09-07T19:43:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9134196460 con 0x7f91340fdea0 2022-09-07T19:43:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9133fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9134196620 con 0x7f9134102fa0 2022-09-07T19:43:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9132ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f913419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9132ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f913419bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:40594/0 (socket says 172.21.15.80:40594) 2022-09-07T19:43:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.074+0000 7f9132ffd700 1 -- 172.21.15.80:0/2871716444 learned_addr learned my addr 172.21.15.80:0/2871716444 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f91337fe700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9134102fa0 0x7f9134195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f91327fc700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91340fe840 0x7f913419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:29.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f9132ffd700 1 -- 172.21.15.80:0/2871716444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9134102fa0 msgr2=0x7f9134195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:29.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f9132ffd700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9134102fa0 0x7f9134195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f9132ffd700 1 -- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91340fe840 msgr2=0x7f913419c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:29.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f9132ffd700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91340fe840 0x7f913419c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f9132ffd700 1 -- 172.21.15.80:0/2871716444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0097e0 con 0x7f91340fdea0 2022-09-07T19:43:29.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f91337fe700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9134102fa0 0x7f9134195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:29.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.075+0000 7f9132ffd700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f913419bae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f912400e740 tx=0x7f912400ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:29.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.076+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124005220 con 0x7f91340fdea0 2022-09-07T19:43:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.076+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f9124005380 con 0x7f91340fdea0 2022-09-07T19:43:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.076+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9134196900 con 0x7f91340fdea0 2022-09-07T19:43:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.076+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124004b70 con 0x7f91340fdea0 2022-09-07T19:43:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.076+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91341a2b20 con 0x7f91340fdea0 2022-09-07T19:43:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.077+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913404d480 con 0x7f91340fdea0 2022-09-07T19:43:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.079+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f912401e020 con 0x7f91340fdea0 2022-09-07T19:43:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.080+0000 7f911bfff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f911c099050 0x7f911c09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.080+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f9124014070 con 0x7f91340fdea0 2022-09-07T19:43:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.080+0000 7f91327fc700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f911c099050 0x7f911c09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.081+0000 7f91327fc700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f911c099050 0x7f911c09b500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f91340f9d40 tx=0x7f9128005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.082+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f912408ef90 con 0x7f91340fdea0 2022-09-07T19:43:29.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.290+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91340faa10 con 0x7f911c099050 2022-09-07T19:43:29.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.303+0000 7f911bfff700 1 -- 172.21.15.80:0/2871716444 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426780 (secure 0 0 0) 0x7f91340faa10 con 0x7f911c099050 2022-09-07T19:43:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f911c099050 msgr2=0x7f911c09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f911c099050 0x7f911c09b500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f91340f9d40 tx=0x7f9128005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 msgr2=0x7f913419bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f913419bae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f912400e740 tx=0x7f912400ea50 comp rx=0 tx=0).stop 2022-09-07T19:43:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 shutdown_connections 2022-09-07T19:43:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f911c099050 0x7f911c09b500 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9134102fa0 0x7f9134195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91340fdea0 0x7f913419bae0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 --2- 172.21.15.80:0/2871716444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91340fe840 0x7f913419c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:29.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 >> 172.21.15.80:0/2871716444 conn(0x7f91340f9800 msgr2=0x7f91340fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:29.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 shutdown_connections 2022-09-07T19:43:29.319 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:29.310+0000 7f9133fff700 1 -- 172.21.15.80:0/2871716444 wait complete. 2022-09-07T19:43:29.319 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2022-09-07T19:43:29.448 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:29 smithi155 ceph-mon[97606]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2022-09-07T19:43:29.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:29 smithi080 ceph-mon[90124]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2022-09-07T19:43:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:29 smithi154 ceph-mon[96967]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2022-09-07T19:43:29.996 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2022-09-07T19:43:27.952625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655731,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":444,"num_read_kb":343,"num_write":341,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80656,"kb_used_data":12144,"kb_used_omap":0,"kb_used_meta":68416,"kb_avail":1124861168,"statfs":{"total":1151940427776,"available":1151857836032,"internally_reserved":0,"allocated":12435456,"data_stored":7928713,"data_compressed":318348,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":0,"internal_metadata":70057984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003497"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529840+0000","last_change":"2022-09-07T19:42:06.951015+0000","last_active":"2022-09-07T19:42:42.529840+0000","last_peered":"2022-09-07T19:42:42.529840+0000","last_clean":"2022-09-07T19:42:42.529840+0000","last_became_active":"2022-09-07T19:42:06.950768+0000","last_became_peered":"2022-09-07T19:42:06.950768+0000","last_unstale":"2022-09-07T19:42:42.529840+0000","last_undegraded":"2022-09-07T19:42:42.529840+0000","last_fullsized":"2022-09-07T19:42:42.529840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:35:45.040811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534037+0000","last_change":"2022-09-07T19:42:06.956370+0000","last_active":"2022-09-07T19:42:42.534037+0000","last_peered":"2022-09-07T19:42:42.534037+0000","last_clean":"2022-09-07T19:42:42.534037+0000","last_became_active":"2022-09-07T19:42:06.955072+0000","last_became_peered":"2022-09-07T19:42:06.955072+0000","last_unstale":"2022-09-07T19:42:42.534037+0000","last_undegraded":"2022-09-07T19:42:42.534037+0000","last_fullsized":"2022-09-07T19:42:42.534037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:01:51.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533766+0000","last_change":"2022-09-07T19:42:06.957647+0000","last_active":"2022-09-07T19:42:42.533766+0000","last_peered":"2022-09-07T19:42:42.533766+0000","last_clean":"2022-09-07T19:42:42.533766+0000","last_became_active":"2022-09-07T19:42:06.956731+0000","last_became_peered":"2022-09-07T19:42:06.956731+0000","last_unstale":"2022-09-07T19:42:42.533766+0000","last_undegraded":"2022-09-07T19:42:42.533766+0000","last_fullsized":"2022-09-07T19:42:42.533766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:13.700278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.534489+0000","last_change":"2022-09-07T19:42:43.533520+0000","last_active":"2022-09-07T19:42:43.534489+0000","last_peered":"2022-09-07T19:42:43.534489+0000","last_clean":"2022-09-07T19:42:43.534489+0000","last_became_active":"2022-09-07T19:42:43.533161+0000","last_became_peered":"2022-09-07T19:42:43.533161+0000","last_unstale":"2022-09-07T19:42:43.534489+0000","last_undegraded":"2022-09-07T19:42:43.534489+0000","last_fullsized":"2022-09-07T19:42:43.534489+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:57:49.408631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527481+0000","last_change":"2022-09-07T19:42:06.938599+0000","last_active":"2022-09-07T19:42:42.527481+0000","last_peered":"2022-09-07T19:42:42.527481+0000","last_clean":"2022-09-07T19:42:42.527481+0000","last_became_active":"2022-09-07T19:42:06.938280+0000","last_became_peered":"2022-09-07T19:42:06.938280+0000","last_unstale":"2022-09-07T19:42:42.527481+0000","last_undegraded":"2022-09-07T19:42:42.527481+0000","last_fullsized":"2022-09-07T19:42:42.527481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:41:40.529183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533693+0000","last_change":"2022-09-07T19:42:06.939120+0000","last_active":"2022-09-07T19:42:42.533693+0000","last_peered":"2022-09-07T19:42:42.533693+0000","last_clean":"2022-09-07T19:42:42.533693+0000","last_became_active":"2022-09-07T19:42:06.938805+0000","last_became_peered":"2022-09-07T19:42:06.938805+0000","last_unstale":"2022-09-07T19:42:42.533693+0000","last_undegraded":"2022-09-07T19:42:42.533693+0000","last_fullsized":"2022-09-07T19:42:42.533693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:26:17.772579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532747+0000","last_change":"2022-09-07T19:42:06.935222+0000","last_active":"2022-09-07T19:42:42.532747+0000","last_peered":"2022-09-07T19:42:42.532747+0000","last_clean":"2022-09-07T19:42:42.532747+0000","last_became_active":"2022-09-07T19:42:06.934863+0000","last_became_peered":"2022-09-07T19:42:06.934863+0000","last_unstale":"2022-09-07T19:42:42.532747+0000","last_undegraded":"2022-09-07T19:42:42.532747+0000","last_fullsized":"2022-09-07T19:42:42.532747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:10:12.989147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529690+0000","last_change":"2022-09-07T19:42:06.940593+0000","last_active":"2022-09-07T19:42:42.529690+0000","last_peered":"2022-09-07T19:42:42.529690+0000","last_clean":"2022-09-07T19:42:42.529690+0000","last_became_active":"2022-09-07T19:42:06.940209+0000","last_became_peered":"2022-09-07T19:42:06.940209+0000","last_unstale":"2022-09-07T19:42:42.529690+0000","last_undegraded":"2022-09-07T19:42:42.529690+0000","last_fullsized":"2022-09-07T19:42:42.529690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:45:25.341085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528135+0000","last_change":"2022-09-07T19:42:06.935215+0000","last_active":"2022-09-07T19:42:42.528135+0000","last_peered":"2022-09-07T19:42:42.528135+0000","last_clean":"2022-09-07T19:42:42.528135+0000","last_became_active":"2022-09-07T19:42:06.934974+0000","last_became_peered":"2022-09-07T19:42:06.934974+0000","last_unstale":"2022-09-07T19:42:42.528135+0000","last_undegraded":"2022-09-07T19:42:42.528135+0000","last_fullsized":"2022-09-07T19:42:42.528135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:01.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534249+0000","last_change":"2022-09-07T19:42:06.939935+0000","last_active":"2022-09-07T19:42:42.534249+0000","last_peered":"2022-09-07T19:42:42.534249+0000","last_clean":"2022-09-07T19:42:42.534249+0000","last_became_active":"2022-09-07T19:42:06.939160+0000","last_became_peered":"2022-09-07T19:42:06.939160+0000","last_unstale":"2022-09-07T19:42:42.534249+0000","last_undegraded":"2022-09-07T19:42:42.534249+0000","last_fullsized":"2022-09-07T19:42:42.534249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:32.324752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532718+0000","last_change":"2022-09-07T19:42:06.948084+0000","last_active":"2022-09-07T19:42:42.532718+0000","last_peered":"2022-09-07T19:42:42.532718+0000","last_clean":"2022-09-07T19:42:42.532718+0000","last_became_active":"2022-09-07T19:42:06.947552+0000","last_became_peered":"2022-09-07T19:42:06.947552+0000","last_unstale":"2022-09-07T19:42:42.532718+0000","last_undegraded":"2022-09-07T19:42:42.532718+0000","last_fullsized":"2022-09-07T19:42:42.532718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:51:20.247983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530144+0000","last_change":"2022-09-07T19:42:06.947021+0000","last_active":"2022-09-07T19:42:42.530144+0000","last_peered":"2022-09-07T19:42:42.530144+0000","last_clean":"2022-09-07T19:42:42.530144+0000","last_became_active":"2022-09-07T19:42:06.946507+0000","last_became_peered":"2022-09-07T19:42:06.946507+0000","last_unstale":"2022-09-07T19:42:42.530144+0000","last_undegraded":"2022-09-07T19:42:42.530144+0000","last_fullsized":"2022-09-07T19:42:42.530144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:25:15.358991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529898+0000","last_change":"2022-09-07T19:42:06.940573+0000","last_active":"2022-09-07T19:42:42.529898+0000","last_peered":"2022-09-07T19:42:42.529898+0000","last_clean":"2022-09-07T19:42:42.529898+0000","last_became_active":"2022-09-07T19:42:06.940298+0000","last_became_peered":"2022-09-07T19:42:06.940298+0000","last_unstale":"2022-09-07T19:42:42.529898+0000","last_undegraded":"2022-09-07T19:42:42.529898+0000","last_fullsized":"2022-09-07T19:42:42.529898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:41.459964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533110+0000","last_change":"2022-09-07T19:42:06.953348+0000","last_active":"2022-09-07T19:42:42.533110+0000","last_peered":"2022-09-07T19:42:42.533110+0000","last_clean":"2022-09-07T19:42:42.533110+0000","last_became_active":"2022-09-07T19:42:06.952776+0000","last_became_peered":"2022-09-07T19:42:06.952776+0000","last_unstale":"2022-09-07T19:42:42.533110+0000","last_undegraded":"2022-09-07T19:42:42.533110+0000","last_fullsized":"2022-09-07T19:42:42.533110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:58:29.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.531647+0000","last_change":"2022-09-07T19:42:43.531647+0000","last_active":"2022-09-07T19:42:43.531647+0000","last_peered":"2022-09-07T19:42:43.531647+0000","last_clean":"2022-09-07T19:42:43.531647+0000","last_became_active":"2022-09-07T19:42:43.531231+0000","last_became_peered":"2022-09-07T19:42:43.531231+0000","last_unstale":"2022-09-07T19:42:43.531647+0000","last_undegraded":"2022-09-07T19:42:43.531647+0000","last_fullsized":"2022-09-07T19:42:43.531647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:22:09.221685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.526912+0000","last_change":"2022-09-07T19:42:06.954614+0000","last_active":"2022-09-07T19:42:42.526912+0000","last_peered":"2022-09-07T19:42:42.526912+0000","last_clean":"2022-09-07T19:42:42.526912+0000","last_became_active":"2022-09-07T19:42:06.954312+0000","last_became_peered":"2022-09-07T19:42:06.954312+0000","last_unstale":"2022-09-07T19:42:42.526912+0000","last_undegraded":"2022-09-07T19:42:42.526912+0000","last_fullsized":"2022-09-07T19:42:42.526912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:39:14.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529750+0000","last_change":"2022-09-07T19:42:06.950491+0000","last_active":"2022-09-07T19:42:42.529750+0000","last_peered":"2022-09-07T19:42:42.529750+0000","last_clean":"2022-09-07T19:42:42.529750+0000","last_became_active":"2022-09-07T19:42:06.950164+0000","last_became_peered":"2022-09-07T19:42:06.950164+0000","last_unstale":"2022-09-07T19:42:42.529750+0000","last_undegraded":"2022-09-07T19:42:42.529750+0000","last_fullsized":"2022-09-07T19:42:42.529750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:25.631788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525241+0000","last_change":"2022-09-07T19:42:06.933766+0000","last_active":"2022-09-07T19:42:42.525241+0000","last_peered":"2022-09-07T19:42:42.525241+0000","last_clean":"2022-09-07T19:42:42.525241+0000","last_became_active":"2022-09-07T19:42:06.933448+0000","last_became_peered":"2022-09-07T19:42:06.933448+0000","last_unstale":"2022-09-07T19:42:42.525241+0000","last_undegraded":"2022-09-07T19:42:42.525241+0000","last_fullsized":"2022-09-07T19:42:42.525241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:10.478403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533372+0000","last_change":"2022-09-07T19:42:06.937141+0000","last_active":"2022-09-07T19:42:42.533372+0000","last_peered":"2022-09-07T19:42:42.533372+0000","last_clean":"2022-09-07T19:42:42.533372+0000","last_became_active":"2022-09-07T19:42:06.936841+0000","last_became_peered":"2022-09-07T19:42:06.936841+0000","last_unstale":"2022-09-07T19:42:42.533372+0000","last_undegraded":"2022-09-07T19:42:42.533372+0000","last_fullsized":"2022-09-07T19:42:42.533372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:57:43.397083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531983+0000","last_change":"2022-09-07T19:42:11.413877+0000","last_active":"2022-09-07T19:42:42.531983+0000","last_peered":"2022-09-07T19:42:42.531983+0000","last_clean":"2022-09-07T19:42:42.531983+0000","last_became_active":"2022-09-07T19:42:11.413419+0000","last_became_peered":"2022-09-07T19:42:11.413419+0000","last_unstale":"2022-09-07T19:42:42.531983+0000","last_undegraded":"2022-09-07T19:42:42.531983+0000","last_fullsized":"2022-09-07T19:42:42.531983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:40:06.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525488+0000","last_change":"2022-09-07T19:42:06.360233+0000","last_active":"2022-09-07T19:42:42.525488+0000","last_peered":"2022-09-07T19:42:42.525488+0000","last_clean":"2022-09-07T19:42:42.525488+0000","last_became_active":"2022-09-07T19:42:06.359937+0000","last_became_peered":"2022-09-07T19:42:06.359937+0000","last_unstale":"2022-09-07T19:42:42.525488+0000","last_undegraded":"2022-09-07T19:42:42.525488+0000","last_fullsized":"2022-09-07T19:42:42.525488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:02.665896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.534897+0000","last_change":"2022-09-07T19:42:43.534412+0000","last_active":"2022-09-07T19:42:43.534897+0000","last_peered":"2022-09-07T19:42:43.534897+0000","last_clean":"2022-09-07T19:42:43.534897+0000","last_became_active":"2022-09-07T19:42:43.534013+0000","last_became_peered":"2022-09-07T19:42:43.534013+0000","last_unstale":"2022-09-07T19:42:43.534897+0000","last_undegraded":"2022-09-07T19:42:43.534897+0000","last_fullsized":"2022-09-07T19:42:43.534897+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:42:27.917594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528717+0000","last_change":"2022-09-07T19:42:11.412836+0000","last_active":"2022-09-07T19:42:42.528717+0000","last_peered":"2022-09-07T19:42:42.528717+0000","last_clean":"2022-09-07T19:42:42.528717+0000","last_became_active":"2022-09-07T19:42:11.412407+0000","last_became_peered":"2022-09-07T19:42:11.412407+0000","last_unstale":"2022-09-07T19:42:42.528717+0000","last_undegraded":"2022-09-07T19:42:42.528717+0000","last_fullsized":"2022-09-07T19:42:42.528717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:40:35.056313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531286+0000","last_change":"2022-09-07T19:42:06.372498+0000","last_active":"2022-09-07T19:42:42.531286+0000","last_peered":"2022-09-07T19:42:42.531286+0000","last_clean":"2022-09-07T19:42:42.531286+0000","last_became_active":"2022-09-07T19:42:06.372183+0000","last_became_peered":"2022-09-07T19:42:06.372183+0000","last_unstale":"2022-09-07T19:42:42.531286+0000","last_undegraded":"2022-09-07T19:42:42.531286+0000","last_fullsized":"2022-09-07T19:42:42.531286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:00:56.451463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533681+0000","last_change":"2022-09-07T19:42:06.953146+0000","last_active":"2022-09-07T19:42:42.533681+0000","last_peered":"2022-09-07T19:42:42.533681+0000","last_clean":"2022-09-07T19:42:42.533681+0000","last_became_active":"2022-09-07T19:42:06.952824+0000","last_became_peered":"2022-09-07T19:42:06.952824+0000","last_unstale":"2022-09-07T19:42:42.533681+0000","last_undegraded":"2022-09-07T19:42:42.533681+0000","last_fullsized":"2022-09-07T19:42:42.533681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:59:59.989327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529215+0000","last_change":"2022-09-07T19:42:11.411807+0000","last_active":"2022-09-07T19:42:42.529215+0000","last_peered":"2022-09-07T19:42:42.529215+0000","last_clean":"2022-09-07T19:42:42.529215+0000","last_became_active":"2022-09-07T19:42:11.411392+0000","last_became_peered":"2022-09-07T19:42:11.411392+0000","last_unstale":"2022-09-07T19:42:42.529215+0000","last_undegraded":"2022-09-07T19:42:42.529215+0000","last_fullsized":"2022-09-07T19:42:42.529215+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:37:00.477243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530296+0000","last_change":"2022-09-07T19:42:06.359561+0000","last_active":"2022-09-07T19:42:42.530296+0000","last_peered":"2022-09-07T19:42:42.530296+0000","last_clean":"2022-09-07T19:42:42.530296+0000","last_became_active":"2022-09-07T19:42:06.359200+0000","last_became_peered":"2022-09-07T19:42:06.359200+0000","last_unstale":"2022-09-07T19:42:42.530296+0000","last_undegraded":"2022-09-07T19:42:42.530296+0000","last_fullsized":"2022-09-07T19:42:42.530296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:16:13.894233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527508+0000","last_change":"2022-09-07T19:42:06.943682+0000","last_active":"2022-09-07T19:42:42.527508+0000","last_peered":"2022-09-07T19:42:42.527508+0000","last_clean":"2022-09-07T19:42:42.527508+0000","last_became_active":"2022-09-07T19:42:06.943323+0000","last_became_peered":"2022-09-07T19:42:06.943323+0000","last_unstale":"2022-09-07T19:42:42.527508+0000","last_undegraded":"2022-09-07T19:42:42.527508+0000","last_fullsized":"2022-09-07T19:42:42.527508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:00:26.030438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528873+0000","last_change":"2022-09-07T19:42:11.403222+0000","last_active":"2022-09-07T19:42:42.528873+0000","last_peered":"2022-09-07T19:42:42.528873+0000","last_clean":"2022-09-07T19:42:42.528873+0000","last_became_active":"2022-09-07T19:42:11.402740+0000","last_became_peered":"2022-09-07T19:42:11.402740+0000","last_unstale":"2022-09-07T19:42:42.528873+0000","last_undegraded":"2022-09-07T19:42:42.528873+0000","last_fullsized":"2022-09-07T19:42:42.528873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:55:07.470945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529918+0000","last_change":"2022-09-07T19:42:06.353930+0000","last_active":"2022-09-07T19:42:42.529918+0000","last_peered":"2022-09-07T19:42:42.529918+0000","last_clean":"2022-09-07T19:42:42.529918+0000","last_became_active":"2022-09-07T19:42:06.353603+0000","last_became_peered":"2022-09-07T19:42:06.353603+0000","last_unstale":"2022-09-07T19:42:42.529918+0000","last_undegraded":"2022-09-07T19:42:42.529918+0000","last_fullsized":"2022-09-07T19:42:42.529918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:50.562667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525802+0000","last_change":"2022-09-07T19:42:06.948086+0000","last_active":"2022-09-07T19:42:42.525802+0000","last_peered":"2022-09-07T19:42:42.525802+0000","last_clean":"2022-09-07T19:42:42.525802+0000","last_became_active":"2022-09-07T19:42:06.947805+0000","last_became_peered":"2022-09-07T19:42:06.947805+0000","last_unstale":"2022-09-07T19:42:42.525802+0000","last_undegraded":"2022-09-07T19:42:42.525802+0000","last_fullsized":"2022-09-07T19:42:42.525802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:36:53.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533230+0000","last_change":"2022-09-07T19:42:11.401915+0000","last_active":"2022-09-07T19:42:42.533230+0000","last_peered":"2022-09-07T19:42:42.533230+0000","last_clean":"2022-09-07T19:42:42.533230+0000","last_became_active":"2022-09-07T19:42:11.401513+0000","last_became_peered":"2022-09-07T19:42:11.401513+0000","last_unstale":"2022-09-07T19:42:42.533230+0000","last_undegraded":"2022-09-07T19:42:42.533230+0000","last_fullsized":"2022-09-07T19:42:42.533230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:42:34.774516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:22.596978+0000","last_change":"2022-09-07T19:42:06.361590+0000","last_active":"2022-09-07T19:43:22.596978+0000","last_peered":"2022-09-07T19:43:22.596978+0000","last_clean":"2022-09-07T19:43:22.596978+0000","last_became_active":"2022-09-07T19:42:06.361278+0000","last_became_peered":"2022-09-07T19:42:06.361278+0000","last_unstale":"2022-09-07T19:43:22.596978+0000","last_undegraded":"2022-09-07T19:43:22.596978+0000","last_fullsized":"2022-09-07T19:43:22.596978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:30.487710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.544375+0000","last_change":"2022-09-07T19:42:43.544375+0000","last_active":"2022-09-07T19:42:43.544375+0000","last_peered":"2022-09-07T19:42:43.544375+0000","last_clean":"2022-09-07T19:42:43.544375+0000","last_became_active":"2022-09-07T19:42:43.543938+0000","last_became_peered":"2022-09-07T19:42:43.543938+0000","last_unstale":"2022-09-07T19:42:43.544375+0000","last_undegraded":"2022-09-07T19:42:43.544375+0000","last_fullsized":"2022-09-07T19:42:43.544375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:02:40.961308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533518+0000","last_change":"2022-09-07T19:42:11.414174+0000","last_active":"2022-09-07T19:42:42.533518+0000","last_peered":"2022-09-07T19:42:42.533518+0000","last_clean":"2022-09-07T19:42:42.533518+0000","last_became_active":"2022-09-07T19:42:11.413798+0000","last_became_peered":"2022-09-07T19:42:11.413798+0000","last_unstale":"2022-09-07T19:42:42.533518+0000","last_undegraded":"2022-09-07T19:42:42.533518+0000","last_fullsized":"2022-09-07T19:42:42.533518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:17.386698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533584+0000","last_change":"2022-09-07T19:42:06.375593+0000","last_active":"2022-09-07T19:42:42.533584+0000","last_peered":"2022-09-07T19:42:42.533584+0000","last_clean":"2022-09-07T19:42:42.533584+0000","last_became_active":"2022-09-07T19:42:06.375396+0000","last_became_peered":"2022-09-07T19:42:06.375396+0000","last_unstale":"2022-09-07T19:42:42.533584+0000","last_undegraded":"2022-09-07T19:42:42.533584+0000","last_fullsized":"2022-09-07T19:42:42.533584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:00:10.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524797+0000","last_change":"2022-09-07T19:42:06.936369+0000","last_active":"2022-09-07T19:42:42.524797+0000","last_peered":"2022-09-07T19:42:42.524797+0000","last_clean":"2022-09-07T19:42:42.524797+0000","last_became_active":"2022-09-07T19:42:06.936083+0000","last_became_peered":"2022-09-07T19:42:06.936083+0000","last_unstale":"2022-09-07T19:42:42.524797+0000","last_undegraded":"2022-09-07T19:42:42.524797+0000","last_fullsized":"2022-09-07T19:42:42.524797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:50:17.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529658+0000","last_change":"2022-09-07T19:42:11.399043+0000","last_active":"2022-09-07T19:42:42.529658+0000","last_peered":"2022-09-07T19:42:42.529658+0000","last_clean":"2022-09-07T19:42:42.529658+0000","last_became_active":"2022-09-07T19:42:11.398634+0000","last_became_peered":"2022-09-07T19:42:11.398634+0000","last_unstale":"2022-09-07T19:42:42.529658+0000","last_undegraded":"2022-09-07T19:42:42.529658+0000","last_fullsized":"2022-09-07T19:42:42.529658+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:30:06.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529157+0000","last_change":"2022-09-07T19:42:06.365700+0000","last_active":"2022-09-07T19:42:42.529157+0000","last_peered":"2022-09-07T19:42:42.529157+0000","last_clean":"2022-09-07T19:42:42.529157+0000","last_became_active":"2022-09-07T19:42:06.365338+0000","last_became_peered":"2022-09-07T19:42:06.365338+0000","last_unstale":"2022-09-07T19:42:42.529157+0000","last_undegraded":"2022-09-07T19:42:42.529157+0000","last_fullsized":"2022-09-07T19:42:42.529157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:18.825477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529614+0000","last_change":"2022-09-07T19:42:06.938275+0000","last_active":"2022-09-07T19:42:42.529614+0000","last_peered":"2022-09-07T19:42:42.529614+0000","last_clean":"2022-09-07T19:42:42.529614+0000","last_became_active":"2022-09-07T19:42:06.937893+0000","last_became_peered":"2022-09-07T19:42:06.937893+0000","last_unstale":"2022-09-07T19:42:42.529614+0000","last_undegraded":"2022-09-07T19:42:42.529614+0000","last_fullsized":"2022-09-07T19:42:42.529614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:42:22.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533918+0000","last_change":"2022-09-07T19:42:11.406329+0000","last_active":"2022-09-07T19:42:42.533918+0000","last_peered":"2022-09-07T19:42:42.533918+0000","last_clean":"2022-09-07T19:42:42.533918+0000","last_became_active":"2022-09-07T19:42:11.405954+0000","last_became_peered":"2022-09-07T19:42:11.405954+0000","last_unstale":"2022-09-07T19:42:42.533918+0000","last_undegraded":"2022-09-07T19:42:42.533918+0000","last_fullsized":"2022-09-07T19:42:42.533918+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:15.735179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524271+0000","last_change":"2022-09-07T19:42:06.360190+0000","last_active":"2022-09-07T19:42:42.524271+0000","last_peered":"2022-09-07T19:42:42.524271+0000","last_clean":"2022-09-07T19:42:42.524271+0000","last_became_active":"2022-09-07T19:42:06.359893+0000","last_became_peered":"2022-09-07T19:42:06.359893+0000","last_unstale":"2022-09-07T19:42:42.524271+0000","last_undegraded":"2022-09-07T19:42:42.524271+0000","last_fullsized":"2022-09-07T19:42:42.524271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:09:54.310816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524779+0000","last_change":"2022-09-07T19:42:06.931094+0000","last_active":"2022-09-07T19:42:42.524779+0000","last_peered":"2022-09-07T19:42:42.524779+0000","last_clean":"2022-09-07T19:42:42.524779+0000","last_became_active":"2022-09-07T19:42:06.930781+0000","last_became_peered":"2022-09-07T19:42:06.930781+0000","last_unstale":"2022-09-07T19:42:42.524779+0000","last_undegraded":"2022-09-07T19:42:42.524779+0000","last_fullsized":"2022-09-07T19:42:42.524779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:31:17.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529916+0000","last_change":"2022-09-07T19:42:11.402900+0000","last_active":"2022-09-07T19:42:42.529916+0000","last_peered":"2022-09-07T19:42:42.529916+0000","last_clean":"2022-09-07T19:42:42.529916+0000","last_became_active":"2022-09-07T19:42:11.402553+0000","last_became_peered":"2022-09-07T19:42:11.402553+0000","last_unstale":"2022-09-07T19:42:42.529916+0000","last_undegraded":"2022-09-07T19:42:42.529916+0000","last_fullsized":"2022-09-07T19:42:42.529916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:19:01.667064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:22.596425+0000","last_change":"2022-09-07T19:42:06.363330+0000","last_active":"2022-09-07T19:43:22.596425+0000","last_peered":"2022-09-07T19:43:22.596425+0000","last_clean":"2022-09-07T19:43:22.596425+0000","last_became_active":"2022-09-07T19:42:06.363057+0000","last_became_peered":"2022-09-07T19:42:06.363057+0000","last_unstale":"2022-09-07T19:43:22.596425+0000","last_undegraded":"2022-09-07T19:43:22.596425+0000","last_fullsized":"2022-09-07T19:43:22.596425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:36.386640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528046+0000","last_change":"2022-09-07T19:42:06.943678+0000","last_active":"2022-09-07T19:42:42.528046+0000","last_peered":"2022-09-07T19:42:42.528046+0000","last_clean":"2022-09-07T19:42:42.528046+0000","last_became_active":"2022-09-07T19:42:06.942341+0000","last_became_peered":"2022-09-07T19:42:06.942341+0000","last_unstale":"2022-09-07T19:42:42.528046+0000","last_undegraded":"2022-09-07T19:42:42.528046+0000","last_fullsized":"2022-09-07T19:42:42.528046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:30:24.776240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524713+0000","last_change":"2022-09-07T19:42:11.410225+0000","last_active":"2022-09-07T19:42:42.524713+0000","last_peered":"2022-09-07T19:42:42.524713+0000","last_clean":"2022-09-07T19:42:42.524713+0000","last_became_active":"2022-09-07T19:42:11.409826+0000","last_became_peered":"2022-09-07T19:42:11.409826+0000","last_unstale":"2022-09-07T19:42:42.524713+0000","last_undegraded":"2022-09-07T19:42:42.524713+0000","last_fullsized":"2022-09-07T19:42:42.524713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:01.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533027+0000","last_change":"2022-09-07T19:42:06.357384+0000","last_active":"2022-09-07T19:42:42.533027+0000","last_peered":"2022-09-07T19:42:42.533027+0000","last_clean":"2022-09-07T19:42:42.533027+0000","last_became_active":"2022-09-07T19:42:06.357042+0000","last_became_peered":"2022-09-07T19:42:06.357042+0000","last_unstale":"2022-09-07T19:42:42.533027+0000","last_undegraded":"2022-09-07T19:42:42.533027+0000","last_fullsized":"2022-09-07T19:42:42.533027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:36:30.278258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533786+0000","last_change":"2022-09-07T19:42:06.952991+0000","last_active":"2022-09-07T19:42:42.533786+0000","last_peered":"2022-09-07T19:42:42.533786+0000","last_clean":"2022-09-07T19:42:42.533786+0000","last_became_active":"2022-09-07T19:42:06.952650+0000","last_became_peered":"2022-09-07T19:42:06.952650+0000","last_unstale":"2022-09-07T19:42:42.533786+0000","last_undegraded":"2022-09-07T19:42:42.533786+0000","last_fullsized":"2022-09-07T19:42:42.533786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:15:44.166803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529493+0000","last_change":"2022-09-07T19:42:11.412153+0000","last_active":"2022-09-07T19:42:42.529493+0000","last_peered":"2022-09-07T19:42:42.529493+0000","last_clean":"2022-09-07T19:42:42.529493+0000","last_became_active":"2022-09-07T19:42:11.411371+0000","last_became_peered":"2022-09-07T19:42:11.411371+0000","last_unstale":"2022-09-07T19:42:42.529493+0000","last_undegraded":"2022-09-07T19:42:42.529493+0000","last_fullsized":"2022-09-07T19:42:42.529493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:34:31.765609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525031+0000","last_change":"2022-09-07T19:42:06.356763+0000","last_active":"2022-09-07T19:42:42.525031+0000","last_peered":"2022-09-07T19:42:42.525031+0000","last_clean":"2022-09-07T19:42:42.525031+0000","last_became_active":"2022-09-07T19:42:06.356155+0000","last_became_peered":"2022-09-07T19:42:06.356155+0000","last_unstale":"2022-09-07T19:42:42.525031+0000","last_undegraded":"2022-09-07T19:42:42.525031+0000","last_fullsized":"2022-09-07T19:42:42.525031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:06:07.941810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527544+0000","last_change":"2022-09-07T19:42:06.940746+0000","last_active":"2022-09-07T19:42:42.527544+0000","last_peered":"2022-09-07T19:42:42.527544+0000","last_clean":"2022-09-07T19:42:42.527544+0000","last_became_active":"2022-09-07T19:42:06.939798+0000","last_became_peered":"2022-09-07T19:42:06.939798+0000","last_unstale":"2022-09-07T19:42:42.527544+0000","last_undegraded":"2022-09-07T19:42:42.527544+0000","last_fullsized":"2022-09-07T19:42:42.527544+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:02:25.348841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524882+0000","last_change":"2022-09-07T19:42:11.393014+0000","last_active":"2022-09-07T19:42:42.524882+0000","last_peered":"2022-09-07T19:42:42.524882+0000","last_clean":"2022-09-07T19:42:42.524882+0000","last_became_active":"2022-09-07T19:42:11.392465+0000","last_became_peered":"2022-09-07T19:42:11.392465+0000","last_unstale":"2022-09-07T19:42:42.524882+0000","last_undegraded":"2022-09-07T19:42:42.524882+0000","last_fullsized":"2022-09-07T19:42:42.524882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:52:11.553583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:23.597934+0000","last_change":"2022-09-07T19:42:06.364454+0000","last_active":"2022-09-07T19:43:23.597934+0000","last_peered":"2022-09-07T19:43:23.597934+0000","last_clean":"2022-09-07T19:43:23.597934+0000","last_became_active":"2022-09-07T19:42:06.364112+0000","last_became_peered":"2022-09-07T19:42:06.364112+0000","last_unstale":"2022-09-07T19:43:23.597934+0000","last_undegraded":"2022-09-07T19:43:23.597934+0000","last_fullsized":"2022-09-07T19:43:23.597934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:04:50.190357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60865,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":110,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530044+0000","last_change":"2022-09-07T19:42:06.942860+0000","last_active":"2022-09-07T19:42:42.530044+0000","last_peered":"2022-09-07T19:42:42.530044+0000","last_clean":"2022-09-07T19:42:42.530044+0000","last_became_active":"2022-09-07T19:42:06.941587+0000","last_became_peered":"2022-09-07T19:42:06.941587+0000","last_unstale":"2022-09-07T19:42:42.530044+0000","last_undegraded":"2022-09-07T19:42:42.530044+0000","last_fullsized":"2022-09-07T19:42:42.530044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:41:45.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525662+0000","last_change":"2022-09-07T19:42:11.403579+0000","last_active":"2022-09-07T19:42:42.525662+0000","last_peered":"2022-09-07T19:42:42.525662+0000","last_clean":"2022-09-07T19:42:42.525662+0000","last_became_active":"2022-09-07T19:42:11.402923+0000","last_became_peered":"2022-09-07T19:42:11.402923+0000","last_unstale":"2022-09-07T19:42:42.525662+0000","last_undegraded":"2022-09-07T19:42:42.525662+0000","last_fullsized":"2022-09-07T19:42:42.525662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:39:47.178557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532972+0000","last_change":"2022-09-07T19:42:06.369220+0000","last_active":"2022-09-07T19:42:42.532972+0000","last_peered":"2022-09-07T19:42:42.532972+0000","last_clean":"2022-09-07T19:42:42.532972+0000","last_became_active":"2022-09-07T19:42:06.368957+0000","last_became_peered":"2022-09-07T19:42:06.368957+0000","last_unstale":"2022-09-07T19:42:42.532972+0000","last_undegraded":"2022-09-07T19:42:42.532972+0000","last_fullsized":"2022-09-07T19:42:42.532972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:13:27.882414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530386+0000","last_change":"2022-09-07T19:42:06.942818+0000","last_active":"2022-09-07T19:42:42.530386+0000","last_peered":"2022-09-07T19:42:42.530386+0000","last_clean":"2022-09-07T19:42:42.530386+0000","last_became_active":"2022-09-07T19:42:06.942536+0000","last_became_peered":"2022-09-07T19:42:06.942536+0000","last_unstale":"2022-09-07T19:42:42.530386+0000","last_undegraded":"2022-09-07T19:42:42.530386+0000","last_fullsized":"2022-09-07T19:42:42.530386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:41:05.892343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.543928+0000","last_change":"2022-09-07T19:42:43.543928+0000","last_active":"2022-09-07T19:42:43.543928+0000","last_peered":"2022-09-07T19:42:43.543928+0000","last_clean":"2022-09-07T19:42:43.543928+0000","last_became_active":"2022-09-07T19:42:43.543287+0000","last_became_peered":"2022-09-07T19:42:43.543287+0000","last_unstale":"2022-09-07T19:42:43.543928+0000","last_undegraded":"2022-09-07T19:42:43.543928+0000","last_fullsized":"2022-09-07T19:42:43.543928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:40:41.522472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524595+0000","last_change":"2022-09-07T19:42:06.372606+0000","last_active":"2022-09-07T19:42:42.524595+0000","last_peered":"2022-09-07T19:42:42.524595+0000","last_clean":"2022-09-07T19:42:42.524595+0000","last_became_active":"2022-09-07T19:42:06.372314+0000","last_became_peered":"2022-09-07T19:42:06.372314+0000","last_unstale":"2022-09-07T19:42:42.524595+0000","last_undegraded":"2022-09-07T19:42:42.524595+0000","last_fullsized":"2022-09-07T19:42:42.524595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:57:29.102343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532545+0000","last_change":"2022-09-07T19:42:06.945336+0000","last_active":"2022-09-07T19:42:42.532545+0000","last_peered":"2022-09-07T19:42:42.532545+0000","last_clean":"2022-09-07T19:42:42.532545+0000","last_became_active":"2022-09-07T19:42:06.945056+0000","last_became_peered":"2022-09-07T19:42:06.945056+0000","last_unstale":"2022-09-07T19:42:42.532545+0000","last_undegraded":"2022-09-07T19:42:42.532545+0000","last_fullsized":"2022-09-07T19:42:42.532545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:24.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525305+0000","last_change":"2022-09-07T19:42:11.404998+0000","last_active":"2022-09-07T19:42:42.525305+0000","last_peered":"2022-09-07T19:42:42.525305+0000","last_clean":"2022-09-07T19:42:42.525305+0000","last_became_active":"2022-09-07T19:42:11.404553+0000","last_became_peered":"2022-09-07T19:42:11.404553+0000","last_unstale":"2022-09-07T19:42:42.525305+0000","last_undegraded":"2022-09-07T19:42:42.525305+0000","last_fullsized":"2022-09-07T19:42:42.525305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:36:55.188346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:24.599618+0000","last_change":"2022-09-07T19:42:06.356368+0000","last_active":"2022-09-07T19:43:24.599618+0000","last_peered":"2022-09-07T19:43:24.599618+0000","last_clean":"2022-09-07T19:43:24.599618+0000","last_became_active":"2022-09-07T19:42:06.356036+0000","last_became_peered":"2022-09-07T19:42:06.356036+0000","last_unstale":"2022-09-07T19:43:24.599618+0000","last_undegraded":"2022-09-07T19:43:24.599618+0000","last_fullsized":"2022-09-07T19:43:24.599618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:37.882450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533293+0000","last_change":"2022-09-07T19:42:06.936825+0000","last_active":"2022-09-07T19:42:42.533293+0000","last_peered":"2022-09-07T19:42:42.533293+0000","last_clean":"2022-09-07T19:42:42.533293+0000","last_became_active":"2022-09-07T19:42:06.936512+0000","last_became_peered":"2022-09-07T19:42:06.936512+0000","last_unstale":"2022-09-07T19:42:42.533293+0000","last_undegraded":"2022-09-07T19:42:42.533293+0000","last_fullsized":"2022-09-07T19:42:42.533293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:35:55.141151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530284+0000","last_change":"2022-09-07T19:42:11.411115+0000","last_active":"2022-09-07T19:42:42.530284+0000","last_peered":"2022-09-07T19:42:42.530284+0000","last_clean":"2022-09-07T19:42:42.530284+0000","last_became_active":"2022-09-07T19:42:11.410742+0000","last_became_peered":"2022-09-07T19:42:11.410742+0000","last_unstale":"2022-09-07T19:42:42.530284+0000","last_undegraded":"2022-09-07T19:42:42.530284+0000","last_fullsized":"2022-09-07T19:42:42.530284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:11:06.320256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527933+0000","last_change":"2022-09-07T19:42:06.363366+0000","last_active":"2022-09-07T19:42:42.527933+0000","last_peered":"2022-09-07T19:42:42.527933+0000","last_clean":"2022-09-07T19:42:42.527933+0000","last_became_active":"2022-09-07T19:42:06.362993+0000","last_became_peered":"2022-09-07T19:42:06.362993+0000","last_unstale":"2022-09-07T19:42:42.527933+0000","last_undegraded":"2022-09-07T19:42:42.527933+0000","last_fullsized":"2022-09-07T19:42:42.527933+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:31:15.571050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524362+0000","last_change":"2022-09-07T19:42:06.948273+0000","last_active":"2022-09-07T19:42:42.524362+0000","last_peered":"2022-09-07T19:42:42.524362+0000","last_clean":"2022-09-07T19:42:42.524362+0000","last_became_active":"2022-09-07T19:42:06.947701+0000","last_became_peered":"2022-09-07T19:42:06.947701+0000","last_unstale":"2022-09-07T19:42:42.524362+0000","last_undegraded":"2022-09-07T19:42:42.524362+0000","last_fullsized":"2022-09-07T19:42:42.524362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:01:57.543316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524314+0000","last_change":"2022-09-07T19:42:11.403357+0000","last_active":"2022-09-07T19:42:42.524314+0000","last_peered":"2022-09-07T19:42:42.524314+0000","last_clean":"2022-09-07T19:42:42.524314+0000","last_became_active":"2022-09-07T19:42:11.402903+0000","last_became_peered":"2022-09-07T19:42:11.402903+0000","last_unstale":"2022-09-07T19:42:42.524314+0000","last_undegraded":"2022-09-07T19:42:42.524314+0000","last_fullsized":"2022-09-07T19:42:42.524314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:52:19.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.832981+0000","last_change":"2022-09-07T19:42:06.358259+0000","last_active":"2022-09-07T19:42:42.832981+0000","last_peered":"2022-09-07T19:42:42.832981+0000","last_clean":"2022-09-07T19:42:42.832981+0000","last_became_active":"2022-09-07T19:42:06.357963+0000","last_became_peered":"2022-09-07T19:42:06.357963+0000","last_unstale":"2022-09-07T19:42:42.832981+0000","last_undegraded":"2022-09-07T19:42:42.832981+0000","last_fullsized":"2022-09-07T19:42:42.832981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:53:56.014702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.537993+0000","last_change":"2022-09-07T19:42:43.537993+0000","last_active":"2022-09-07T19:42:43.537993+0000","last_peered":"2022-09-07T19:42:43.537993+0000","last_clean":"2022-09-07T19:42:43.537993+0000","last_became_active":"2022-09-07T19:42:43.537650+0000","last_became_peered":"2022-09-07T19:42:43.537650+0000","last_unstale":"2022-09-07T19:42:43.537993+0000","last_undegraded":"2022-09-07T19:42:43.537993+0000","last_fullsized":"2022-09-07T19:42:43.537993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:15:44.289100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.723162+0000","last_change":"2022-09-07T19:42:43.723162+0000","last_active":"2022-09-07T19:42:43.723162+0000","last_peered":"2022-09-07T19:42:43.723162+0000","last_clean":"2022-09-07T19:42:43.723162+0000","last_became_active":"2022-09-07T19:42:43.722525+0000","last_became_peered":"2022-09-07T19:42:43.722525+0000","last_unstale":"2022-09-07T19:42:43.723162+0000","last_undegraded":"2022-09-07T19:42:43.723162+0000","last_fullsized":"2022-09-07T19:42:43.723162+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:27:30.738256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525029+0000","last_change":"2022-09-07T19:42:06.358852+0000","last_active":"2022-09-07T19:42:42.525029+0000","last_peered":"2022-09-07T19:42:42.525029+0000","last_clean":"2022-09-07T19:42:42.525029+0000","last_became_active":"2022-09-07T19:42:06.358465+0000","last_became_peered":"2022-09-07T19:42:06.358465+0000","last_unstale":"2022-09-07T19:42:42.525029+0000","last_undegraded":"2022-09-07T19:42:42.525029+0000","last_fullsized":"2022-09-07T19:42:42.525029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:15:57.255952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534210+0000","last_change":"2022-09-07T19:42:06.941011+0000","last_active":"2022-09-07T19:42:42.534210+0000","last_peered":"2022-09-07T19:42:42.534210+0000","last_clean":"2022-09-07T19:42:42.534210+0000","last_became_active":"2022-09-07T19:42:06.940728+0000","last_became_peered":"2022-09-07T19:42:06.940728+0000","last_unstale":"2022-09-07T19:42:42.534210+0000","last_undegraded":"2022-09-07T19:42:42.534210+0000","last_fullsized":"2022-09-07T19:42:42.534210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:57:52.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532441+0000","last_change":"2022-09-07T19:42:11.405383+0000","last_active":"2022-09-07T19:42:42.532441+0000","last_peered":"2022-09-07T19:42:42.532441+0000","last_clean":"2022-09-07T19:42:42.532441+0000","last_became_active":"2022-09-07T19:42:11.405021+0000","last_became_peered":"2022-09-07T19:42:11.405021+0000","last_unstale":"2022-09-07T19:42:42.532441+0000","last_undegraded":"2022-09-07T19:42:42.532441+0000","last_fullsized":"2022-09-07T19:42:42.532441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:24:30.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532982+0000","last_change":"2022-09-07T19:42:06.365791+0000","last_active":"2022-09-07T19:42:42.532982+0000","last_peered":"2022-09-07T19:42:42.532982+0000","last_clean":"2022-09-07T19:42:42.532982+0000","last_became_active":"2022-09-07T19:42:06.365471+0000","last_became_peered":"2022-09-07T19:42:06.365471+0000","last_unstale":"2022-09-07T19:42:42.532982+0000","last_undegraded":"2022-09-07T19:42:42.532982+0000","last_fullsized":"2022-09-07T19:42:42.532982+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:38:03.735263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533278+0000","last_change":"2022-09-07T19:42:06.951163+0000","last_active":"2022-09-07T19:42:42.533278+0000","last_peered":"2022-09-07T19:42:42.533278+0000","last_clean":"2022-09-07T19:42:42.533278+0000","last_became_active":"2022-09-07T19:42:06.950879+0000","last_became_peered":"2022-09-07T19:42:06.950879+0000","last_unstale":"2022-09-07T19:42:42.533278+0000","last_undegraded":"2022-09-07T19:42:42.533278+0000","last_fullsized":"2022-09-07T19:42:42.533278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:19:17.420880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530020+0000","last_change":"2022-09-07T19:42:11.402397+0000","last_active":"2022-09-07T19:42:42.530020+0000","last_peered":"2022-09-07T19:42:42.530020+0000","last_clean":"2022-09-07T19:42:42.530020+0000","last_became_active":"2022-09-07T19:42:11.402036+0000","last_became_peered":"2022-09-07T19:42:11.402036+0000","last_unstale":"2022-09-07T19:42:42.530020+0000","last_undegraded":"2022-09-07T19:42:42.530020+0000","last_fullsized":"2022-09-07T19:42:42.530020+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:42:53.158561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524405+0000","last_change":"2022-09-07T19:42:06.936405+0000","last_active":"2022-09-07T19:42:42.524405+0000","last_peered":"2022-09-07T19:42:42.524405+0000","last_clean":"2022-09-07T19:42:42.524405+0000","last_became_active":"2022-09-07T19:42:06.936125+0000","last_became_peered":"2022-09-07T19:42:06.936125+0000","last_unstale":"2022-09-07T19:42:42.524405+0000","last_undegraded":"2022-09-07T19:42:42.524405+0000","last_fullsized":"2022-09-07T19:42:42.524405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:47:33.002955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:24.598708+0000","last_change":"2022-09-07T19:42:06.372771+0000","last_active":"2022-09-07T19:43:24.598708+0000","last_peered":"2022-09-07T19:43:24.598708+0000","last_clean":"2022-09-07T19:43:24.598708+0000","last_became_active":"2022-09-07T19:42:06.372498+0000","last_became_peered":"2022-09-07T19:42:06.372498+0000","last_unstale":"2022-09-07T19:43:24.598708+0000","last_undegraded":"2022-09-07T19:43:24.598708+0000","last_fullsized":"2022-09-07T19:43:24.598708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:26:04.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532339+0000","last_change":"2022-09-07T19:42:11.410486+0000","last_active":"2022-09-07T19:42:42.532339+0000","last_peered":"2022-09-07T19:42:42.532339+0000","last_clean":"2022-09-07T19:42:42.532339+0000","last_became_active":"2022-09-07T19:42:11.410195+0000","last_became_peered":"2022-09-07T19:42:11.410195+0000","last_unstale":"2022-09-07T19:42:42.532339+0000","last_undegraded":"2022-09-07T19:42:42.532339+0000","last_fullsized":"2022-09-07T19:42:42.532339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:01:25.927536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531197+0000","last_change":"2022-09-07T19:42:06.942040+0000","last_active":"2022-09-07T19:42:42.531197+0000","last_peered":"2022-09-07T19:42:42.531197+0000","last_clean":"2022-09-07T19:42:42.531197+0000","last_became_active":"2022-09-07T19:42:06.941732+0000","last_became_peered":"2022-09-07T19:42:06.941732+0000","last_unstale":"2022-09-07T19:42:42.531197+0000","last_undegraded":"2022-09-07T19:42:42.531197+0000","last_fullsized":"2022-09-07T19:42:42.531197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:05:56.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529116+0000","last_change":"2022-09-07T19:42:06.361996+0000","last_active":"2022-09-07T19:42:42.529116+0000","last_peered":"2022-09-07T19:42:42.529116+0000","last_clean":"2022-09-07T19:42:42.529116+0000","last_became_active":"2022-09-07T19:42:06.361658+0000","last_became_peered":"2022-09-07T19:42:06.361658+0000","last_unstale":"2022-09-07T19:42:42.529116+0000","last_undegraded":"2022-09-07T19:42:42.529116+0000","last_fullsized":"2022-09-07T19:42:42.529116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:07:13.180501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":379,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531959+0000","last_change":"2022-09-07T19:40:58.352995+0000","last_active":"2022-09-07T19:42:42.531959+0000","last_peered":"2022-09-07T19:42:42.531959+0000","last_clean":"2022-09-07T19:42:42.531959+0000","last_became_active":"2022-09-07T19:40:58.352548+0000","last_became_peered":"2022-09-07T19:40:58.352548+0000","last_unstale":"2022-09-07T19:42:42.531959+0000","last_undegraded":"2022-09-07T19:42:42.531959+0000","last_fullsized":"2022-09-07T19:42:42.531959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_clean_scrub_stamp":"2022-09-07T19:37:12.654773+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:58:55.796726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525257+0000","last_change":"2022-09-07T19:42:11.404798+0000","last_active":"2022-09-07T19:42:42.525257+0000","last_peered":"2022-09-07T19:42:42.525257+0000","last_clean":"2022-09-07T19:42:42.525257+0000","last_became_active":"2022-09-07T19:42:11.404370+0000","last_became_peered":"2022-09-07T19:42:11.404370+0000","last_unstale":"2022-09-07T19:42:42.525257+0000","last_undegraded":"2022-09-07T19:42:42.525257+0000","last_fullsized":"2022-09-07T19:42:42.525257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:40.619684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529018+0000","last_change":"2022-09-07T19:42:06.943283+0000","last_active":"2022-09-07T19:42:42.529018+0000","last_peered":"2022-09-07T19:42:42.529018+0000","last_clean":"2022-09-07T19:42:42.529018+0000","last_became_active":"2022-09-07T19:42:06.942864+0000","last_became_peered":"2022-09-07T19:42:06.942864+0000","last_unstale":"2022-09-07T19:42:42.529018+0000","last_undegraded":"2022-09-07T19:42:42.529018+0000","last_fullsized":"2022-09-07T19:42:42.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:23.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531999+0000","last_change":"2022-09-07T19:42:06.361341+0000","last_active":"2022-09-07T19:42:42.531999+0000","last_peered":"2022-09-07T19:42:42.531999+0000","last_clean":"2022-09-07T19:42:42.531999+0000","last_became_active":"2022-09-07T19:42:06.361008+0000","last_became_peered":"2022-09-07T19:42:06.361008+0000","last_unstale":"2022-09-07T19:42:42.531999+0000","last_undegraded":"2022-09-07T19:42:42.531999+0000","last_fullsized":"2022-09-07T19:42:42.531999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:08:54.850406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528725+0000","last_change":"2022-09-07T19:42:11.401991+0000","last_active":"2022-09-07T19:42:42.528725+0000","last_peered":"2022-09-07T19:42:42.528725+0000","last_clean":"2022-09-07T19:42:42.528725+0000","last_became_active":"2022-09-07T19:42:11.401129+0000","last_became_peered":"2022-09-07T19:42:11.401129+0000","last_unstale":"2022-09-07T19:42:42.528725+0000","last_undegraded":"2022-09-07T19:42:42.528725+0000","last_fullsized":"2022-09-07T19:42:42.528725+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:11:40.780758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530143+0000","last_change":"2022-09-07T19:42:06.364282+0000","last_active":"2022-09-07T19:42:42.530143+0000","last_peered":"2022-09-07T19:42:42.530143+0000","last_clean":"2022-09-07T19:42:42.530143+0000","last_became_active":"2022-09-07T19:42:06.364004+0000","last_became_peered":"2022-09-07T19:42:06.364004+0000","last_unstale":"2022-09-07T19:42:42.530143+0000","last_undegraded":"2022-09-07T19:42:42.530143+0000","last_fullsized":"2022-09-07T19:42:42.530143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:16.489787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532636+0000","last_change":"2022-09-07T19:42:06.935556+0000","last_active":"2022-09-07T19:42:42.532636+0000","last_peered":"2022-09-07T19:42:42.532636+0000","last_clean":"2022-09-07T19:42:42.532636+0000","last_became_active":"2022-09-07T19:42:06.935277+0000","last_became_peered":"2022-09-07T19:42:06.935277+0000","last_unstale":"2022-09-07T19:42:42.532636+0000","last_undegraded":"2022-09-07T19:42:42.532636+0000","last_fullsized":"2022-09-07T19:42:42.532636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:52:27.506947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529532+0000","last_change":"2022-09-07T19:42:11.402833+0000","last_active":"2022-09-07T19:42:42.529532+0000","last_peered":"2022-09-07T19:42:42.529532+0000","last_clean":"2022-09-07T19:42:42.529532+0000","last_became_active":"2022-09-07T19:42:11.402478+0000","last_became_peered":"2022-09-07T19:42:11.402478+0000","last_unstale":"2022-09-07T19:42:42.529532+0000","last_undegraded":"2022-09-07T19:42:42.529532+0000","last_fullsized":"2022-09-07T19:42:42.529532+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:58:50.474580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:44.331407+0000","last_change":"2022-09-07T19:42:06.369761+0000","last_active":"2022-09-07T19:42:44.331407+0000","last_peered":"2022-09-07T19:42:44.331407+0000","last_clean":"2022-09-07T19:42:44.331407+0000","last_became_active":"2022-09-07T19:42:06.369366+0000","last_became_peered":"2022-09-07T19:42:06.369366+0000","last_unstale":"2022-09-07T19:42:44.331407+0000","last_undegraded":"2022-09-07T19:42:44.331407+0000","last_fullsized":"2022-09-07T19:42:44.331407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:58.993644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531020+0000","last_change":"2022-09-07T19:42:06.939822+0000","last_active":"2022-09-07T19:42:42.531020+0000","last_peered":"2022-09-07T19:42:42.531020+0000","last_clean":"2022-09-07T19:42:42.531020+0000","last_became_active":"2022-09-07T19:42:06.939515+0000","last_became_peered":"2022-09-07T19:42:06.939515+0000","last_unstale":"2022-09-07T19:42:42.531020+0000","last_undegraded":"2022-09-07T19:42:42.531020+0000","last_fullsized":"2022-09-07T19:42:42.531020+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:32:15.696524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531251+0000","last_change":"2022-09-07T19:42:11.401085+0000","last_active":"2022-09-07T19:42:42.531251+0000","last_peered":"2022-09-07T19:42:42.531251+0000","last_clean":"2022-09-07T19:42:42.531251+0000","last_became_active":"2022-09-07T19:42:11.400594+0000","last_became_peered":"2022-09-07T19:42:11.400594+0000","last_unstale":"2022-09-07T19:42:42.531251+0000","last_undegraded":"2022-09-07T19:42:42.531251+0000","last_fullsized":"2022-09-07T19:42:42.531251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:44:52.837616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529607+0000","last_change":"2022-09-07T19:42:06.365721+0000","last_active":"2022-09-07T19:42:42.529607+0000","last_peered":"2022-09-07T19:42:42.529607+0000","last_clean":"2022-09-07T19:42:42.529607+0000","last_became_active":"2022-09-07T19:42:06.365388+0000","last_became_peered":"2022-09-07T19:42:06.365388+0000","last_unstale":"2022-09-07T19:42:42.529607+0000","last_undegraded":"2022-09-07T19:42:42.529607+0000","last_fullsized":"2022-09-07T19:42:42.529607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:51:57.432567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534108+0000","last_change":"2022-09-07T19:42:06.959467+0000","last_active":"2022-09-07T19:42:42.534108+0000","last_peered":"2022-09-07T19:42:42.534108+0000","last_clean":"2022-09-07T19:42:42.534108+0000","last_became_active":"2022-09-07T19:42:06.959165+0000","last_became_peered":"2022-09-07T19:42:06.959165+0000","last_unstale":"2022-09-07T19:42:42.534108+0000","last_undegraded":"2022-09-07T19:42:42.534108+0000","last_fullsized":"2022-09-07T19:42:42.534108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:45:54.697717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529417+0000","last_change":"2022-09-07T19:42:11.414077+0000","last_active":"2022-09-07T19:42:42.529417+0000","last_peered":"2022-09-07T19:42:42.529417+0000","last_clean":"2022-09-07T19:42:42.529417+0000","last_became_active":"2022-09-07T19:42:11.413611+0000","last_became_peered":"2022-09-07T19:42:11.413611+0000","last_unstale":"2022-09-07T19:42:42.529417+0000","last_undegraded":"2022-09-07T19:42:42.529417+0000","last_fullsized":"2022-09-07T19:42:42.529417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:28:23.166148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527029+0000","last_change":"2022-09-07T19:42:06.359443+0000","last_active":"2022-09-07T19:42:42.527029+0000","last_peered":"2022-09-07T19:42:42.527029+0000","last_clean":"2022-09-07T19:42:42.527029+0000","last_became_active":"2022-09-07T19:42:06.359095+0000","last_became_peered":"2022-09-07T19:42:06.359095+0000","last_unstale":"2022-09-07T19:42:42.527029+0000","last_undegraded":"2022-09-07T19:42:42.527029+0000","last_fullsized":"2022-09-07T19:42:42.527029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:36:01.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527736+0000","last_change":"2022-09-07T19:42:06.933410+0000","last_active":"2022-09-07T19:42:42.527736+0000","last_peered":"2022-09-07T19:42:42.527736+0000","last_clean":"2022-09-07T19:42:42.527736+0000","last_became_active":"2022-09-07T19:42:06.933092+0000","last_became_peered":"2022-09-07T19:42:06.933092+0000","last_unstale":"2022-09-07T19:42:42.527736+0000","last_undegraded":"2022-09-07T19:42:42.527736+0000","last_fullsized":"2022-09-07T19:42:42.527736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:39:51.700247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525703+0000","last_change":"2022-09-07T19:42:11.409290+0000","last_active":"2022-09-07T19:42:42.525703+0000","last_peered":"2022-09-07T19:42:42.525703+0000","last_clean":"2022-09-07T19:42:42.525703+0000","last_became_active":"2022-09-07T19:42:11.408883+0000","last_became_peered":"2022-09-07T19:42:11.408883+0000","last_unstale":"2022-09-07T19:42:42.525703+0000","last_undegraded":"2022-09-07T19:42:42.525703+0000","last_fullsized":"2022-09-07T19:42:42.525703+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:51:39.640794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530017+0000","last_change":"2022-09-07T19:42:06.377191+0000","last_active":"2022-09-07T19:42:42.530017+0000","last_peered":"2022-09-07T19:42:42.530017+0000","last_clean":"2022-09-07T19:42:42.530017+0000","last_became_active":"2022-09-07T19:42:06.376437+0000","last_became_peered":"2022-09-07T19:42:06.376437+0000","last_unstale":"2022-09-07T19:42:42.530017+0000","last_undegraded":"2022-09-07T19:42:42.530017+0000","last_fullsized":"2022-09-07T19:42:42.530017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:53:44.874088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528310+0000","last_change":"2022-09-07T19:42:06.954380+0000","last_active":"2022-09-07T19:42:42.528310+0000","last_peered":"2022-09-07T19:42:42.528310+0000","last_clean":"2022-09-07T19:42:42.528310+0000","last_became_active":"2022-09-07T19:42:06.954206+0000","last_became_peered":"2022-09-07T19:42:06.954206+0000","last_unstale":"2022-09-07T19:42:42.528310+0000","last_undegraded":"2022-09-07T19:42:42.528310+0000","last_fullsized":"2022-09-07T19:42:42.528310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:49:23.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.542848+0000","last_change":"2022-09-07T19:42:43.542848+0000","last_active":"2022-09-07T19:42:43.542848+0000","last_peered":"2022-09-07T19:42:43.542848+0000","last_clean":"2022-09-07T19:42:43.542848+0000","last_became_active":"2022-09-07T19:42:43.538460+0000","last_became_peered":"2022-09-07T19:42:43.538460+0000","last_unstale":"2022-09-07T19:42:43.542848+0000","last_undegraded":"2022-09-07T19:42:43.542848+0000","last_fullsized":"2022-09-07T19:42:43.542848+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:15:55.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532798+0000","last_change":"2022-09-07T19:42:06.358321+0000","last_active":"2022-09-07T19:42:42.532798+0000","last_peered":"2022-09-07T19:42:42.532798+0000","last_clean":"2022-09-07T19:42:42.532798+0000","last_became_active":"2022-09-07T19:42:06.358016+0000","last_became_peered":"2022-09-07T19:42:06.358016+0000","last_unstale":"2022-09-07T19:42:42.532798+0000","last_undegraded":"2022-09-07T19:42:42.532798+0000","last_fullsized":"2022-09-07T19:42:42.532798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:44:23.140211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530712+0000","last_change":"2022-09-07T19:42:06.954601+0000","last_active":"2022-09-07T19:42:42.530712+0000","last_peered":"2022-09-07T19:42:42.530712+0000","last_clean":"2022-09-07T19:42:42.530712+0000","last_became_active":"2022-09-07T19:42:06.954220+0000","last_became_peered":"2022-09-07T19:42:06.954220+0000","last_unstale":"2022-09-07T19:42:42.530712+0000","last_undegraded":"2022-09-07T19:42:42.530712+0000","last_fullsized":"2022-09-07T19:42:42.530712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:21.042536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529231+0000","last_change":"2022-09-07T19:42:11.406496+0000","last_active":"2022-09-07T19:42:42.529231+0000","last_peered":"2022-09-07T19:42:42.529231+0000","last_clean":"2022-09-07T19:42:42.529231+0000","last_became_active":"2022-09-07T19:42:11.406097+0000","last_became_peered":"2022-09-07T19:42:11.406097+0000","last_unstale":"2022-09-07T19:42:42.529231+0000","last_undegraded":"2022-09-07T19:42:42.529231+0000","last_fullsized":"2022-09-07T19:42:42.529231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:19.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530504+0000","last_change":"2022-09-07T19:42:06.357410+0000","last_active":"2022-09-07T19:42:42.530504+0000","last_peered":"2022-09-07T19:42:42.530504+0000","last_clean":"2022-09-07T19:42:42.530504+0000","last_became_active":"2022-09-07T19:42:06.357016+0000","last_became_peered":"2022-09-07T19:42:06.357016+0000","last_unstale":"2022-09-07T19:42:42.530504+0000","last_undegraded":"2022-09-07T19:42:42.530504+0000","last_fullsized":"2022-09-07T19:42:42.530504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:10:30.657678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532824+0000","last_change":"2022-09-07T19:42:06.944746+0000","last_active":"2022-09-07T19:42:42.532824+0000","last_peered":"2022-09-07T19:42:42.532824+0000","last_clean":"2022-09-07T19:42:42.532824+0000","last_became_active":"2022-09-07T19:42:06.944324+0000","last_became_peered":"2022-09-07T19:42:06.944324+0000","last_unstale":"2022-09-07T19:42:42.532824+0000","last_undegraded":"2022-09-07T19:42:42.532824+0000","last_fullsized":"2022-09-07T19:42:42.532824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:20:56.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527141+0000","last_change":"2022-09-07T19:42:11.405830+0000","last_active":"2022-09-07T19:42:42.527141+0000","last_peered":"2022-09-07T19:42:42.527141+0000","last_clean":"2022-09-07T19:42:42.527141+0000","last_became_active":"2022-09-07T19:42:11.405375+0000","last_became_peered":"2022-09-07T19:42:11.405375+0000","last_unstale":"2022-09-07T19:42:42.527141+0000","last_undegraded":"2022-09-07T19:42:42.527141+0000","last_fullsized":"2022-09-07T19:42:42.527141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:30:43.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533713+0000","last_change":"2022-09-07T19:42:06.359635+0000","last_active":"2022-09-07T19:42:42.533713+0000","last_peered":"2022-09-07T19:42:42.533713+0000","last_clean":"2022-09-07T19:42:42.533713+0000","last_became_active":"2022-09-07T19:42:06.359349+0000","last_became_peered":"2022-09-07T19:42:06.359349+0000","last_unstale":"2022-09-07T19:42:42.533713+0000","last_undegraded":"2022-09-07T19:42:42.533713+0000","last_fullsized":"2022-09-07T19:42:42.533713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:56.282670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532941+0000","last_change":"2022-09-07T19:42:06.948313+0000","last_active":"2022-09-07T19:42:42.532941+0000","last_peered":"2022-09-07T19:42:42.532941+0000","last_clean":"2022-09-07T19:42:42.532941+0000","last_became_active":"2022-09-07T19:42:06.948008+0000","last_became_peered":"2022-09-07T19:42:06.948008+0000","last_unstale":"2022-09-07T19:42:42.532941+0000","last_undegraded":"2022-09-07T19:42:42.532941+0000","last_fullsized":"2022-09-07T19:42:42.532941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:39:30.575085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533294+0000","last_change":"2022-09-07T19:42:11.413042+0000","last_active":"2022-09-07T19:42:42.533294+0000","last_peered":"2022-09-07T19:42:42.533294+0000","last_clean":"2022-09-07T19:42:42.533294+0000","last_became_active":"2022-09-07T19:42:11.412658+0000","last_became_peered":"2022-09-07T19:42:11.412658+0000","last_unstale":"2022-09-07T19:42:42.533294+0000","last_undegraded":"2022-09-07T19:42:42.533294+0000","last_fullsized":"2022-09-07T19:42:42.533294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:33:41.892522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525141+0000","last_change":"2022-09-07T19:42:06.376394+0000","last_active":"2022-09-07T19:42:42.525141+0000","last_peered":"2022-09-07T19:42:42.525141+0000","last_clean":"2022-09-07T19:42:42.525141+0000","last_became_active":"2022-09-07T19:42:06.376141+0000","last_became_peered":"2022-09-07T19:42:06.376141+0000","last_unstale":"2022-09-07T19:42:42.525141+0000","last_undegraded":"2022-09-07T19:42:42.525141+0000","last_fullsized":"2022-09-07T19:42:42.525141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:40:00.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533399+0000","last_change":"2022-09-07T19:42:06.937730+0000","last_active":"2022-09-07T19:42:42.533399+0000","last_peered":"2022-09-07T19:42:42.533399+0000","last_clean":"2022-09-07T19:42:42.533399+0000","last_became_active":"2022-09-07T19:42:06.937387+0000","last_became_peered":"2022-09-07T19:42:06.937387+0000","last_unstale":"2022-09-07T19:42:42.533399+0000","last_undegraded":"2022-09-07T19:42:42.533399+0000","last_fullsized":"2022-09-07T19:42:42.533399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:22:04.045843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524089+0000","last_change":"2022-09-07T19:42:11.403846+0000","last_active":"2022-09-07T19:42:42.524089+0000","last_peered":"2022-09-07T19:42:42.524089+0000","last_clean":"2022-09-07T19:42:42.524089+0000","last_became_active":"2022-09-07T19:42:11.403096+0000","last_became_peered":"2022-09-07T19:42:11.403096+0000","last_unstale":"2022-09-07T19:42:42.524089+0000","last_undegraded":"2022-09-07T19:42:42.524089+0000","last_fullsized":"2022-09-07T19:42:42.524089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:37:41.081199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530198+0000","last_change":"2022-09-07T19:42:06.378938+0000","last_active":"2022-09-07T19:42:42.530198+0000","last_peered":"2022-09-07T19:42:42.530198+0000","last_clean":"2022-09-07T19:42:42.530198+0000","last_became_active":"2022-09-07T19:42:06.378545+0000","last_became_peered":"2022-09-07T19:42:06.378545+0000","last_unstale":"2022-09-07T19:42:42.530198+0000","last_undegraded":"2022-09-07T19:42:42.530198+0000","last_fullsized":"2022-09-07T19:42:42.530198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:53.904515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532623+0000","last_change":"2022-09-07T19:42:06.936282+0000","last_active":"2022-09-07T19:42:42.532623+0000","last_peered":"2022-09-07T19:42:42.532623+0000","last_clean":"2022-09-07T19:42:42.532623+0000","last_became_active":"2022-09-07T19:42:06.935916+0000","last_became_peered":"2022-09-07T19:42:06.935916+0000","last_unstale":"2022-09-07T19:42:42.532623+0000","last_undegraded":"2022-09-07T19:42:42.532623+0000","last_fullsized":"2022-09-07T19:42:42.532623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:53:06.657196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528328+0000","last_change":"2022-09-07T19:42:06.938195+0000","last_active":"2022-09-07T19:42:42.528328+0000","last_peered":"2022-09-07T19:42:42.528328+0000","last_clean":"2022-09-07T19:42:42.528328+0000","last_became_active":"2022-09-07T19:42:06.937916+0000","last_became_peered":"2022-09-07T19:42:06.937916+0000","last_unstale":"2022-09-07T19:42:42.528328+0000","last_undegraded":"2022-09-07T19:42:42.528328+0000","last_fullsized":"2022-09-07T19:42:42.528328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:22:43.390552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532073+0000","last_change":"2022-09-07T19:42:06.940303+0000","last_active":"2022-09-07T19:42:42.532073+0000","last_peered":"2022-09-07T19:42:42.532073+0000","last_clean":"2022-09-07T19:42:42.532073+0000","last_became_active":"2022-09-07T19:42:06.939974+0000","last_became_peered":"2022-09-07T19:42:06.939974+0000","last_unstale":"2022-09-07T19:42:42.532073+0000","last_undegraded":"2022-09-07T19:42:42.532073+0000","last_fullsized":"2022-09-07T19:42:42.532073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:36:37.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530850+0000","last_change":"2022-09-07T19:42:06.948849+0000","last_active":"2022-09-07T19:42:42.530850+0000","last_peered":"2022-09-07T19:42:42.530850+0000","last_clean":"2022-09-07T19:42:42.530850+0000","last_became_active":"2022-09-07T19:42:06.948263+0000","last_became_peered":"2022-09-07T19:42:06.948263+0000","last_unstale":"2022-09-07T19:42:42.530850+0000","last_undegraded":"2022-09-07T19:42:42.530850+0000","last_fullsized":"2022-09-07T19:42:42.530850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:33:26.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533385+0000","last_change":"2022-09-07T19:42:06.957145+0000","last_active":"2022-09-07T19:42:42.533385+0000","last_peered":"2022-09-07T19:42:42.533385+0000","last_clean":"2022-09-07T19:42:42.533385+0000","last_became_active":"2022-09-07T19:42:06.956769+0000","last_became_peered":"2022-09-07T19:42:06.956769+0000","last_unstale":"2022-09-07T19:42:42.533385+0000","last_undegraded":"2022-09-07T19:42:42.533385+0000","last_fullsized":"2022-09-07T19:42:42.533385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:51:09.154847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532714+0000","last_change":"2022-09-07T19:42:06.954543+0000","last_active":"2022-09-07T19:42:42.532714+0000","last_peered":"2022-09-07T19:42:42.532714+0000","last_clean":"2022-09-07T19:42:42.532714+0000","last_became_active":"2022-09-07T19:42:06.954229+0000","last_became_peered":"2022-09-07T19:42:06.954229+0000","last_unstale":"2022-09-07T19:42:42.532714+0000","last_undegraded":"2022-09-07T19:42:42.532714+0000","last_fullsized":"2022-09-07T19:42:42.532714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:55:48.612830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529496+0000","last_change":"2022-09-07T19:42:06.937808+0000","last_active":"2022-09-07T19:42:42.529496+0000","last_peered":"2022-09-07T19:42:42.529496+0000","last_clean":"2022-09-07T19:42:42.529496+0000","last_became_active":"2022-09-07T19:42:06.937452+0000","last_became_peered":"2022-09-07T19:42:06.937452+0000","last_unstale":"2022-09-07T19:42:42.529496+0000","last_undegraded":"2022-09-07T19:42:42.529496+0000","last_fullsized":"2022-09-07T19:42:42.529496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:56:19.296497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533366+0000","last_change":"2022-09-07T19:42:06.939519+0000","last_active":"2022-09-07T19:42:42.533366+0000","last_peered":"2022-09-07T19:42:42.533366+0000","last_clean":"2022-09-07T19:42:42.533366+0000","last_became_active":"2022-09-07T19:42:06.939171+0000","last_became_peered":"2022-09-07T19:42:06.939171+0000","last_unstale":"2022-09-07T19:42:42.533366+0000","last_undegraded":"2022-09-07T19:42:42.533366+0000","last_fullsized":"2022-09-07T19:42:42.533366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:12:30.663072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531175+0000","last_change":"2022-09-07T19:42:06.939331+0000","last_active":"2022-09-07T19:42:42.531175+0000","last_peered":"2022-09-07T19:42:42.531175+0000","last_clean":"2022-09-07T19:42:42.531175+0000","last_became_active":"2022-09-07T19:42:06.939034+0000","last_became_peered":"2022-09-07T19:42:06.939034+0000","last_unstale":"2022-09-07T19:42:42.531175+0000","last_undegraded":"2022-09-07T19:42:42.531175+0000","last_fullsized":"2022-09-07T19:42:42.531175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:14:24.794753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.544352+0000","last_change":"2022-09-07T19:42:43.544352+0000","last_active":"2022-09-07T19:42:43.544352+0000","last_peered":"2022-09-07T19:42:43.544352+0000","last_clean":"2022-09-07T19:42:43.544352+0000","last_became_active":"2022-09-07T19:42:43.544029+0000","last_became_peered":"2022-09-07T19:42:43.544029+0000","last_unstale":"2022-09-07T19:42:43.544352+0000","last_undegraded":"2022-09-07T19:42:43.544352+0000","last_fullsized":"2022-09-07T19:42:43.544352+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:01:59.991410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530100+0000","last_change":"2022-09-07T19:42:06.940112+0000","last_active":"2022-09-07T19:42:42.530100+0000","last_peered":"2022-09-07T19:42:42.530100+0000","last_clean":"2022-09-07T19:42:42.530100+0000","last_became_active":"2022-09-07T19:42:06.939734+0000","last_became_peered":"2022-09-07T19:42:06.939734+0000","last_unstale":"2022-09-07T19:42:42.530100+0000","last_undegraded":"2022-09-07T19:42:42.530100+0000","last_fullsized":"2022-09-07T19:42:42.530100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:17:34.201649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527344+0000","last_change":"2022-09-07T19:42:06.945504+0000","last_active":"2022-09-07T19:42:42.527344+0000","last_peered":"2022-09-07T19:42:42.527344+0000","last_clean":"2022-09-07T19:42:42.527344+0000","last_became_active":"2022-09-07T19:42:06.945194+0000","last_became_peered":"2022-09-07T19:42:06.945194+0000","last_unstale":"2022-09-07T19:42:42.527344+0000","last_undegraded":"2022-09-07T19:42:42.527344+0000","last_fullsized":"2022-09-07T19:42:42.527344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:54:10.526721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529750+0000","last_change":"2022-09-07T19:42:06.953952+0000","last_active":"2022-09-07T19:42:42.529750+0000","last_peered":"2022-09-07T19:42:42.529750+0000","last_clean":"2022-09-07T19:42:42.529750+0000","last_became_active":"2022-09-07T19:42:06.953594+0000","last_became_peered":"2022-09-07T19:42:06.953594+0000","last_unstale":"2022-09-07T19:42:42.529750+0000","last_undegraded":"2022-09-07T19:42:42.529750+0000","last_fullsized":"2022-09-07T19:42:42.529750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:52:15.188770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529643+0000","last_change":"2022-09-07T19:42:06.943804+0000","last_active":"2022-09-07T19:42:42.529643+0000","last_peered":"2022-09-07T19:42:42.529643+0000","last_clean":"2022-09-07T19:42:42.529643+0000","last_became_active":"2022-09-07T19:42:06.943499+0000","last_became_peered":"2022-09-07T19:42:06.943499+0000","last_unstale":"2022-09-07T19:42:42.529643+0000","last_undegraded":"2022-09-07T19:42:42.529643+0000","last_fullsized":"2022-09-07T19:42:42.529643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:20.646159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281075,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65117,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":308,"num_read_kb":224,"num_write":158,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383707,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6100,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739052,"statfs":{"total":95995035648,"available":95988789248,"internally_reserved":0,"allocated":995328,"data_stored":498840,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68500000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64500000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.41399999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.46200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45700000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.109,"5min":1.294,"15min":1.294},"last":0.626},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.58499999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.86199999999999999,"5min":1.05,"15min":1.05},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.026,"15min":1.026},"last":0.54900000000000004}]},{"osd":8,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56200000000000006}]},{"osd":9,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.68300000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.60699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91300000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.60899999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645345,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6560,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738592,"statfs":{"total":95995035648,"available":95988318208,"internally_reserved":0,"allocated":1138688,"data_stored":1151091,"data_compressed":53343,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:43:08 2022","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":9.9600000000000009,"5min":9.9600000000000009,"15min":9.9600000000000009},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72599999999999998,"5min":0.746,"15min":0.746},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56299999999999994,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38800000000000001}]},{"osd":2,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78500000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57899999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69299999999999995,"15min":0.67700000000000005},"min":{"1min":0.56100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.374}]},{"osd":5,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.56000000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89500000000000002,"15min":0.92100000000000004},"min":{"1min":0.57899999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.405,"5min":4.415,"15min":4.415},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.76200000000000001,"15min":0.74299999999999999},"min":{"1min":0.60899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.75900000000000001}]},{"osd":7,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.90800000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.55300000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.624}]},{"osd":9,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.85399999999999998,"15min":0.82199999999999995},"min":{"1min":0.68600000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.58799999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:22 2022","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67800000000000005}]}]},{"osd":9,"up_from":67,"seq":287762808871,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":1011712,"data_stored":499076,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69299999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":1.137}]},{"osd":1,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90700000000000003,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98899999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.88700000000000001}]},{"osd":3,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76800000000000002},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89500000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94099999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80700000000000005,"15min":0.81499999999999995},"min":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.89200000000000002,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.85399999999999998,"15min":0.876},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94199999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.86299999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.92100000000000004}]},{"osd":6,"last update":"Wed Sep 7 19:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.753}]},{"osd":7,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.98499999999999999,"5min":1.599,"15min":1.599},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.93899999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.95299999999999996,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.88}]},{"osd":8,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.98799999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0589999999999999,"5min":1.357,"15min":1.357},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.96499999999999997,"15min":0.98899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.03,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.048}]},{"osd":10,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.046,"15min":0.96899999999999997},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":12.18,"5min":12.18,"15min":12.18},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.71,"5min":1.081,"15min":0.97599999999999998},"min":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":15.32,"5min":15.32,"15min":15.32},"last":0.78700000000000003}]},{"osd":11,"last update":"Wed Sep 7 19:43:15 2022","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":1.079},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":12.147,"5min":12.147,"15min":12.147},"last":0.99199999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6436,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738716,"statfs":{"total":95995035648,"available":95988445184,"internally_reserved":0,"allocated":1011712,"data_stored":498996,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67300000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.498}]},{"osd":1,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.74399999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78700000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.876,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63200000000000001,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.41799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.622,"15min":0.62},"min":{"1min":0.441,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.58499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.026,"15min":1.026},"last":0.84299999999999997}]},{"osd":7,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.46100000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.49399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.75600000000000001}]},{"osd":9,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.76600000000000001}]},{"osd":10,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71699999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73899999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332144,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6548,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738604,"statfs":{"total":95995035648,"available":95988330496,"internally_reserved":0,"allocated":1060864,"data_stored":1095204,"data_compressed":53343,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:35 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42099999999999999,"15min":0.41099999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53100000000000003,"5min":1.097,"15min":1.097},"last":0.439},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.623,"5min":0.748,"15min":0.748},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.77800000000000002}]},{"osd":3,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68899999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.443,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.504}]},{"osd":5,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.752,"15min":1.752},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.78,"15min":1.78},"last":0.74299999999999999}]},{"osd":6,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61699999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.87,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.752},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.64900000000000002},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72599999999999998}]},{"osd":9,"last update":"Wed Sep 7 19:42:34 2022","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68899999999999995}]},{"osd":10,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.755},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94499999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65500000000000003}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80400000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6416,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738736,"statfs":{"total":95995035648,"available":95988465664,"internally_reserved":0,"allocated":991232,"data_stored":494268,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.47699999999999998,"15min":0.45200000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.61499999999999999,"15min":0.57999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.48799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80400000000000005}]},{"osd":2,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95699999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.77900000000000003}]},{"osd":3,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":0.996},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.073,"15min":1.073},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85399999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":1.119,"15min":1.119},"last":0.622}]},{"osd":7,"last update":"Wed Sep 7 19:42:38 2022","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73699999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:43:03 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80300000000000005,"15min":0.79200000000000004},"min":{"1min":0.627,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.78100000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.79600000000000004}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.141,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86899999999999999}]},{"osd":10,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91500000000000004,"15min":0.91300000000000003},"min":{"1min":0.73799999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.85399999999999998}]},{"osd":11,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7440,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737712,"statfs":{"total":95995035648,"available":95987417088,"internally_reserved":0,"allocated":1056768,"data_stored":555043,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.89700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.54600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84699999999999998,"5min":1.04,"15min":1.04},"last":0.502}]},{"osd":2,"last update":"Wed Sep 7 19:42:24 2022","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.67300000000000004}]},{"osd":3,"last update":"Wed Sep 7 19:42:50 2022","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42099999999999999,"15min":0.40100000000000002},"min":{"1min":0.32100000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.441,"15min":0.41299999999999998},"min":{"1min":0.308,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 7 19:42:40 2022","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.752}]},{"osd":6,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.504,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90900000000000003,"5min":1.107,"15min":1.107},"last":0.73299999999999998}]},{"osd":7,"last update":"Wed Sep 7 19:42:40 2022","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85999999999999999,"5min":0.875,"15min":0.875},"last":0.71599999999999997}]},{"osd":8,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.65800000000000003,"15min":0.63200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.90400000000000003}]},{"osd":9,"last update":"Wed Sep 7 19:42:31 2022","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.747,"15min":0.749},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.069,"15min":1.069},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94399999999999995,"5min":1.056,"15min":1.056},"last":0.875}]},{"osd":10,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.48699999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.032,"15min":1.032},"last":0.83699999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.91800000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7336,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737816,"statfs":{"total":95995035648,"available":95987523584,"internally_reserved":0,"allocated":1015808,"data_stored":495624,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 7 19:43:00 2022","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.6479999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:43:25 2022","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.66300000000000003,"15min":0.61299999999999999},"min":{"1min":0.47499999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.145,"5min":0.745,"15min":0.64800000000000002},"min":{"1min":0.52100000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.9370000000000003,"5min":6.9370000000000003,"15min":6.9370000000000003},"last":0.624}]},{"osd":3,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":7.2670000000000003,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.70099999999999996}]},{"osd":4,"last update":"Wed Sep 7 19:43:19 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.68100000000000005,"15min":0.65100000000000002},"min":{"1min":0.56499999999999995,"5min":0.372,"15min":0.372},"max":{"1min":1.2390000000000001,"5min":1.244,"15min":1.244},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.484,"5min":3.484,"15min":3.484},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71399999999999997,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.71899999999999997,"15min":0.67700000000000005},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.748},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":7.1660000000000004,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.89800000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:43:00 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.77400000000000002,"15min":0.755},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.94899999999999995}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1299999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.127,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.754}]},{"osd":10,"last update":"Wed Sep 7 19:42:56 2022","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.83199999999999996,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91000000000000003,"15min":0.91400000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.302,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.143}]},{"osd":11,"last update":"Wed Sep 7 19:43:19 2022","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.81899999999999995,"15min":0.77600000000000002},"min":{"1min":0.64400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":0.876},{"interface":"front","average":{"1min":0.998,"5min":0.88500000000000001,"15min":0.86599999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.048}]}]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7592,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737560,"statfs":{"total":95995035648,"available":95987261440,"internally_reserved":0,"allocated":1081344,"data_stored":556722,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.42799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79500000000000004,"5min":1.113,"15min":1.113},"last":0.60399999999999998}]},{"osd":1,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81299999999999994,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":2.117,"15min":2.117},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.434},{"interface":"front","average":{"1min":0.622,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45600000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:43:09 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.64100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.751}]},{"osd":7,"last update":"Wed Sep 7 19:43:11 2022","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73999999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.64300000000000002,"15min":0.63200000000000001},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.622}]},{"osd":9,"last update":"Wed Sep 7 19:42:30 2022","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2},"last":0.80900000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.70999999999999996,"15min":0.68700000000000006},"min":{"1min":0.67100000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70099999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6680,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738472,"statfs":{"total":95995035648,"available":95988195328,"internally_reserved":0,"allocated":999424,"data_stored":494139,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45700000000000002,"15min":0.41699999999999998},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51300000000000001,"15min":0.45000000000000001},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.76700000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.59399999999999997},"min":{"1min":0.52800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.88500000000000001}]},{"osd":2,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.71099999999999997,"15min":0.65900000000000003},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.069,"5min":1.288,"15min":1.288},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.98399999999999999}]},{"osd":4,"last update":"Wed Sep 7 19:43:13 2022","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.68200000000000005,"15min":0.63200000000000001},"min":{"1min":0.56499999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70899999999999996,"15min":0.65100000000000002},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2090000000000001}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.68600000000000005},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94499999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71299999999999997,"15min":0.68200000000000005},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.97499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Wed Sep 7 19:43:13 2022","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.71599999999999997,"15min":0.68000000000000005},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.66600000000000004,"15min":0.63},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.91800000000000004}]},{"osd":7,"last update":"Wed Sep 7 19:42:36 2022","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.76600000000000001,"15min":0.73499999999999999},"min":{"1min":0.67500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0529999999999999,"5min":1.173,"15min":1.173},"last":0.997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.61599999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.97499999999999998,"5min":1.075,"15min":1.075},"last":1.107}]},{"osd":8,"last update":"Wed Sep 7 19:42:01 2022","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.879}]},{"osd":9,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.91800000000000004,"15min":0.92300000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.1819999999999999,"5min":1.204,"15min":1.204},"last":1.25},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.089,"5min":1.143,"15min":1.143},"last":0.95499999999999996}]},{"osd":10,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.008},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.95099999999999996,"15min":0.96199999999999997},"min":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1479999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.03}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.069},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.173}]}]},{"osd":4,"up_from":33,"seq":141733920833,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6556,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738596,"statfs":{"total":95995035648,"available":95988322304,"internally_reserved":0,"allocated":1003520,"data_stored":499263,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:16 2022","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53800000000000003},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.192,"15min":0.192},"max":{"1min":0.56000000000000005,"5min":0.628,"15min":0.628},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.36599999999999999},"min":{"1min":0.35199999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.56999999999999995,"5min":0.753,"15min":0.753},"last":0.437}]},{"osd":2,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.52700000000000002},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":0.74399999999999999,"5min":0.755,"15min":0.755},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.65300000000000002,"15min":0.56899999999999995},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.1240000000000001,"5min":0.69999999999999996,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.5990000000000002,"5min":6.5990000000000002,"15min":6.5990000000000002},"last":0.623}]},{"osd":5,"last update":"Wed Sep 7 19:42:41 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56699999999999995,"15min":0.53400000000000003},"min":{"1min":0.5,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.70299999999999996,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.436,"15min":0.436},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Sep 7 19:42:41 2022","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.505},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.60999999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:43:03 2022","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66800000000000004,"15min":0.63900000000000001},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88300000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68899999999999995}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.879,"5min":0.999,"15min":0.999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89900000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67300000000000004}]},{"osd":10,"last update":"Wed Sep 7 19:42:56 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86099999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.70599999999999996}]},{"osd":11,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72099999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757310,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6684,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738468,"statfs":{"total":95995035648,"available":95988191232,"internally_reserved":0,"allocated":1069056,"data_stored":1090447,"data_compressed":53343,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70799999999999996,"5min":0.751,"15min":0.751},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67300000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.621},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.754,"15min":0.754},"last":0.66100000000000003}]},{"osd":2,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.30499999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.54300000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.501,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72799999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67600000000000005}]},{"osd":6,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.67500000000000004,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.218,"5min":5.218,"15min":5.218},"last":0.86399999999999999}]},{"osd":7,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.81999999999999995}]},{"osd":8,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83699999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.84599999999999997}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.91000000000000003}]},{"osd":10,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.87},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-07T19:43:30.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph pg dump --format=json 2022-09-07T19:43:30.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:30 smithi080 ceph-mon[90124]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:43:30.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:30 smithi155 ceph-mon[97606]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:43:30.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:30 smithi154 ceph-mon[96967]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:43:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:31.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:31 smithi155 ceph-mon[97606]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:43:31.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:31 smithi080 ceph-mon[90124]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:43:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:31 smithi154 ceph-mon[96967]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:43:32.430 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 -- 172.21.15.80:0/2693980192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 msgr2=0x7fb398104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:32.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 --2- 172.21.15.80:0/2693980192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 0x7fb398104cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009840 tx=0x7fb38c009b50 comp rx=0 tx=0).stop 2022-09-07T19:43:32.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 -- 172.21.15.80:0/2693980192 shutdown_connections 2022-09-07T19:43:32.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 --2- 172.21.15.80:0/2693980192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3981002d0 0x7fb3981006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 --2- 172.21.15.80:0/2693980192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981053d0 0x7fb39810cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 --2- 172.21.15.80:0/2693980192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 0x7fb398104cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 -- 172.21.15.80:0/2693980192 >> 172.21.15.80:0/2693980192 conn(0x7fb3980fbbf0 msgr2=0x7fb3980fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:32.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 -- 172.21.15.80:0/2693980192 shutdown_connections 2022-09-07T19:43:32.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.431+0000 7fb39e769700 1 -- 172.21.15.80:0/2693980192 wait complete. 2022-09-07T19:43:32.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.433+0000 7fb39e769700 1 Processor -- start 2022-09-07T19:43:32.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.433+0000 7fb39e769700 1 -- start start 2022-09-07T19:43:32.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.433+0000 7fb39e769700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 0x7fb398195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:32.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.433+0000 7fb39e769700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 0x7fb3981963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:32.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.433+0000 7fb39e769700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3981053d0 0x7fb39819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:32.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb39e769700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39819aec0 con 0x7fb3981053d0 2022-09-07T19:43:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb39e769700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39819b030 con 0x7fb398100c70 2022-09-07T19:43:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb39e769700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39819b1f0 con 0x7fb3981002d0 2022-09-07T19:43:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 0x7fb398195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 0x7fb398195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:51598/0 (socket says 172.21.15.80:51598) 2022-09-07T19:43:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 -- 172.21.15.80:0/1008051905 learned_addr learned my addr 172.21.15.80:0/1008051905 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb39cd06700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3981053d0 0x7fb39819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb3977fe700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 0x7fb3981963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 -- 172.21.15.80:0/1008051905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 msgr2=0x7fb3981963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 0x7fb3981963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 -- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3981053d0 msgr2=0x7fb39819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3981053d0 0x7fb39819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.434+0000 7fb397fff700 1 -- 172.21.15.80:0/1008051905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c009470 con 0x7fb3981002d0 2022-09-07T19:43:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.435+0000 7fb397fff700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 0x7fb398195e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb38800e740 tx=0x7fb38800ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.435+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388005220 con 0x7fb3981002d0 2022-09-07T19:43:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.435+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb388005380 con 0x7fb3981002d0 2022-09-07T19:43:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.435+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39819b4d0 con 0x7fb3981002d0 2022-09-07T19:43:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.435+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388004b70 con 0x7fb3981002d0 2022-09-07T19:43:32.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.435+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3981a2cc0 con 0x7fb3981002d0 2022-09-07T19:43:32.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.436+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb398064ea0 con 0x7fb3981002d0 2022-09-07T19:43:32.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.438+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fb38801e020 con 0x7fb3981002d0 2022-09-07T19:43:32.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.439+0000 7fb3957fa700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb380099050 0x7fb38009b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.439+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fb388014070 con 0x7fb3981002d0 2022-09-07T19:43:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.439+0000 7fb3977fe700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb380099050 0x7fb38009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.440+0000 7fb3977fe700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb380099050 0x7fb38009b500 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009810 tx=0x7fb38c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.443+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb38808ebe0 con 0x7fb3981002d0 2022-09-07T19:43:32.649 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.650+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3980fce40 con 0x7fb380099050 2022-09-07T19:43:32.662 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.662+0000 7fb3957fa700 1 -- 172.21.15.80:0/1008051905 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426828 (secure 0 0 0) 0x7fb3980fce40 con 0x7fb380099050 2022-09-07T19:43:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:32.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb380099050 msgr2=0x7fb38009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:32.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb380099050 0x7fb38009b500 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009810 tx=0x7fb38c000bc0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.676 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 msgr2=0x7fb398195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:32.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 0x7fb398195e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb38800e740 tx=0x7fb38800ea50 comp rx=0 tx=0).stop 2022-09-07T19:43:32.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 shutdown_connections 2022-09-07T19:43:32.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3981053d0 0x7fb39819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb380099050 0x7fb38009b500 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981002d0 0x7fb398195e90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 --2- 172.21.15.80:0/1008051905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb398100c70 0x7fb3981963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:32.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 >> 172.21.15.80:0/1008051905 conn(0x7fb3980fbbf0 msgr2=0x7fb3980fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:32.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 shutdown_connections 2022-09-07T19:43:32.678 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:32.670+0000 7fb39e769700 1 -- 172.21.15.80:0/1008051905 wait complete. 2022-09-07T19:43:32.679 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2022-09-07T19:43:33.163 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2022-09-07T19:43:31.953724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655731,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":474,"num_read_kb":358,"num_write":341,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80656,"kb_used_data":12144,"kb_used_omap":0,"kb_used_meta":68416,"kb_avail":1124861168,"statfs":{"total":1151940427776,"available":1151857836032,"internally_reserved":0,"allocated":12435456,"data_stored":7928713,"data_compressed":318348,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":0,"internal_metadata":70057984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529840+0000","last_change":"2022-09-07T19:42:06.951015+0000","last_active":"2022-09-07T19:42:42.529840+0000","last_peered":"2022-09-07T19:42:42.529840+0000","last_clean":"2022-09-07T19:42:42.529840+0000","last_became_active":"2022-09-07T19:42:06.950768+0000","last_became_peered":"2022-09-07T19:42:06.950768+0000","last_unstale":"2022-09-07T19:42:42.529840+0000","last_undegraded":"2022-09-07T19:42:42.529840+0000","last_fullsized":"2022-09-07T19:42:42.529840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:35:45.040811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534037+0000","last_change":"2022-09-07T19:42:06.956370+0000","last_active":"2022-09-07T19:42:42.534037+0000","last_peered":"2022-09-07T19:42:42.534037+0000","last_clean":"2022-09-07T19:42:42.534037+0000","last_became_active":"2022-09-07T19:42:06.955072+0000","last_became_peered":"2022-09-07T19:42:06.955072+0000","last_unstale":"2022-09-07T19:42:42.534037+0000","last_undegraded":"2022-09-07T19:42:42.534037+0000","last_fullsized":"2022-09-07T19:42:42.534037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:01:51.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533766+0000","last_change":"2022-09-07T19:42:06.957647+0000","last_active":"2022-09-07T19:42:42.533766+0000","last_peered":"2022-09-07T19:42:42.533766+0000","last_clean":"2022-09-07T19:42:42.533766+0000","last_became_active":"2022-09-07T19:42:06.956731+0000","last_became_peered":"2022-09-07T19:42:06.956731+0000","last_unstale":"2022-09-07T19:42:42.533766+0000","last_undegraded":"2022-09-07T19:42:42.533766+0000","last_fullsized":"2022-09-07T19:42:42.533766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:13.700278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.534489+0000","last_change":"2022-09-07T19:42:43.533520+0000","last_active":"2022-09-07T19:42:43.534489+0000","last_peered":"2022-09-07T19:42:43.534489+0000","last_clean":"2022-09-07T19:42:43.534489+0000","last_became_active":"2022-09-07T19:42:43.533161+0000","last_became_peered":"2022-09-07T19:42:43.533161+0000","last_unstale":"2022-09-07T19:42:43.534489+0000","last_undegraded":"2022-09-07T19:42:43.534489+0000","last_fullsized":"2022-09-07T19:42:43.534489+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:57:49.408631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527481+0000","last_change":"2022-09-07T19:42:06.938599+0000","last_active":"2022-09-07T19:42:42.527481+0000","last_peered":"2022-09-07T19:42:42.527481+0000","last_clean":"2022-09-07T19:42:42.527481+0000","last_became_active":"2022-09-07T19:42:06.938280+0000","last_became_peered":"2022-09-07T19:42:06.938280+0000","last_unstale":"2022-09-07T19:42:42.527481+0000","last_undegraded":"2022-09-07T19:42:42.527481+0000","last_fullsized":"2022-09-07T19:42:42.527481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:41:40.529183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533693+0000","last_change":"2022-09-07T19:42:06.939120+0000","last_active":"2022-09-07T19:42:42.533693+0000","last_peered":"2022-09-07T19:42:42.533693+0000","last_clean":"2022-09-07T19:42:42.533693+0000","last_became_active":"2022-09-07T19:42:06.938805+0000","last_became_peered":"2022-09-07T19:42:06.938805+0000","last_unstale":"2022-09-07T19:42:42.533693+0000","last_undegraded":"2022-09-07T19:42:42.533693+0000","last_fullsized":"2022-09-07T19:42:42.533693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:26:17.772579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532747+0000","last_change":"2022-09-07T19:42:06.935222+0000","last_active":"2022-09-07T19:42:42.532747+0000","last_peered":"2022-09-07T19:42:42.532747+0000","last_clean":"2022-09-07T19:42:42.532747+0000","last_became_active":"2022-09-07T19:42:06.934863+0000","last_became_peered":"2022-09-07T19:42:06.934863+0000","last_unstale":"2022-09-07T19:42:42.532747+0000","last_undegraded":"2022-09-07T19:42:42.532747+0000","last_fullsized":"2022-09-07T19:42:42.532747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:10:12.989147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529690+0000","last_change":"2022-09-07T19:42:06.940593+0000","last_active":"2022-09-07T19:42:42.529690+0000","last_peered":"2022-09-07T19:42:42.529690+0000","last_clean":"2022-09-07T19:42:42.529690+0000","last_became_active":"2022-09-07T19:42:06.940209+0000","last_became_peered":"2022-09-07T19:42:06.940209+0000","last_unstale":"2022-09-07T19:42:42.529690+0000","last_undegraded":"2022-09-07T19:42:42.529690+0000","last_fullsized":"2022-09-07T19:42:42.529690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:45:25.341085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528135+0000","last_change":"2022-09-07T19:42:06.935215+0000","last_active":"2022-09-07T19:42:42.528135+0000","last_peered":"2022-09-07T19:42:42.528135+0000","last_clean":"2022-09-07T19:42:42.528135+0000","last_became_active":"2022-09-07T19:42:06.934974+0000","last_became_peered":"2022-09-07T19:42:06.934974+0000","last_unstale":"2022-09-07T19:42:42.528135+0000","last_undegraded":"2022-09-07T19:42:42.528135+0000","last_fullsized":"2022-09-07T19:42:42.528135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:01.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534249+0000","last_change":"2022-09-07T19:42:06.939935+0000","last_active":"2022-09-07T19:42:42.534249+0000","last_peered":"2022-09-07T19:42:42.534249+0000","last_clean":"2022-09-07T19:42:42.534249+0000","last_became_active":"2022-09-07T19:42:06.939160+0000","last_became_peered":"2022-09-07T19:42:06.939160+0000","last_unstale":"2022-09-07T19:42:42.534249+0000","last_undegraded":"2022-09-07T19:42:42.534249+0000","last_fullsized":"2022-09-07T19:42:42.534249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:32.324752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532718+0000","last_change":"2022-09-07T19:42:06.948084+0000","last_active":"2022-09-07T19:42:42.532718+0000","last_peered":"2022-09-07T19:42:42.532718+0000","last_clean":"2022-09-07T19:42:42.532718+0000","last_became_active":"2022-09-07T19:42:06.947552+0000","last_became_peered":"2022-09-07T19:42:06.947552+0000","last_unstale":"2022-09-07T19:42:42.532718+0000","last_undegraded":"2022-09-07T19:42:42.532718+0000","last_fullsized":"2022-09-07T19:42:42.532718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:51:20.247983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530144+0000","last_change":"2022-09-07T19:42:06.947021+0000","last_active":"2022-09-07T19:42:42.530144+0000","last_peered":"2022-09-07T19:42:42.530144+0000","last_clean":"2022-09-07T19:42:42.530144+0000","last_became_active":"2022-09-07T19:42:06.946507+0000","last_became_peered":"2022-09-07T19:42:06.946507+0000","last_unstale":"2022-09-07T19:42:42.530144+0000","last_undegraded":"2022-09-07T19:42:42.530144+0000","last_fullsized":"2022-09-07T19:42:42.530144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:25:15.358991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529898+0000","last_change":"2022-09-07T19:42:06.940573+0000","last_active":"2022-09-07T19:42:42.529898+0000","last_peered":"2022-09-07T19:42:42.529898+0000","last_clean":"2022-09-07T19:42:42.529898+0000","last_became_active":"2022-09-07T19:42:06.940298+0000","last_became_peered":"2022-09-07T19:42:06.940298+0000","last_unstale":"2022-09-07T19:42:42.529898+0000","last_undegraded":"2022-09-07T19:42:42.529898+0000","last_fullsized":"2022-09-07T19:42:42.529898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:41.459964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533110+0000","last_change":"2022-09-07T19:42:06.953348+0000","last_active":"2022-09-07T19:42:42.533110+0000","last_peered":"2022-09-07T19:42:42.533110+0000","last_clean":"2022-09-07T19:42:42.533110+0000","last_became_active":"2022-09-07T19:42:06.952776+0000","last_became_peered":"2022-09-07T19:42:06.952776+0000","last_unstale":"2022-09-07T19:42:42.533110+0000","last_undegraded":"2022-09-07T19:42:42.533110+0000","last_fullsized":"2022-09-07T19:42:42.533110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:58:29.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.531647+0000","last_change":"2022-09-07T19:42:43.531647+0000","last_active":"2022-09-07T19:42:43.531647+0000","last_peered":"2022-09-07T19:42:43.531647+0000","last_clean":"2022-09-07T19:42:43.531647+0000","last_became_active":"2022-09-07T19:42:43.531231+0000","last_became_peered":"2022-09-07T19:42:43.531231+0000","last_unstale":"2022-09-07T19:42:43.531647+0000","last_undegraded":"2022-09-07T19:42:43.531647+0000","last_fullsized":"2022-09-07T19:42:43.531647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:22:09.221685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.526912+0000","last_change":"2022-09-07T19:42:06.954614+0000","last_active":"2022-09-07T19:42:42.526912+0000","last_peered":"2022-09-07T19:42:42.526912+0000","last_clean":"2022-09-07T19:42:42.526912+0000","last_became_active":"2022-09-07T19:42:06.954312+0000","last_became_peered":"2022-09-07T19:42:06.954312+0000","last_unstale":"2022-09-07T19:42:42.526912+0000","last_undegraded":"2022-09-07T19:42:42.526912+0000","last_fullsized":"2022-09-07T19:42:42.526912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:39:14.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529750+0000","last_change":"2022-09-07T19:42:06.950491+0000","last_active":"2022-09-07T19:42:42.529750+0000","last_peered":"2022-09-07T19:42:42.529750+0000","last_clean":"2022-09-07T19:42:42.529750+0000","last_became_active":"2022-09-07T19:42:06.950164+0000","last_became_peered":"2022-09-07T19:42:06.950164+0000","last_unstale":"2022-09-07T19:42:42.529750+0000","last_undegraded":"2022-09-07T19:42:42.529750+0000","last_fullsized":"2022-09-07T19:42:42.529750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:25.631788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525241+0000","last_change":"2022-09-07T19:42:06.933766+0000","last_active":"2022-09-07T19:42:42.525241+0000","last_peered":"2022-09-07T19:42:42.525241+0000","last_clean":"2022-09-07T19:42:42.525241+0000","last_became_active":"2022-09-07T19:42:06.933448+0000","last_became_peered":"2022-09-07T19:42:06.933448+0000","last_unstale":"2022-09-07T19:42:42.525241+0000","last_undegraded":"2022-09-07T19:42:42.525241+0000","last_fullsized":"2022-09-07T19:42:42.525241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:10.478403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533372+0000","last_change":"2022-09-07T19:42:06.937141+0000","last_active":"2022-09-07T19:42:42.533372+0000","last_peered":"2022-09-07T19:42:42.533372+0000","last_clean":"2022-09-07T19:42:42.533372+0000","last_became_active":"2022-09-07T19:42:06.936841+0000","last_became_peered":"2022-09-07T19:42:06.936841+0000","last_unstale":"2022-09-07T19:42:42.533372+0000","last_undegraded":"2022-09-07T19:42:42.533372+0000","last_fullsized":"2022-09-07T19:42:42.533372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:57:43.397083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531983+0000","last_change":"2022-09-07T19:42:11.413877+0000","last_active":"2022-09-07T19:42:42.531983+0000","last_peered":"2022-09-07T19:42:42.531983+0000","last_clean":"2022-09-07T19:42:42.531983+0000","last_became_active":"2022-09-07T19:42:11.413419+0000","last_became_peered":"2022-09-07T19:42:11.413419+0000","last_unstale":"2022-09-07T19:42:42.531983+0000","last_undegraded":"2022-09-07T19:42:42.531983+0000","last_fullsized":"2022-09-07T19:42:42.531983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:40:06.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525488+0000","last_change":"2022-09-07T19:42:06.360233+0000","last_active":"2022-09-07T19:42:42.525488+0000","last_peered":"2022-09-07T19:42:42.525488+0000","last_clean":"2022-09-07T19:42:42.525488+0000","last_became_active":"2022-09-07T19:42:06.359937+0000","last_became_peered":"2022-09-07T19:42:06.359937+0000","last_unstale":"2022-09-07T19:42:42.525488+0000","last_undegraded":"2022-09-07T19:42:42.525488+0000","last_fullsized":"2022-09-07T19:42:42.525488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:02.665896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.534897+0000","last_change":"2022-09-07T19:42:43.534412+0000","last_active":"2022-09-07T19:42:43.534897+0000","last_peered":"2022-09-07T19:42:43.534897+0000","last_clean":"2022-09-07T19:42:43.534897+0000","last_became_active":"2022-09-07T19:42:43.534013+0000","last_became_peered":"2022-09-07T19:42:43.534013+0000","last_unstale":"2022-09-07T19:42:43.534897+0000","last_undegraded":"2022-09-07T19:42:43.534897+0000","last_fullsized":"2022-09-07T19:42:43.534897+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:42:27.917594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528717+0000","last_change":"2022-09-07T19:42:11.412836+0000","last_active":"2022-09-07T19:42:42.528717+0000","last_peered":"2022-09-07T19:42:42.528717+0000","last_clean":"2022-09-07T19:42:42.528717+0000","last_became_active":"2022-09-07T19:42:11.412407+0000","last_became_peered":"2022-09-07T19:42:11.412407+0000","last_unstale":"2022-09-07T19:42:42.528717+0000","last_undegraded":"2022-09-07T19:42:42.528717+0000","last_fullsized":"2022-09-07T19:42:42.528717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:40:35.056313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531286+0000","last_change":"2022-09-07T19:42:06.372498+0000","last_active":"2022-09-07T19:42:42.531286+0000","last_peered":"2022-09-07T19:42:42.531286+0000","last_clean":"2022-09-07T19:42:42.531286+0000","last_became_active":"2022-09-07T19:42:06.372183+0000","last_became_peered":"2022-09-07T19:42:06.372183+0000","last_unstale":"2022-09-07T19:42:42.531286+0000","last_undegraded":"2022-09-07T19:42:42.531286+0000","last_fullsized":"2022-09-07T19:42:42.531286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:00:56.451463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533681+0000","last_change":"2022-09-07T19:42:06.953146+0000","last_active":"2022-09-07T19:42:42.533681+0000","last_peered":"2022-09-07T19:42:42.533681+0000","last_clean":"2022-09-07T19:42:42.533681+0000","last_became_active":"2022-09-07T19:42:06.952824+0000","last_became_peered":"2022-09-07T19:42:06.952824+0000","last_unstale":"2022-09-07T19:42:42.533681+0000","last_undegraded":"2022-09-07T19:42:42.533681+0000","last_fullsized":"2022-09-07T19:42:42.533681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:59:59.989327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529215+0000","last_change":"2022-09-07T19:42:11.411807+0000","last_active":"2022-09-07T19:42:42.529215+0000","last_peered":"2022-09-07T19:42:42.529215+0000","last_clean":"2022-09-07T19:42:42.529215+0000","last_became_active":"2022-09-07T19:42:11.411392+0000","last_became_peered":"2022-09-07T19:42:11.411392+0000","last_unstale":"2022-09-07T19:42:42.529215+0000","last_undegraded":"2022-09-07T19:42:42.529215+0000","last_fullsized":"2022-09-07T19:42:42.529215+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:37:00.477243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530296+0000","last_change":"2022-09-07T19:42:06.359561+0000","last_active":"2022-09-07T19:42:42.530296+0000","last_peered":"2022-09-07T19:42:42.530296+0000","last_clean":"2022-09-07T19:42:42.530296+0000","last_became_active":"2022-09-07T19:42:06.359200+0000","last_became_peered":"2022-09-07T19:42:06.359200+0000","last_unstale":"2022-09-07T19:42:42.530296+0000","last_undegraded":"2022-09-07T19:42:42.530296+0000","last_fullsized":"2022-09-07T19:42:42.530296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:16:13.894233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527508+0000","last_change":"2022-09-07T19:42:06.943682+0000","last_active":"2022-09-07T19:42:42.527508+0000","last_peered":"2022-09-07T19:42:42.527508+0000","last_clean":"2022-09-07T19:42:42.527508+0000","last_became_active":"2022-09-07T19:42:06.943323+0000","last_became_peered":"2022-09-07T19:42:06.943323+0000","last_unstale":"2022-09-07T19:42:42.527508+0000","last_undegraded":"2022-09-07T19:42:42.527508+0000","last_fullsized":"2022-09-07T19:42:42.527508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:00:26.030438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528873+0000","last_change":"2022-09-07T19:42:11.403222+0000","last_active":"2022-09-07T19:42:42.528873+0000","last_peered":"2022-09-07T19:42:42.528873+0000","last_clean":"2022-09-07T19:42:42.528873+0000","last_became_active":"2022-09-07T19:42:11.402740+0000","last_became_peered":"2022-09-07T19:42:11.402740+0000","last_unstale":"2022-09-07T19:42:42.528873+0000","last_undegraded":"2022-09-07T19:42:42.528873+0000","last_fullsized":"2022-09-07T19:42:42.528873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:55:07.470945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529918+0000","last_change":"2022-09-07T19:42:06.353930+0000","last_active":"2022-09-07T19:42:42.529918+0000","last_peered":"2022-09-07T19:42:42.529918+0000","last_clean":"2022-09-07T19:42:42.529918+0000","last_became_active":"2022-09-07T19:42:06.353603+0000","last_became_peered":"2022-09-07T19:42:06.353603+0000","last_unstale":"2022-09-07T19:42:42.529918+0000","last_undegraded":"2022-09-07T19:42:42.529918+0000","last_fullsized":"2022-09-07T19:42:42.529918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:50.562667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525802+0000","last_change":"2022-09-07T19:42:06.948086+0000","last_active":"2022-09-07T19:42:42.525802+0000","last_peered":"2022-09-07T19:42:42.525802+0000","last_clean":"2022-09-07T19:42:42.525802+0000","last_became_active":"2022-09-07T19:42:06.947805+0000","last_became_peered":"2022-09-07T19:42:06.947805+0000","last_unstale":"2022-09-07T19:42:42.525802+0000","last_undegraded":"2022-09-07T19:42:42.525802+0000","last_fullsized":"2022-09-07T19:42:42.525802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:36:53.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533230+0000","last_change":"2022-09-07T19:42:11.401915+0000","last_active":"2022-09-07T19:42:42.533230+0000","last_peered":"2022-09-07T19:42:42.533230+0000","last_clean":"2022-09-07T19:42:42.533230+0000","last_became_active":"2022-09-07T19:42:11.401513+0000","last_became_peered":"2022-09-07T19:42:11.401513+0000","last_unstale":"2022-09-07T19:42:42.533230+0000","last_undegraded":"2022-09-07T19:42:42.533230+0000","last_fullsized":"2022-09-07T19:42:42.533230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:42:34.774516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:27.605017+0000","last_change":"2022-09-07T19:42:06.361590+0000","last_active":"2022-09-07T19:43:27.605017+0000","last_peered":"2022-09-07T19:43:27.605017+0000","last_clean":"2022-09-07T19:43:27.605017+0000","last_became_active":"2022-09-07T19:42:06.361278+0000","last_became_peered":"2022-09-07T19:42:06.361278+0000","last_unstale":"2022-09-07T19:43:27.605017+0000","last_undegraded":"2022-09-07T19:43:27.605017+0000","last_fullsized":"2022-09-07T19:43:27.605017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:45:30.487710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.544375+0000","last_change":"2022-09-07T19:42:43.544375+0000","last_active":"2022-09-07T19:42:43.544375+0000","last_peered":"2022-09-07T19:42:43.544375+0000","last_clean":"2022-09-07T19:42:43.544375+0000","last_became_active":"2022-09-07T19:42:43.543938+0000","last_became_peered":"2022-09-07T19:42:43.543938+0000","last_unstale":"2022-09-07T19:42:43.544375+0000","last_undegraded":"2022-09-07T19:42:43.544375+0000","last_fullsized":"2022-09-07T19:42:43.544375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:02:40.961308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533518+0000","last_change":"2022-09-07T19:42:11.414174+0000","last_active":"2022-09-07T19:42:42.533518+0000","last_peered":"2022-09-07T19:42:42.533518+0000","last_clean":"2022-09-07T19:42:42.533518+0000","last_became_active":"2022-09-07T19:42:11.413798+0000","last_became_peered":"2022-09-07T19:42:11.413798+0000","last_unstale":"2022-09-07T19:42:42.533518+0000","last_undegraded":"2022-09-07T19:42:42.533518+0000","last_fullsized":"2022-09-07T19:42:42.533518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:17.386698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533584+0000","last_change":"2022-09-07T19:42:06.375593+0000","last_active":"2022-09-07T19:42:42.533584+0000","last_peered":"2022-09-07T19:42:42.533584+0000","last_clean":"2022-09-07T19:42:42.533584+0000","last_became_active":"2022-09-07T19:42:06.375396+0000","last_became_peered":"2022-09-07T19:42:06.375396+0000","last_unstale":"2022-09-07T19:42:42.533584+0000","last_undegraded":"2022-09-07T19:42:42.533584+0000","last_fullsized":"2022-09-07T19:42:42.533584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:00:10.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524797+0000","last_change":"2022-09-07T19:42:06.936369+0000","last_active":"2022-09-07T19:42:42.524797+0000","last_peered":"2022-09-07T19:42:42.524797+0000","last_clean":"2022-09-07T19:42:42.524797+0000","last_became_active":"2022-09-07T19:42:06.936083+0000","last_became_peered":"2022-09-07T19:42:06.936083+0000","last_unstale":"2022-09-07T19:42:42.524797+0000","last_undegraded":"2022-09-07T19:42:42.524797+0000","last_fullsized":"2022-09-07T19:42:42.524797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:50:17.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529658+0000","last_change":"2022-09-07T19:42:11.399043+0000","last_active":"2022-09-07T19:42:42.529658+0000","last_peered":"2022-09-07T19:42:42.529658+0000","last_clean":"2022-09-07T19:42:42.529658+0000","last_became_active":"2022-09-07T19:42:11.398634+0000","last_became_peered":"2022-09-07T19:42:11.398634+0000","last_unstale":"2022-09-07T19:42:42.529658+0000","last_undegraded":"2022-09-07T19:42:42.529658+0000","last_fullsized":"2022-09-07T19:42:42.529658+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:30:06.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529157+0000","last_change":"2022-09-07T19:42:06.365700+0000","last_active":"2022-09-07T19:42:42.529157+0000","last_peered":"2022-09-07T19:42:42.529157+0000","last_clean":"2022-09-07T19:42:42.529157+0000","last_became_active":"2022-09-07T19:42:06.365338+0000","last_became_peered":"2022-09-07T19:42:06.365338+0000","last_unstale":"2022-09-07T19:42:42.529157+0000","last_undegraded":"2022-09-07T19:42:42.529157+0000","last_fullsized":"2022-09-07T19:42:42.529157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:01:18.825477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529614+0000","last_change":"2022-09-07T19:42:06.938275+0000","last_active":"2022-09-07T19:42:42.529614+0000","last_peered":"2022-09-07T19:42:42.529614+0000","last_clean":"2022-09-07T19:42:42.529614+0000","last_became_active":"2022-09-07T19:42:06.937893+0000","last_became_peered":"2022-09-07T19:42:06.937893+0000","last_unstale":"2022-09-07T19:42:42.529614+0000","last_undegraded":"2022-09-07T19:42:42.529614+0000","last_fullsized":"2022-09-07T19:42:42.529614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:42:22.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533918+0000","last_change":"2022-09-07T19:42:11.406329+0000","last_active":"2022-09-07T19:42:42.533918+0000","last_peered":"2022-09-07T19:42:42.533918+0000","last_clean":"2022-09-07T19:42:42.533918+0000","last_became_active":"2022-09-07T19:42:11.405954+0000","last_became_peered":"2022-09-07T19:42:11.405954+0000","last_unstale":"2022-09-07T19:42:42.533918+0000","last_undegraded":"2022-09-07T19:42:42.533918+0000","last_fullsized":"2022-09-07T19:42:42.533918+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:15.735179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524271+0000","last_change":"2022-09-07T19:42:06.360190+0000","last_active":"2022-09-07T19:42:42.524271+0000","last_peered":"2022-09-07T19:42:42.524271+0000","last_clean":"2022-09-07T19:42:42.524271+0000","last_became_active":"2022-09-07T19:42:06.359893+0000","last_became_peered":"2022-09-07T19:42:06.359893+0000","last_unstale":"2022-09-07T19:42:42.524271+0000","last_undegraded":"2022-09-07T19:42:42.524271+0000","last_fullsized":"2022-09-07T19:42:42.524271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:09:54.310816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524779+0000","last_change":"2022-09-07T19:42:06.931094+0000","last_active":"2022-09-07T19:42:42.524779+0000","last_peered":"2022-09-07T19:42:42.524779+0000","last_clean":"2022-09-07T19:42:42.524779+0000","last_became_active":"2022-09-07T19:42:06.930781+0000","last_became_peered":"2022-09-07T19:42:06.930781+0000","last_unstale":"2022-09-07T19:42:42.524779+0000","last_undegraded":"2022-09-07T19:42:42.524779+0000","last_fullsized":"2022-09-07T19:42:42.524779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:31:17.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529916+0000","last_change":"2022-09-07T19:42:11.402900+0000","last_active":"2022-09-07T19:42:42.529916+0000","last_peered":"2022-09-07T19:42:42.529916+0000","last_clean":"2022-09-07T19:42:42.529916+0000","last_became_active":"2022-09-07T19:42:11.402553+0000","last_became_peered":"2022-09-07T19:42:11.402553+0000","last_unstale":"2022-09-07T19:42:42.529916+0000","last_undegraded":"2022-09-07T19:42:42.529916+0000","last_fullsized":"2022-09-07T19:42:42.529916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:19:01.667064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:27.604455+0000","last_change":"2022-09-07T19:42:06.363330+0000","last_active":"2022-09-07T19:43:27.604455+0000","last_peered":"2022-09-07T19:43:27.604455+0000","last_clean":"2022-09-07T19:43:27.604455+0000","last_became_active":"2022-09-07T19:42:06.363057+0000","last_became_peered":"2022-09-07T19:42:06.363057+0000","last_unstale":"2022-09-07T19:43:27.604455+0000","last_undegraded":"2022-09-07T19:43:27.604455+0000","last_fullsized":"2022-09-07T19:43:27.604455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:36.386640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528046+0000","last_change":"2022-09-07T19:42:06.943678+0000","last_active":"2022-09-07T19:42:42.528046+0000","last_peered":"2022-09-07T19:42:42.528046+0000","last_clean":"2022-09-07T19:42:42.528046+0000","last_became_active":"2022-09-07T19:42:06.942341+0000","last_became_peered":"2022-09-07T19:42:06.942341+0000","last_unstale":"2022-09-07T19:42:42.528046+0000","last_undegraded":"2022-09-07T19:42:42.528046+0000","last_fullsized":"2022-09-07T19:42:42.528046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:30:24.776240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524713+0000","last_change":"2022-09-07T19:42:11.410225+0000","last_active":"2022-09-07T19:42:42.524713+0000","last_peered":"2022-09-07T19:42:42.524713+0000","last_clean":"2022-09-07T19:42:42.524713+0000","last_became_active":"2022-09-07T19:42:11.409826+0000","last_became_peered":"2022-09-07T19:42:11.409826+0000","last_unstale":"2022-09-07T19:42:42.524713+0000","last_undegraded":"2022-09-07T19:42:42.524713+0000","last_fullsized":"2022-09-07T19:42:42.524713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:01.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533027+0000","last_change":"2022-09-07T19:42:06.357384+0000","last_active":"2022-09-07T19:42:42.533027+0000","last_peered":"2022-09-07T19:42:42.533027+0000","last_clean":"2022-09-07T19:42:42.533027+0000","last_became_active":"2022-09-07T19:42:06.357042+0000","last_became_peered":"2022-09-07T19:42:06.357042+0000","last_unstale":"2022-09-07T19:42:42.533027+0000","last_undegraded":"2022-09-07T19:42:42.533027+0000","last_fullsized":"2022-09-07T19:42:42.533027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:36:30.278258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533786+0000","last_change":"2022-09-07T19:42:06.952991+0000","last_active":"2022-09-07T19:42:42.533786+0000","last_peered":"2022-09-07T19:42:42.533786+0000","last_clean":"2022-09-07T19:42:42.533786+0000","last_became_active":"2022-09-07T19:42:06.952650+0000","last_became_peered":"2022-09-07T19:42:06.952650+0000","last_unstale":"2022-09-07T19:42:42.533786+0000","last_undegraded":"2022-09-07T19:42:42.533786+0000","last_fullsized":"2022-09-07T19:42:42.533786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:15:44.166803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529493+0000","last_change":"2022-09-07T19:42:11.412153+0000","last_active":"2022-09-07T19:42:42.529493+0000","last_peered":"2022-09-07T19:42:42.529493+0000","last_clean":"2022-09-07T19:42:42.529493+0000","last_became_active":"2022-09-07T19:42:11.411371+0000","last_became_peered":"2022-09-07T19:42:11.411371+0000","last_unstale":"2022-09-07T19:42:42.529493+0000","last_undegraded":"2022-09-07T19:42:42.529493+0000","last_fullsized":"2022-09-07T19:42:42.529493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:34:31.765609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525031+0000","last_change":"2022-09-07T19:42:06.356763+0000","last_active":"2022-09-07T19:42:42.525031+0000","last_peered":"2022-09-07T19:42:42.525031+0000","last_clean":"2022-09-07T19:42:42.525031+0000","last_became_active":"2022-09-07T19:42:06.356155+0000","last_became_peered":"2022-09-07T19:42:06.356155+0000","last_unstale":"2022-09-07T19:42:42.525031+0000","last_undegraded":"2022-09-07T19:42:42.525031+0000","last_fullsized":"2022-09-07T19:42:42.525031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:06:07.941810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527544+0000","last_change":"2022-09-07T19:42:06.940746+0000","last_active":"2022-09-07T19:42:42.527544+0000","last_peered":"2022-09-07T19:42:42.527544+0000","last_clean":"2022-09-07T19:42:42.527544+0000","last_became_active":"2022-09-07T19:42:06.939798+0000","last_became_peered":"2022-09-07T19:42:06.939798+0000","last_unstale":"2022-09-07T19:42:42.527544+0000","last_undegraded":"2022-09-07T19:42:42.527544+0000","last_fullsized":"2022-09-07T19:42:42.527544+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:02:25.348841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524882+0000","last_change":"2022-09-07T19:42:11.393014+0000","last_active":"2022-09-07T19:42:42.524882+0000","last_peered":"2022-09-07T19:42:42.524882+0000","last_clean":"2022-09-07T19:42:42.524882+0000","last_became_active":"2022-09-07T19:42:11.392465+0000","last_became_peered":"2022-09-07T19:42:11.392465+0000","last_unstale":"2022-09-07T19:42:42.524882+0000","last_undegraded":"2022-09-07T19:42:42.524882+0000","last_fullsized":"2022-09-07T19:42:42.524882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:52:11.553583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:28.605944+0000","last_change":"2022-09-07T19:42:06.364454+0000","last_active":"2022-09-07T19:43:28.605944+0000","last_peered":"2022-09-07T19:43:28.605944+0000","last_clean":"2022-09-07T19:43:28.605944+0000","last_became_active":"2022-09-07T19:42:06.364112+0000","last_became_peered":"2022-09-07T19:42:06.364112+0000","last_unstale":"2022-09-07T19:43:28.605944+0000","last_undegraded":"2022-09-07T19:43:28.605944+0000","last_fullsized":"2022-09-07T19:43:28.605944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:04:50.190357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60865,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":115,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530044+0000","last_change":"2022-09-07T19:42:06.942860+0000","last_active":"2022-09-07T19:42:42.530044+0000","last_peered":"2022-09-07T19:42:42.530044+0000","last_clean":"2022-09-07T19:42:42.530044+0000","last_became_active":"2022-09-07T19:42:06.941587+0000","last_became_peered":"2022-09-07T19:42:06.941587+0000","last_unstale":"2022-09-07T19:42:42.530044+0000","last_undegraded":"2022-09-07T19:42:42.530044+0000","last_fullsized":"2022-09-07T19:42:42.530044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:41:45.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525662+0000","last_change":"2022-09-07T19:42:11.403579+0000","last_active":"2022-09-07T19:42:42.525662+0000","last_peered":"2022-09-07T19:42:42.525662+0000","last_clean":"2022-09-07T19:42:42.525662+0000","last_became_active":"2022-09-07T19:42:11.402923+0000","last_became_peered":"2022-09-07T19:42:11.402923+0000","last_unstale":"2022-09-07T19:42:42.525662+0000","last_undegraded":"2022-09-07T19:42:42.525662+0000","last_fullsized":"2022-09-07T19:42:42.525662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:39:47.178557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532972+0000","last_change":"2022-09-07T19:42:06.369220+0000","last_active":"2022-09-07T19:42:42.532972+0000","last_peered":"2022-09-07T19:42:42.532972+0000","last_clean":"2022-09-07T19:42:42.532972+0000","last_became_active":"2022-09-07T19:42:06.368957+0000","last_became_peered":"2022-09-07T19:42:06.368957+0000","last_unstale":"2022-09-07T19:42:42.532972+0000","last_undegraded":"2022-09-07T19:42:42.532972+0000","last_fullsized":"2022-09-07T19:42:42.532972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:13:27.882414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530386+0000","last_change":"2022-09-07T19:42:06.942818+0000","last_active":"2022-09-07T19:42:42.530386+0000","last_peered":"2022-09-07T19:42:42.530386+0000","last_clean":"2022-09-07T19:42:42.530386+0000","last_became_active":"2022-09-07T19:42:06.942536+0000","last_became_peered":"2022-09-07T19:42:06.942536+0000","last_unstale":"2022-09-07T19:42:42.530386+0000","last_undegraded":"2022-09-07T19:42:42.530386+0000","last_fullsized":"2022-09-07T19:42:42.530386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:41:05.892343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.543928+0000","last_change":"2022-09-07T19:42:43.543928+0000","last_active":"2022-09-07T19:42:43.543928+0000","last_peered":"2022-09-07T19:42:43.543928+0000","last_clean":"2022-09-07T19:42:43.543928+0000","last_became_active":"2022-09-07T19:42:43.543287+0000","last_became_peered":"2022-09-07T19:42:43.543287+0000","last_unstale":"2022-09-07T19:42:43.543928+0000","last_undegraded":"2022-09-07T19:42:43.543928+0000","last_fullsized":"2022-09-07T19:42:43.543928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:40:41.522472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524595+0000","last_change":"2022-09-07T19:42:06.372606+0000","last_active":"2022-09-07T19:42:42.524595+0000","last_peered":"2022-09-07T19:42:42.524595+0000","last_clean":"2022-09-07T19:42:42.524595+0000","last_became_active":"2022-09-07T19:42:06.372314+0000","last_became_peered":"2022-09-07T19:42:06.372314+0000","last_unstale":"2022-09-07T19:42:42.524595+0000","last_undegraded":"2022-09-07T19:42:42.524595+0000","last_fullsized":"2022-09-07T19:42:42.524595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:57:29.102343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532545+0000","last_change":"2022-09-07T19:42:06.945336+0000","last_active":"2022-09-07T19:42:42.532545+0000","last_peered":"2022-09-07T19:42:42.532545+0000","last_clean":"2022-09-07T19:42:42.532545+0000","last_became_active":"2022-09-07T19:42:06.945056+0000","last_became_peered":"2022-09-07T19:42:06.945056+0000","last_unstale":"2022-09-07T19:42:42.532545+0000","last_undegraded":"2022-09-07T19:42:42.532545+0000","last_fullsized":"2022-09-07T19:42:42.532545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:48:24.858246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525305+0000","last_change":"2022-09-07T19:42:11.404998+0000","last_active":"2022-09-07T19:42:42.525305+0000","last_peered":"2022-09-07T19:42:42.525305+0000","last_clean":"2022-09-07T19:42:42.525305+0000","last_became_active":"2022-09-07T19:42:11.404553+0000","last_became_peered":"2022-09-07T19:42:11.404553+0000","last_unstale":"2022-09-07T19:42:42.525305+0000","last_undegraded":"2022-09-07T19:42:42.525305+0000","last_fullsized":"2022-09-07T19:42:42.525305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:36:55.188346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:29.607951+0000","last_change":"2022-09-07T19:42:06.356368+0000","last_active":"2022-09-07T19:43:29.607951+0000","last_peered":"2022-09-07T19:43:29.607951+0000","last_clean":"2022-09-07T19:43:29.607951+0000","last_became_active":"2022-09-07T19:42:06.356036+0000","last_became_peered":"2022-09-07T19:42:06.356036+0000","last_unstale":"2022-09-07T19:43:29.607951+0000","last_undegraded":"2022-09-07T19:43:29.607951+0000","last_fullsized":"2022-09-07T19:43:29.607951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:37.882450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533293+0000","last_change":"2022-09-07T19:42:06.936825+0000","last_active":"2022-09-07T19:42:42.533293+0000","last_peered":"2022-09-07T19:42:42.533293+0000","last_clean":"2022-09-07T19:42:42.533293+0000","last_became_active":"2022-09-07T19:42:06.936512+0000","last_became_peered":"2022-09-07T19:42:06.936512+0000","last_unstale":"2022-09-07T19:42:42.533293+0000","last_undegraded":"2022-09-07T19:42:42.533293+0000","last_fullsized":"2022-09-07T19:42:42.533293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:35:55.141151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530284+0000","last_change":"2022-09-07T19:42:11.411115+0000","last_active":"2022-09-07T19:42:42.530284+0000","last_peered":"2022-09-07T19:42:42.530284+0000","last_clean":"2022-09-07T19:42:42.530284+0000","last_became_active":"2022-09-07T19:42:11.410742+0000","last_became_peered":"2022-09-07T19:42:11.410742+0000","last_unstale":"2022-09-07T19:42:42.530284+0000","last_undegraded":"2022-09-07T19:42:42.530284+0000","last_fullsized":"2022-09-07T19:42:42.530284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:11:06.320256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527933+0000","last_change":"2022-09-07T19:42:06.363366+0000","last_active":"2022-09-07T19:42:42.527933+0000","last_peered":"2022-09-07T19:42:42.527933+0000","last_clean":"2022-09-07T19:42:42.527933+0000","last_became_active":"2022-09-07T19:42:06.362993+0000","last_became_peered":"2022-09-07T19:42:06.362993+0000","last_unstale":"2022-09-07T19:42:42.527933+0000","last_undegraded":"2022-09-07T19:42:42.527933+0000","last_fullsized":"2022-09-07T19:42:42.527933+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:31:15.571050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524362+0000","last_change":"2022-09-07T19:42:06.948273+0000","last_active":"2022-09-07T19:42:42.524362+0000","last_peered":"2022-09-07T19:42:42.524362+0000","last_clean":"2022-09-07T19:42:42.524362+0000","last_became_active":"2022-09-07T19:42:06.947701+0000","last_became_peered":"2022-09-07T19:42:06.947701+0000","last_unstale":"2022-09-07T19:42:42.524362+0000","last_undegraded":"2022-09-07T19:42:42.524362+0000","last_fullsized":"2022-09-07T19:42:42.524362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:01:57.543316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524314+0000","last_change":"2022-09-07T19:42:11.403357+0000","last_active":"2022-09-07T19:42:42.524314+0000","last_peered":"2022-09-07T19:42:42.524314+0000","last_clean":"2022-09-07T19:42:42.524314+0000","last_became_active":"2022-09-07T19:42:11.402903+0000","last_became_peered":"2022-09-07T19:42:11.402903+0000","last_unstale":"2022-09-07T19:42:42.524314+0000","last_undegraded":"2022-09-07T19:42:42.524314+0000","last_fullsized":"2022-09-07T19:42:42.524314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:52:19.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.832981+0000","last_change":"2022-09-07T19:42:06.358259+0000","last_active":"2022-09-07T19:42:42.832981+0000","last_peered":"2022-09-07T19:42:42.832981+0000","last_clean":"2022-09-07T19:42:42.832981+0000","last_became_active":"2022-09-07T19:42:06.357963+0000","last_became_peered":"2022-09-07T19:42:06.357963+0000","last_unstale":"2022-09-07T19:42:42.832981+0000","last_undegraded":"2022-09-07T19:42:42.832981+0000","last_fullsized":"2022-09-07T19:42:42.832981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:53:56.014702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.537993+0000","last_change":"2022-09-07T19:42:43.537993+0000","last_active":"2022-09-07T19:42:43.537993+0000","last_peered":"2022-09-07T19:42:43.537993+0000","last_clean":"2022-09-07T19:42:43.537993+0000","last_became_active":"2022-09-07T19:42:43.537650+0000","last_became_peered":"2022-09-07T19:42:43.537650+0000","last_unstale":"2022-09-07T19:42:43.537993+0000","last_undegraded":"2022-09-07T19:42:43.537993+0000","last_fullsized":"2022-09-07T19:42:43.537993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:15:44.289100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.723162+0000","last_change":"2022-09-07T19:42:43.723162+0000","last_active":"2022-09-07T19:42:43.723162+0000","last_peered":"2022-09-07T19:42:43.723162+0000","last_clean":"2022-09-07T19:42:43.723162+0000","last_became_active":"2022-09-07T19:42:43.722525+0000","last_became_peered":"2022-09-07T19:42:43.722525+0000","last_unstale":"2022-09-07T19:42:43.723162+0000","last_undegraded":"2022-09-07T19:42:43.723162+0000","last_fullsized":"2022-09-07T19:42:43.723162+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:27:30.738256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525029+0000","last_change":"2022-09-07T19:42:06.358852+0000","last_active":"2022-09-07T19:42:42.525029+0000","last_peered":"2022-09-07T19:42:42.525029+0000","last_clean":"2022-09-07T19:42:42.525029+0000","last_became_active":"2022-09-07T19:42:06.358465+0000","last_became_peered":"2022-09-07T19:42:06.358465+0000","last_unstale":"2022-09-07T19:42:42.525029+0000","last_undegraded":"2022-09-07T19:42:42.525029+0000","last_fullsized":"2022-09-07T19:42:42.525029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:15:57.255952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534210+0000","last_change":"2022-09-07T19:42:06.941011+0000","last_active":"2022-09-07T19:42:42.534210+0000","last_peered":"2022-09-07T19:42:42.534210+0000","last_clean":"2022-09-07T19:42:42.534210+0000","last_became_active":"2022-09-07T19:42:06.940728+0000","last_became_peered":"2022-09-07T19:42:06.940728+0000","last_unstale":"2022-09-07T19:42:42.534210+0000","last_undegraded":"2022-09-07T19:42:42.534210+0000","last_fullsized":"2022-09-07T19:42:42.534210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:57:52.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532441+0000","last_change":"2022-09-07T19:42:11.405383+0000","last_active":"2022-09-07T19:42:42.532441+0000","last_peered":"2022-09-07T19:42:42.532441+0000","last_clean":"2022-09-07T19:42:42.532441+0000","last_became_active":"2022-09-07T19:42:11.405021+0000","last_became_peered":"2022-09-07T19:42:11.405021+0000","last_unstale":"2022-09-07T19:42:42.532441+0000","last_undegraded":"2022-09-07T19:42:42.532441+0000","last_fullsized":"2022-09-07T19:42:42.532441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:24:30.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532982+0000","last_change":"2022-09-07T19:42:06.365791+0000","last_active":"2022-09-07T19:42:42.532982+0000","last_peered":"2022-09-07T19:42:42.532982+0000","last_clean":"2022-09-07T19:42:42.532982+0000","last_became_active":"2022-09-07T19:42:06.365471+0000","last_became_peered":"2022-09-07T19:42:06.365471+0000","last_unstale":"2022-09-07T19:42:42.532982+0000","last_undegraded":"2022-09-07T19:42:42.532982+0000","last_fullsized":"2022-09-07T19:42:42.532982+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:38:03.735263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533278+0000","last_change":"2022-09-07T19:42:06.951163+0000","last_active":"2022-09-07T19:42:42.533278+0000","last_peered":"2022-09-07T19:42:42.533278+0000","last_clean":"2022-09-07T19:42:42.533278+0000","last_became_active":"2022-09-07T19:42:06.950879+0000","last_became_peered":"2022-09-07T19:42:06.950879+0000","last_unstale":"2022-09-07T19:42:42.533278+0000","last_undegraded":"2022-09-07T19:42:42.533278+0000","last_fullsized":"2022-09-07T19:42:42.533278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:19:17.420880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530020+0000","last_change":"2022-09-07T19:42:11.402397+0000","last_active":"2022-09-07T19:42:42.530020+0000","last_peered":"2022-09-07T19:42:42.530020+0000","last_clean":"2022-09-07T19:42:42.530020+0000","last_became_active":"2022-09-07T19:42:11.402036+0000","last_became_peered":"2022-09-07T19:42:11.402036+0000","last_unstale":"2022-09-07T19:42:42.530020+0000","last_undegraded":"2022-09-07T19:42:42.530020+0000","last_fullsized":"2022-09-07T19:42:42.530020+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:42:53.158561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524405+0000","last_change":"2022-09-07T19:42:06.936405+0000","last_active":"2022-09-07T19:42:42.524405+0000","last_peered":"2022-09-07T19:42:42.524405+0000","last_clean":"2022-09-07T19:42:42.524405+0000","last_became_active":"2022-09-07T19:42:06.936125+0000","last_became_peered":"2022-09-07T19:42:06.936125+0000","last_unstale":"2022-09-07T19:42:42.524405+0000","last_undegraded":"2022-09-07T19:42:42.524405+0000","last_fullsized":"2022-09-07T19:42:42.524405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:47:33.002955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":75,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:43:29.607241+0000","last_change":"2022-09-07T19:42:06.372771+0000","last_active":"2022-09-07T19:43:29.607241+0000","last_peered":"2022-09-07T19:43:29.607241+0000","last_clean":"2022-09-07T19:43:29.607241+0000","last_became_active":"2022-09-07T19:42:06.372498+0000","last_became_peered":"2022-09-07T19:42:06.372498+0000","last_unstale":"2022-09-07T19:43:29.607241+0000","last_undegraded":"2022-09-07T19:43:29.607241+0000","last_fullsized":"2022-09-07T19:43:29.607241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:26:04.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532339+0000","last_change":"2022-09-07T19:42:11.410486+0000","last_active":"2022-09-07T19:42:42.532339+0000","last_peered":"2022-09-07T19:42:42.532339+0000","last_clean":"2022-09-07T19:42:42.532339+0000","last_became_active":"2022-09-07T19:42:11.410195+0000","last_became_peered":"2022-09-07T19:42:11.410195+0000","last_unstale":"2022-09-07T19:42:42.532339+0000","last_undegraded":"2022-09-07T19:42:42.532339+0000","last_fullsized":"2022-09-07T19:42:42.532339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:01:25.927536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531197+0000","last_change":"2022-09-07T19:42:06.942040+0000","last_active":"2022-09-07T19:42:42.531197+0000","last_peered":"2022-09-07T19:42:42.531197+0000","last_clean":"2022-09-07T19:42:42.531197+0000","last_became_active":"2022-09-07T19:42:06.941732+0000","last_became_peered":"2022-09-07T19:42:06.941732+0000","last_unstale":"2022-09-07T19:42:42.531197+0000","last_undegraded":"2022-09-07T19:42:42.531197+0000","last_fullsized":"2022-09-07T19:42:42.531197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:05:56.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529116+0000","last_change":"2022-09-07T19:42:06.361996+0000","last_active":"2022-09-07T19:42:42.529116+0000","last_peered":"2022-09-07T19:42:42.529116+0000","last_clean":"2022-09-07T19:42:42.529116+0000","last_became_active":"2022-09-07T19:42:06.361658+0000","last_became_peered":"2022-09-07T19:42:06.361658+0000","last_unstale":"2022-09-07T19:42:42.529116+0000","last_undegraded":"2022-09-07T19:42:42.529116+0000","last_fullsized":"2022-09-07T19:42:42.529116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:07:13.180501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":379,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531959+0000","last_change":"2022-09-07T19:40:58.352995+0000","last_active":"2022-09-07T19:42:42.531959+0000","last_peered":"2022-09-07T19:42:42.531959+0000","last_clean":"2022-09-07T19:42:42.531959+0000","last_became_active":"2022-09-07T19:40:58.352548+0000","last_became_peered":"2022-09-07T19:40:58.352548+0000","last_unstale":"2022-09-07T19:42:42.531959+0000","last_undegraded":"2022-09-07T19:42:42.531959+0000","last_fullsized":"2022-09-07T19:42:42.531959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:37:12.654773+0000","last_clean_scrub_stamp":"2022-09-07T19:37:12.654773+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:58:55.796726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525257+0000","last_change":"2022-09-07T19:42:11.404798+0000","last_active":"2022-09-07T19:42:42.525257+0000","last_peered":"2022-09-07T19:42:42.525257+0000","last_clean":"2022-09-07T19:42:42.525257+0000","last_became_active":"2022-09-07T19:42:11.404370+0000","last_became_peered":"2022-09-07T19:42:11.404370+0000","last_unstale":"2022-09-07T19:42:42.525257+0000","last_undegraded":"2022-09-07T19:42:42.525257+0000","last_fullsized":"2022-09-07T19:42:42.525257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:39:40.619684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529018+0000","last_change":"2022-09-07T19:42:06.943283+0000","last_active":"2022-09-07T19:42:42.529018+0000","last_peered":"2022-09-07T19:42:42.529018+0000","last_clean":"2022-09-07T19:42:42.529018+0000","last_became_active":"2022-09-07T19:42:06.942864+0000","last_became_peered":"2022-09-07T19:42:06.942864+0000","last_unstale":"2022-09-07T19:42:42.529018+0000","last_undegraded":"2022-09-07T19:42:42.529018+0000","last_fullsized":"2022-09-07T19:42:42.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:07:23.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531999+0000","last_change":"2022-09-07T19:42:06.361341+0000","last_active":"2022-09-07T19:42:42.531999+0000","last_peered":"2022-09-07T19:42:42.531999+0000","last_clean":"2022-09-07T19:42:42.531999+0000","last_became_active":"2022-09-07T19:42:06.361008+0000","last_became_peered":"2022-09-07T19:42:06.361008+0000","last_unstale":"2022-09-07T19:42:42.531999+0000","last_undegraded":"2022-09-07T19:42:42.531999+0000","last_fullsized":"2022-09-07T19:42:42.531999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:08:54.850406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528725+0000","last_change":"2022-09-07T19:42:11.401991+0000","last_active":"2022-09-07T19:42:42.528725+0000","last_peered":"2022-09-07T19:42:42.528725+0000","last_clean":"2022-09-07T19:42:42.528725+0000","last_became_active":"2022-09-07T19:42:11.401129+0000","last_became_peered":"2022-09-07T19:42:11.401129+0000","last_unstale":"2022-09-07T19:42:42.528725+0000","last_undegraded":"2022-09-07T19:42:42.528725+0000","last_fullsized":"2022-09-07T19:42:42.528725+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:11:40.780758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530143+0000","last_change":"2022-09-07T19:42:06.364282+0000","last_active":"2022-09-07T19:42:42.530143+0000","last_peered":"2022-09-07T19:42:42.530143+0000","last_clean":"2022-09-07T19:42:42.530143+0000","last_became_active":"2022-09-07T19:42:06.364004+0000","last_became_peered":"2022-09-07T19:42:06.364004+0000","last_unstale":"2022-09-07T19:42:42.530143+0000","last_undegraded":"2022-09-07T19:42:42.530143+0000","last_fullsized":"2022-09-07T19:42:42.530143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:28:16.489787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532636+0000","last_change":"2022-09-07T19:42:06.935556+0000","last_active":"2022-09-07T19:42:42.532636+0000","last_peered":"2022-09-07T19:42:42.532636+0000","last_clean":"2022-09-07T19:42:42.532636+0000","last_became_active":"2022-09-07T19:42:06.935277+0000","last_became_peered":"2022-09-07T19:42:06.935277+0000","last_unstale":"2022-09-07T19:42:42.532636+0000","last_undegraded":"2022-09-07T19:42:42.532636+0000","last_fullsized":"2022-09-07T19:42:42.532636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:52:27.506947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529532+0000","last_change":"2022-09-07T19:42:11.402833+0000","last_active":"2022-09-07T19:42:42.529532+0000","last_peered":"2022-09-07T19:42:42.529532+0000","last_clean":"2022-09-07T19:42:42.529532+0000","last_became_active":"2022-09-07T19:42:11.402478+0000","last_became_peered":"2022-09-07T19:42:11.402478+0000","last_unstale":"2022-09-07T19:42:42.529532+0000","last_undegraded":"2022-09-07T19:42:42.529532+0000","last_fullsized":"2022-09-07T19:42:42.529532+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:58:50.474580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:44.331407+0000","last_change":"2022-09-07T19:42:06.369761+0000","last_active":"2022-09-07T19:42:44.331407+0000","last_peered":"2022-09-07T19:42:44.331407+0000","last_clean":"2022-09-07T19:42:44.331407+0000","last_became_active":"2022-09-07T19:42:06.369366+0000","last_became_peered":"2022-09-07T19:42:06.369366+0000","last_unstale":"2022-09-07T19:42:44.331407+0000","last_undegraded":"2022-09-07T19:42:44.331407+0000","last_fullsized":"2022-09-07T19:42:44.331407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:58.993644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531020+0000","last_change":"2022-09-07T19:42:06.939822+0000","last_active":"2022-09-07T19:42:42.531020+0000","last_peered":"2022-09-07T19:42:42.531020+0000","last_clean":"2022-09-07T19:42:42.531020+0000","last_became_active":"2022-09-07T19:42:06.939515+0000","last_became_peered":"2022-09-07T19:42:06.939515+0000","last_unstale":"2022-09-07T19:42:42.531020+0000","last_undegraded":"2022-09-07T19:42:42.531020+0000","last_fullsized":"2022-09-07T19:42:42.531020+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:32:15.696524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531251+0000","last_change":"2022-09-07T19:42:11.401085+0000","last_active":"2022-09-07T19:42:42.531251+0000","last_peered":"2022-09-07T19:42:42.531251+0000","last_clean":"2022-09-07T19:42:42.531251+0000","last_became_active":"2022-09-07T19:42:11.400594+0000","last_became_peered":"2022-09-07T19:42:11.400594+0000","last_unstale":"2022-09-07T19:42:42.531251+0000","last_undegraded":"2022-09-07T19:42:42.531251+0000","last_fullsized":"2022-09-07T19:42:42.531251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:44:52.837616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529607+0000","last_change":"2022-09-07T19:42:06.365721+0000","last_active":"2022-09-07T19:42:42.529607+0000","last_peered":"2022-09-07T19:42:42.529607+0000","last_clean":"2022-09-07T19:42:42.529607+0000","last_became_active":"2022-09-07T19:42:06.365388+0000","last_became_peered":"2022-09-07T19:42:06.365388+0000","last_unstale":"2022-09-07T19:42:42.529607+0000","last_undegraded":"2022-09-07T19:42:42.529607+0000","last_fullsized":"2022-09-07T19:42:42.529607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:51:57.432567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.534108+0000","last_change":"2022-09-07T19:42:06.959467+0000","last_active":"2022-09-07T19:42:42.534108+0000","last_peered":"2022-09-07T19:42:42.534108+0000","last_clean":"2022-09-07T19:42:42.534108+0000","last_became_active":"2022-09-07T19:42:06.959165+0000","last_became_peered":"2022-09-07T19:42:06.959165+0000","last_unstale":"2022-09-07T19:42:42.534108+0000","last_undegraded":"2022-09-07T19:42:42.534108+0000","last_fullsized":"2022-09-07T19:42:42.534108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:45:54.697717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529417+0000","last_change":"2022-09-07T19:42:11.414077+0000","last_active":"2022-09-07T19:42:42.529417+0000","last_peered":"2022-09-07T19:42:42.529417+0000","last_clean":"2022-09-07T19:42:42.529417+0000","last_became_active":"2022-09-07T19:42:11.413611+0000","last_became_peered":"2022-09-07T19:42:11.413611+0000","last_unstale":"2022-09-07T19:42:42.529417+0000","last_undegraded":"2022-09-07T19:42:42.529417+0000","last_fullsized":"2022-09-07T19:42:42.529417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:28:23.166148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527029+0000","last_change":"2022-09-07T19:42:06.359443+0000","last_active":"2022-09-07T19:42:42.527029+0000","last_peered":"2022-09-07T19:42:42.527029+0000","last_clean":"2022-09-07T19:42:42.527029+0000","last_became_active":"2022-09-07T19:42:06.359095+0000","last_became_peered":"2022-09-07T19:42:06.359095+0000","last_unstale":"2022-09-07T19:42:42.527029+0000","last_undegraded":"2022-09-07T19:42:42.527029+0000","last_fullsized":"2022-09-07T19:42:42.527029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T06:36:01.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527736+0000","last_change":"2022-09-07T19:42:06.933410+0000","last_active":"2022-09-07T19:42:42.527736+0000","last_peered":"2022-09-07T19:42:42.527736+0000","last_clean":"2022-09-07T19:42:42.527736+0000","last_became_active":"2022-09-07T19:42:06.933092+0000","last_became_peered":"2022-09-07T19:42:06.933092+0000","last_unstale":"2022-09-07T19:42:42.527736+0000","last_undegraded":"2022-09-07T19:42:42.527736+0000","last_fullsized":"2022-09-07T19:42:42.527736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:39:51.700247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525703+0000","last_change":"2022-09-07T19:42:11.409290+0000","last_active":"2022-09-07T19:42:42.525703+0000","last_peered":"2022-09-07T19:42:42.525703+0000","last_clean":"2022-09-07T19:42:42.525703+0000","last_became_active":"2022-09-07T19:42:11.408883+0000","last_became_peered":"2022-09-07T19:42:11.408883+0000","last_unstale":"2022-09-07T19:42:42.525703+0000","last_undegraded":"2022-09-07T19:42:42.525703+0000","last_fullsized":"2022-09-07T19:42:42.525703+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:51:39.640794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530017+0000","last_change":"2022-09-07T19:42:06.377191+0000","last_active":"2022-09-07T19:42:42.530017+0000","last_peered":"2022-09-07T19:42:42.530017+0000","last_clean":"2022-09-07T19:42:42.530017+0000","last_became_active":"2022-09-07T19:42:06.376437+0000","last_became_peered":"2022-09-07T19:42:06.376437+0000","last_unstale":"2022-09-07T19:42:42.530017+0000","last_undegraded":"2022-09-07T19:42:42.530017+0000","last_fullsized":"2022-09-07T19:42:42.530017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:53:44.874088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528310+0000","last_change":"2022-09-07T19:42:06.954380+0000","last_active":"2022-09-07T19:42:42.528310+0000","last_peered":"2022-09-07T19:42:42.528310+0000","last_clean":"2022-09-07T19:42:42.528310+0000","last_became_active":"2022-09-07T19:42:06.954206+0000","last_became_peered":"2022-09-07T19:42:06.954206+0000","last_unstale":"2022-09-07T19:42:42.528310+0000","last_undegraded":"2022-09-07T19:42:42.528310+0000","last_fullsized":"2022-09-07T19:42:42.528310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:49:23.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.542848+0000","last_change":"2022-09-07T19:42:43.542848+0000","last_active":"2022-09-07T19:42:43.542848+0000","last_peered":"2022-09-07T19:42:43.542848+0000","last_clean":"2022-09-07T19:42:43.542848+0000","last_became_active":"2022-09-07T19:42:43.538460+0000","last_became_peered":"2022-09-07T19:42:43.538460+0000","last_unstale":"2022-09-07T19:42:43.542848+0000","last_undegraded":"2022-09-07T19:42:43.542848+0000","last_fullsized":"2022-09-07T19:42:43.542848+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:15:55.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532798+0000","last_change":"2022-09-07T19:42:06.358321+0000","last_active":"2022-09-07T19:42:42.532798+0000","last_peered":"2022-09-07T19:42:42.532798+0000","last_clean":"2022-09-07T19:42:42.532798+0000","last_became_active":"2022-09-07T19:42:06.358016+0000","last_became_peered":"2022-09-07T19:42:06.358016+0000","last_unstale":"2022-09-07T19:42:42.532798+0000","last_undegraded":"2022-09-07T19:42:42.532798+0000","last_fullsized":"2022-09-07T19:42:42.532798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:44:23.140211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530712+0000","last_change":"2022-09-07T19:42:06.954601+0000","last_active":"2022-09-07T19:42:42.530712+0000","last_peered":"2022-09-07T19:42:42.530712+0000","last_clean":"2022-09-07T19:42:42.530712+0000","last_became_active":"2022-09-07T19:42:06.954220+0000","last_became_peered":"2022-09-07T19:42:06.954220+0000","last_unstale":"2022-09-07T19:42:42.530712+0000","last_undegraded":"2022-09-07T19:42:42.530712+0000","last_fullsized":"2022-09-07T19:42:42.530712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:55:21.042536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529231+0000","last_change":"2022-09-07T19:42:11.406496+0000","last_active":"2022-09-07T19:42:42.529231+0000","last_peered":"2022-09-07T19:42:42.529231+0000","last_clean":"2022-09-07T19:42:42.529231+0000","last_became_active":"2022-09-07T19:42:11.406097+0000","last_became_peered":"2022-09-07T19:42:11.406097+0000","last_unstale":"2022-09-07T19:42:42.529231+0000","last_undegraded":"2022-09-07T19:42:42.529231+0000","last_fullsized":"2022-09-07T19:42:42.529231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:08:19.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530504+0000","last_change":"2022-09-07T19:42:06.357410+0000","last_active":"2022-09-07T19:42:42.530504+0000","last_peered":"2022-09-07T19:42:42.530504+0000","last_clean":"2022-09-07T19:42:42.530504+0000","last_became_active":"2022-09-07T19:42:06.357016+0000","last_became_peered":"2022-09-07T19:42:06.357016+0000","last_unstale":"2022-09-07T19:42:42.530504+0000","last_undegraded":"2022-09-07T19:42:42.530504+0000","last_fullsized":"2022-09-07T19:42:42.530504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:10:30.657678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532824+0000","last_change":"2022-09-07T19:42:06.944746+0000","last_active":"2022-09-07T19:42:42.532824+0000","last_peered":"2022-09-07T19:42:42.532824+0000","last_clean":"2022-09-07T19:42:42.532824+0000","last_became_active":"2022-09-07T19:42:06.944324+0000","last_became_peered":"2022-09-07T19:42:06.944324+0000","last_unstale":"2022-09-07T19:42:42.532824+0000","last_undegraded":"2022-09-07T19:42:42.532824+0000","last_fullsized":"2022-09-07T19:42:42.532824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:20:56.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527141+0000","last_change":"2022-09-07T19:42:11.405830+0000","last_active":"2022-09-07T19:42:42.527141+0000","last_peered":"2022-09-07T19:42:42.527141+0000","last_clean":"2022-09-07T19:42:42.527141+0000","last_became_active":"2022-09-07T19:42:11.405375+0000","last_became_peered":"2022-09-07T19:42:11.405375+0000","last_unstale":"2022-09-07T19:42:42.527141+0000","last_undegraded":"2022-09-07T19:42:42.527141+0000","last_fullsized":"2022-09-07T19:42:42.527141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T00:30:43.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533713+0000","last_change":"2022-09-07T19:42:06.359635+0000","last_active":"2022-09-07T19:42:42.533713+0000","last_peered":"2022-09-07T19:42:42.533713+0000","last_clean":"2022-09-07T19:42:42.533713+0000","last_became_active":"2022-09-07T19:42:06.359349+0000","last_became_peered":"2022-09-07T19:42:06.359349+0000","last_unstale":"2022-09-07T19:42:42.533713+0000","last_undegraded":"2022-09-07T19:42:42.533713+0000","last_fullsized":"2022-09-07T19:42:42.533713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T20:04:56.282670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532941+0000","last_change":"2022-09-07T19:42:06.948313+0000","last_active":"2022-09-07T19:42:42.532941+0000","last_peered":"2022-09-07T19:42:42.532941+0000","last_clean":"2022-09-07T19:42:42.532941+0000","last_became_active":"2022-09-07T19:42:06.948008+0000","last_became_peered":"2022-09-07T19:42:06.948008+0000","last_unstale":"2022-09-07T19:42:42.532941+0000","last_undegraded":"2022-09-07T19:42:42.532941+0000","last_fullsized":"2022-09-07T19:42:42.532941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:39:30.575085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533294+0000","last_change":"2022-09-07T19:42:11.413042+0000","last_active":"2022-09-07T19:42:42.533294+0000","last_peered":"2022-09-07T19:42:42.533294+0000","last_clean":"2022-09-07T19:42:42.533294+0000","last_became_active":"2022-09-07T19:42:11.412658+0000","last_became_peered":"2022-09-07T19:42:11.412658+0000","last_unstale":"2022-09-07T19:42:42.533294+0000","last_undegraded":"2022-09-07T19:42:42.533294+0000","last_fullsized":"2022-09-07T19:42:42.533294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:33:41.892522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.525141+0000","last_change":"2022-09-07T19:42:06.376394+0000","last_active":"2022-09-07T19:42:42.525141+0000","last_peered":"2022-09-07T19:42:42.525141+0000","last_clean":"2022-09-07T19:42:42.525141+0000","last_became_active":"2022-09-07T19:42:06.376141+0000","last_became_peered":"2022-09-07T19:42:06.376141+0000","last_unstale":"2022-09-07T19:42:42.525141+0000","last_undegraded":"2022-09-07T19:42:42.525141+0000","last_fullsized":"2022-09-07T19:42:42.525141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:40:00.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533399+0000","last_change":"2022-09-07T19:42:06.937730+0000","last_active":"2022-09-07T19:42:42.533399+0000","last_peered":"2022-09-07T19:42:42.533399+0000","last_clean":"2022-09-07T19:42:42.533399+0000","last_became_active":"2022-09-07T19:42:06.937387+0000","last_became_peered":"2022-09-07T19:42:06.937387+0000","last_unstale":"2022-09-07T19:42:42.533399+0000","last_undegraded":"2022-09-07T19:42:42.533399+0000","last_fullsized":"2022-09-07T19:42:42.533399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T05:22:04.045843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.524089+0000","last_change":"2022-09-07T19:42:11.403846+0000","last_active":"2022-09-07T19:42:42.524089+0000","last_peered":"2022-09-07T19:42:42.524089+0000","last_clean":"2022-09-07T19:42:42.524089+0000","last_became_active":"2022-09-07T19:42:11.403096+0000","last_became_peered":"2022-09-07T19:42:11.403096+0000","last_unstale":"2022-09-07T19:42:42.524089+0000","last_undegraded":"2022-09-07T19:42:42.524089+0000","last_fullsized":"2022-09-07T19:42:42.524089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:10.373624+0000","last_clean_scrub_stamp":"2022-09-07T19:42:10.373624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:37:41.081199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530198+0000","last_change":"2022-09-07T19:42:06.378938+0000","last_active":"2022-09-07T19:42:42.530198+0000","last_peered":"2022-09-07T19:42:42.530198+0000","last_clean":"2022-09-07T19:42:42.530198+0000","last_became_active":"2022-09-07T19:42:06.378545+0000","last_became_peered":"2022-09-07T19:42:06.378545+0000","last_unstale":"2022-09-07T19:42:42.530198+0000","last_undegraded":"2022-09-07T19:42:42.530198+0000","last_fullsized":"2022-09-07T19:42:42.530198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:05.077111+0000","last_clean_scrub_stamp":"2022-09-07T19:42:05.077111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T04:44:53.904515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532623+0000","last_change":"2022-09-07T19:42:06.936282+0000","last_active":"2022-09-07T19:42:42.532623+0000","last_peered":"2022-09-07T19:42:42.532623+0000","last_clean":"2022-09-07T19:42:42.532623+0000","last_became_active":"2022-09-07T19:42:06.935916+0000","last_became_peered":"2022-09-07T19:42:06.935916+0000","last_unstale":"2022-09-07T19:42:42.532623+0000","last_undegraded":"2022-09-07T19:42:42.532623+0000","last_fullsized":"2022-09-07T19:42:42.532623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:53:06.657196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.528328+0000","last_change":"2022-09-07T19:42:06.938195+0000","last_active":"2022-09-07T19:42:42.528328+0000","last_peered":"2022-09-07T19:42:42.528328+0000","last_clean":"2022-09-07T19:42:42.528328+0000","last_became_active":"2022-09-07T19:42:06.937916+0000","last_became_peered":"2022-09-07T19:42:06.937916+0000","last_unstale":"2022-09-07T19:42:42.528328+0000","last_undegraded":"2022-09-07T19:42:42.528328+0000","last_fullsized":"2022-09-07T19:42:42.528328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:22:43.390552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532073+0000","last_change":"2022-09-07T19:42:06.940303+0000","last_active":"2022-09-07T19:42:42.532073+0000","last_peered":"2022-09-07T19:42:42.532073+0000","last_clean":"2022-09-07T19:42:42.532073+0000","last_became_active":"2022-09-07T19:42:06.939974+0000","last_became_peered":"2022-09-07T19:42:06.939974+0000","last_unstale":"2022-09-07T19:42:42.532073+0000","last_undegraded":"2022-09-07T19:42:42.532073+0000","last_fullsized":"2022-09-07T19:42:42.532073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:36:37.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530850+0000","last_change":"2022-09-07T19:42:06.948849+0000","last_active":"2022-09-07T19:42:42.530850+0000","last_peered":"2022-09-07T19:42:42.530850+0000","last_clean":"2022-09-07T19:42:42.530850+0000","last_became_active":"2022-09-07T19:42:06.948263+0000","last_became_peered":"2022-09-07T19:42:06.948263+0000","last_unstale":"2022-09-07T19:42:42.530850+0000","last_undegraded":"2022-09-07T19:42:42.530850+0000","last_fullsized":"2022-09-07T19:42:42.530850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T21:33:26.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533385+0000","last_change":"2022-09-07T19:42:06.957145+0000","last_active":"2022-09-07T19:42:42.533385+0000","last_peered":"2022-09-07T19:42:42.533385+0000","last_clean":"2022-09-07T19:42:42.533385+0000","last_became_active":"2022-09-07T19:42:06.956769+0000","last_became_peered":"2022-09-07T19:42:06.956769+0000","last_unstale":"2022-09-07T19:42:42.533385+0000","last_undegraded":"2022-09-07T19:42:42.533385+0000","last_fullsized":"2022-09-07T19:42:42.533385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:51:09.154847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.532714+0000","last_change":"2022-09-07T19:42:06.954543+0000","last_active":"2022-09-07T19:42:42.532714+0000","last_peered":"2022-09-07T19:42:42.532714+0000","last_clean":"2022-09-07T19:42:42.532714+0000","last_became_active":"2022-09-07T19:42:06.954229+0000","last_became_peered":"2022-09-07T19:42:06.954229+0000","last_unstale":"2022-09-07T19:42:42.532714+0000","last_undegraded":"2022-09-07T19:42:42.532714+0000","last_fullsized":"2022-09-07T19:42:42.532714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T02:55:48.612830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529496+0000","last_change":"2022-09-07T19:42:06.937808+0000","last_active":"2022-09-07T19:42:42.529496+0000","last_peered":"2022-09-07T19:42:42.529496+0000","last_clean":"2022-09-07T19:42:42.529496+0000","last_became_active":"2022-09-07T19:42:06.937452+0000","last_became_peered":"2022-09-07T19:42:06.937452+0000","last_unstale":"2022-09-07T19:42:42.529496+0000","last_undegraded":"2022-09-07T19:42:42.529496+0000","last_fullsized":"2022-09-07T19:42:42.529496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T22:56:19.296497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.533366+0000","last_change":"2022-09-07T19:42:06.939519+0000","last_active":"2022-09-07T19:42:42.533366+0000","last_peered":"2022-09-07T19:42:42.533366+0000","last_clean":"2022-09-07T19:42:42.533366+0000","last_became_active":"2022-09-07T19:42:06.939171+0000","last_became_peered":"2022-09-07T19:42:06.939171+0000","last_unstale":"2022-09-07T19:42:42.533366+0000","last_undegraded":"2022-09-07T19:42:42.533366+0000","last_fullsized":"2022-09-07T19:42:42.533366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T07:12:30.663072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.531175+0000","last_change":"2022-09-07T19:42:06.939331+0000","last_active":"2022-09-07T19:42:42.531175+0000","last_peered":"2022-09-07T19:42:42.531175+0000","last_clean":"2022-09-07T19:42:42.531175+0000","last_became_active":"2022-09-07T19:42:06.939034+0000","last_became_peered":"2022-09-07T19:42:06.939034+0000","last_unstale":"2022-09-07T19:42:42.531175+0000","last_undegraded":"2022-09-07T19:42:42.531175+0000","last_fullsized":"2022-09-07T19:42:42.531175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:14:24.794753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2022-09-07T19:42:43.544352+0000","last_change":"2022-09-07T19:42:43.544352+0000","last_active":"2022-09-07T19:42:43.544352+0000","last_peered":"2022-09-07T19:42:43.544352+0000","last_clean":"2022-09-07T19:42:43.544352+0000","last_became_active":"2022-09-07T19:42:43.544029+0000","last_became_peered":"2022-09-07T19:42:43.544029+0000","last_unstale":"2022-09-07T19:42:43.544352+0000","last_undegraded":"2022-09-07T19:42:43.544352+0000","last_fullsized":"2022-09-07T19:42:43.544352+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:01:59.991410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.530100+0000","last_change":"2022-09-07T19:42:06.940112+0000","last_active":"2022-09-07T19:42:42.530100+0000","last_peered":"2022-09-07T19:42:42.530100+0000","last_clean":"2022-09-07T19:42:42.530100+0000","last_became_active":"2022-09-07T19:42:06.939734+0000","last_became_peered":"2022-09-07T19:42:06.939734+0000","last_unstale":"2022-09-07T19:42:42.530100+0000","last_undegraded":"2022-09-07T19:42:42.530100+0000","last_fullsized":"2022-09-07T19:42:42.530100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T01:17:34.201649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.527344+0000","last_change":"2022-09-07T19:42:06.945504+0000","last_active":"2022-09-07T19:42:42.527344+0000","last_peered":"2022-09-07T19:42:42.527344+0000","last_clean":"2022-09-07T19:42:42.527344+0000","last_became_active":"2022-09-07T19:42:06.945194+0000","last_became_peered":"2022-09-07T19:42:06.945194+0000","last_unstale":"2022-09-07T19:42:42.527344+0000","last_undegraded":"2022-09-07T19:42:42.527344+0000","last_fullsized":"2022-09-07T19:42:42.527344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T19:54:10.526721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529750+0000","last_change":"2022-09-07T19:42:06.953952+0000","last_active":"2022-09-07T19:42:42.529750+0000","last_peered":"2022-09-07T19:42:42.529750+0000","last_clean":"2022-09-07T19:42:42.529750+0000","last_became_active":"2022-09-07T19:42:06.953594+0000","last_became_peered":"2022-09-07T19:42:06.953594+0000","last_unstale":"2022-09-07T19:42:42.529750+0000","last_undegraded":"2022-09-07T19:42:42.529750+0000","last_fullsized":"2022-09-07T19:42:42.529750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-09T03:52:15.188770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2022-09-07T19:42:42.529643+0000","last_change":"2022-09-07T19:42:06.943804+0000","last_active":"2022-09-07T19:42:42.529643+0000","last_peered":"2022-09-07T19:42:42.529643+0000","last_clean":"2022-09-07T19:42:42.529643+0000","last_became_active":"2022-09-07T19:42:06.943499+0000","last_became_peered":"2022-09-07T19:42:06.943499+0000","last_unstale":"2022-09-07T19:42:42.529643+0000","last_undegraded":"2022-09-07T19:42:42.529643+0000","last_fullsized":"2022-09-07T19:42:42.529643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-07T19:42:06.340687+0000","last_clean_scrub_stamp":"2022-09-07T19:42:06.340687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-09-08T23:07:20.646159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281075,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65117,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":338,"num_read_kb":239,"num_write":158,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383708,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6100,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739052,"statfs":{"total":95995035648,"available":95988789248,"internally_reserved":0,"allocated":995328,"data_stored":498840,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68500000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.44}]},{"osd":1,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.749},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.46200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.71399999999999997}]},{"osd":6,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.109,"5min":1.294,"15min":1.294},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.58499999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.86199999999999999,"5min":1.05,"15min":1.05},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.026,"15min":1.026},"last":0.57699999999999996}]},{"osd":8,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.82499999999999996}]},{"osd":10,"last update":"Wed Sep 7 19:43:18 2022","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.60699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91300000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.72699999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6560,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738592,"statfs":{"total":95995035648,"available":95988318208,"internally_reserved":0,"allocated":1138688,"data_stored":1151091,"data_compressed":53343,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:43:08 2022","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":9.9600000000000009,"5min":9.9600000000000009,"15min":9.9600000000000009},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72599999999999998,"5min":0.746,"15min":0.746},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56299999999999994,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38800000000000001}]},{"osd":2,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78500000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57899999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44500000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69299999999999995,"15min":0.67700000000000005},"min":{"1min":0.56100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.374}]},{"osd":5,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.56000000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89500000000000002,"15min":0.92100000000000004},"min":{"1min":0.57899999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.405,"5min":4.415,"15min":4.415},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.76200000000000001,"15min":0.74299999999999999},"min":{"1min":0.60899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.75900000000000001}]},{"osd":7,"last update":"Wed Sep 7 19:41:57 2022","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.90800000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.55300000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.624}]},{"osd":9,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.85399999999999998,"15min":0.82199999999999995},"min":{"1min":0.68600000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.58799999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:22 2022","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67800000000000005}]}]},{"osd":9,"up_from":67,"seq":287762808872,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":1011712,"data_stored":499076,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69299999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.76300000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90700000000000003,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98899999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76800000000000002},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89500000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94099999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80700000000000005,"15min":0.81499999999999995},"min":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.89200000000000002,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.85399999999999998,"15min":0.876},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94199999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.86299999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.77500000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.753}]},{"osd":7,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.98499999999999999,"5min":1.599,"15min":1.599},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.93899999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.95299999999999996,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.69999999999999996}]},{"osd":8,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.98799999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0589999999999999,"5min":1.357,"15min":1.357},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.96499999999999997,"15min":0.98899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.03,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.83599999999999997}]},{"osd":10,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.046,"15min":0.96899999999999997},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":12.18,"5min":12.18,"15min":12.18},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.71,"5min":1.081,"15min":0.97599999999999998},"min":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":15.32,"5min":15.32,"15min":15.32},"last":0.70699999999999996}]},{"osd":11,"last update":"Wed Sep 7 19:43:15 2022","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":12.147,"5min":12.147,"15min":12.147},"last":0.73399999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6436,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738716,"statfs":{"total":95995035648,"available":95988445184,"internally_reserved":0,"allocated":1011712,"data_stored":498996,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67300000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.498}]},{"osd":1,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.74399999999999999}]},{"osd":2,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78700000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.876,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63200000000000001,"15min":0.65200000000000002},"min":{"1min":0.495,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.41799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.622,"15min":0.62},"min":{"1min":0.441,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.58499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.026,"15min":1.026},"last":0.84299999999999997}]},{"osd":7,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.46100000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.49399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.75600000000000001}]},{"osd":9,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.76600000000000001}]},{"osd":10,"last update":"Wed Sep 7 19:42:57 2022","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71699999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73899999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6548,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738604,"statfs":{"total":95995035648,"available":95988330496,"internally_reserved":0,"allocated":1060864,"data_stored":1095204,"data_compressed":53343,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:35 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.42099999999999999,"15min":0.41099999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53100000000000003,"5min":1.097,"15min":1.097},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.623,"5min":0.748,"15min":0.748},"last":0.41699999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68899999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.497}]},{"osd":5,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.752,"15min":1.752},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.78,"15min":1.78},"last":0.71399999999999997}]},{"osd":6,"last update":"Wed Sep 7 19:42:37 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70699999999999996}]},{"osd":8,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.87,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.64900000000000002},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":9,"last update":"Wed Sep 7 19:42:34 2022","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.752}]},{"osd":10,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.755},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94499999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68400000000000005}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79400000000000004}]}]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6416,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738736,"statfs":{"total":95995035648,"available":95988465664,"internally_reserved":0,"allocated":991232,"data_stored":494268,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.47699999999999998,"15min":0.45200000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.61499999999999999,"15min":0.57999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.48799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57499999999999996}]},{"osd":2,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95699999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.80100000000000005}]},{"osd":3,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":0.996},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.073,"15min":1.073},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85399999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":1.119,"15min":1.119},"last":0.83599999999999997}]},{"osd":7,"last update":"Wed Sep 7 19:42:38 2022","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.84999999999999998}]},{"osd":8,"last update":"Wed Sep 7 19:43:03 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80300000000000005,"15min":0.79200000000000004},"min":{"1min":0.627,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.78100000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.91700000000000004}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.141,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":10,"last update":"Wed Sep 7 19:42:58 2022","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.878},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91500000000000004,"15min":0.91300000000000003},"min":{"1min":0.73799999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.008}]},{"osd":11,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.71099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7440,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737712,"statfs":{"total":95995035648,"available":95987417088,"internally_reserved":0,"allocated":1056768,"data_stored":555043,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.89700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.54600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84699999999999998,"5min":1.04,"15min":1.04},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Sep 7 19:43:25 2022","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.58799999999999997,"15min":0.55400000000000005},"min":{"1min":0.41699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.85299999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76900000000000002}]},{"osd":3,"last update":"Wed Sep 7 19:42:50 2022","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42099999999999999,"15min":0.40100000000000002},"min":{"1min":0.32100000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.441,"15min":0.41299999999999998},"min":{"1min":0.308,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.436}]},{"osd":5,"last update":"Wed Sep 7 19:42:40 2022","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69099999999999995}]},{"osd":6,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.504,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90900000000000003,"5min":1.107,"15min":1.107},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Sep 7 19:42:40 2022","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.625},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85999999999999999,"5min":0.875,"15min":0.875},"last":0.63800000000000001}]},{"osd":8,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.65800000000000003,"15min":0.63200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65700000000000003}]},{"osd":9,"last update":"Wed Sep 7 19:42:31 2022","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.747,"15min":0.749},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.069,"15min":1.069},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94399999999999995,"5min":1.056,"15min":1.056},"last":0.68400000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:42:59 2022","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.48699999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.032,"15min":1.032},"last":0.74099999999999999}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.81999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7336,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737816,"statfs":{"total":95995035648,"available":95987523584,"internally_reserved":0,"allocated":1015808,"data_stored":495624,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 7 19:43:00 2022","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.6479999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Wed Sep 7 19:43:25 2022","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.66300000000000003,"15min":0.61299999999999999},"min":{"1min":0.47499999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.145,"5min":0.745,"15min":0.64800000000000002},"min":{"1min":0.52100000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.9370000000000003,"5min":6.9370000000000003,"15min":6.9370000000000003},"last":0.624}]},{"osd":3,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":7.2670000000000003,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.70099999999999996}]},{"osd":4,"last update":"Wed Sep 7 19:43:19 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.68100000000000005,"15min":0.65100000000000002},"min":{"1min":0.56499999999999995,"5min":0.372,"15min":0.372},"max":{"1min":1.2390000000000001,"5min":1.244,"15min":1.244},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.484,"5min":3.484,"15min":3.484},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71399999999999997,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.996,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.71899999999999997,"15min":0.67700000000000005},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.748},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":7.1660000000000004,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.89800000000000002}]},{"osd":8,"last update":"Wed Sep 7 19:43:00 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.77400000000000002,"15min":0.755},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.94899999999999995}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1299999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.127,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.754}]},{"osd":10,"last update":"Wed Sep 7 19:42:56 2022","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.83199999999999996,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91000000000000003,"15min":0.91400000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.302,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.143}]},{"osd":11,"last update":"Wed Sep 7 19:43:19 2022","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.81899999999999995,"15min":0.77600000000000002},"min":{"1min":0.64400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":0.876},{"interface":"front","average":{"1min":0.998,"5min":0.88500000000000001,"15min":0.86599999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.048}]}]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7592,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737560,"statfs":{"total":95995035648,"available":95987261440,"internally_reserved":0,"allocated":1081344,"data_stored":556722,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.42799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79500000000000004,"5min":1.113,"15min":1.113},"last":0.60399999999999998}]},{"osd":1,"last update":"Wed Sep 7 19:42:26 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81299999999999994,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":2.117,"15min":2.117},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.434},{"interface":"front","average":{"1min":0.622,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45600000000000002}]},{"osd":6,"last update":"Wed Sep 7 19:43:09 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.64100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.751}]},{"osd":7,"last update":"Wed Sep 7 19:43:11 2022","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73999999999999999}]},{"osd":8,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.64300000000000002,"15min":0.63200000000000001},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.622}]},{"osd":9,"last update":"Wed Sep 7 19:42:30 2022","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2},"last":0.80900000000000005}]},{"osd":10,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.70999999999999996,"15min":0.68700000000000006},"min":{"1min":0.67100000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70099999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6680,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738472,"statfs":{"total":95995035648,"available":95988195328,"internally_reserved":0,"allocated":999424,"data_stored":494139,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45700000000000002,"15min":0.41699999999999998},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.62},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51300000000000001,"15min":0.45000000000000001},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.59399999999999997},"min":{"1min":0.52800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.71099999999999997,"15min":0.65900000000000003},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.069,"5min":1.288,"15min":1.288},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.85099999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:43:13 2022","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.68200000000000005,"15min":0.63200000000000001},"min":{"1min":0.56499999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.753},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70899999999999996,"15min":0.65100000000000002},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.871}]},{"osd":5,"last update":"Wed Sep 7 19:42:39 2022","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.68600000000000005},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94499999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71299999999999997,"15min":0.68200000000000005},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.97499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Wed Sep 7 19:43:13 2022","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.71599999999999997,"15min":0.68000000000000005},"min":{"1min":0.52400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.66600000000000004,"15min":0.63},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.70699999999999996}]},{"osd":7,"last update":"Wed Sep 7 19:42:36 2022","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.76600000000000001,"15min":0.73499999999999999},"min":{"1min":0.67500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0529999999999999,"5min":1.173,"15min":1.173},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.61599999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.97499999999999998,"5min":1.075,"15min":1.075},"last":0.81699999999999995}]},{"osd":8,"last update":"Wed Sep 7 19:42:01 2022","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.879}]},{"osd":9,"last update":"Wed Sep 7 19:42:32 2022","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.91800000000000004,"15min":0.92300000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.1819999999999999,"5min":1.204,"15min":1.204},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.089,"5min":1.143,"15min":1.143},"last":0.79800000000000004}]},{"osd":10,"last update":"Wed Sep 7 19:42:55 2022","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.95099999999999996,"15min":0.96199999999999997},"min":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1479999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.85799999999999998}]},{"osd":11,"last update":"Wed Sep 7 19:43:10 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.88},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.91000000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6556,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738596,"statfs":{"total":95995035648,"available":95988322304,"internally_reserved":0,"allocated":1003520,"data_stored":499263,"data_compressed":17591,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:41:16 2022","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53800000000000003},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.192,"15min":0.192},"max":{"1min":0.56000000000000005,"5min":0.628,"15min":0.628},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.36599999999999999},"min":{"1min":0.35199999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.56999999999999995,"5min":0.753,"15min":0.753},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.52700000000000002},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":0.74399999999999999,"5min":0.755,"15min":0.755},"last":0.70399999999999996}]},{"osd":3,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.65300000000000002,"15min":0.56899999999999995},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":0.69999999999999996,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.5990000000000002,"5min":6.5990000000000002,"15min":6.5990000000000002},"last":0.755}]},{"osd":5,"last update":"Wed Sep 7 19:42:41 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56699999999999995,"15min":0.53400000000000003},"min":{"1min":0.5,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed Sep 7 19:43:21 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.70299999999999996,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.436,"15min":0.436},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.83899999999999997}]},{"osd":7,"last update":"Wed Sep 7 19:42:41 2022","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.505},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.85299999999999998}]},{"osd":8,"last update":"Wed Sep 7 19:43:03 2022","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66800000000000004,"15min":0.63900000000000001},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88300000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.97599999999999998}]},{"osd":9,"last update":"Wed Sep 7 19:42:33 2022","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.879,"5min":0.999,"15min":0.999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89900000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.89000000000000001}]},{"osd":10,"last update":"Wed Sep 7 19:42:56 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86099999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.94199999999999995}]},{"osd":11,"last update":"Wed Sep 7 19:43:07 2022","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.995}]}]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6684,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738468,"statfs":{"total":95995035648,"available":95988191232,"internally_reserved":0,"allocated":1069056,"data_stored":1090447,"data_compressed":53343,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70799999999999996,"5min":0.751,"15min":0.751},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67300000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.754,"15min":0.754},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.30499999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.54300000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.44}]},{"osd":3,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.501,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.59799999999999998}]},{"osd":4,"last update":"Wed Sep 7 19:42:42 2022","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72799999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57299999999999995}]},{"osd":6,"last update":"Wed Sep 7 19:43:12 2022","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.67500000000000004,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.218,"5min":5.218,"15min":5.218},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.621},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68000000000000005}]},{"osd":8,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83699999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66200000000000003}]},{"osd":9,"last update":"Wed Sep 7 19:42:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.76200000000000001}]},{"osd":10,"last update":"Wed Sep 7 19:43:01 2022","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.747},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34105,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35752,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-07T19:43:33.174 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2022-09-07T19:43:33.175 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-09-07T19:43:33.175 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2022-09-07T19:43:33.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph health --format=json 2022-09-07T19:43:33.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:33 smithi080 ceph-mon[90124]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:33.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:33 smithi155 ceph-mon[97606]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:33 smithi154 ceph-mon[96967]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:34.552 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:34 smithi080 ceph-mon[90124]: from='client.25021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:43:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:34 smithi154 ceph-mon[96967]: from='client.25021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:43:34.705 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:34 smithi155 ceph-mon[97606]: from='client.25021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-09-07T19:43:35.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:35 smithi080 ceph-mon[90124]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:43:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:35 smithi154 ceph-mon[96967]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:43:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:35 smithi155 ceph-mon[97606]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:43:35.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1451955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 msgr2=0x7fabf4066a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:35.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1451955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 0x7fabf4066a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009810 tx=0x7fabe4009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:35.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1451955159 shutdown_connections 2022-09-07T19:43:35.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1451955159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 0x7fabf410cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1451955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 0x7fabf4066a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1451955159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf410a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.893+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1451955159 >> 172.21.15.80:0/1451955159 conn(0x7fabf4073cf0 msgr2=0x7fabf40740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.894+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1451955159 shutdown_connections 2022-09-07T19:43:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.894+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1451955159 wait complete. 2022-09-07T19:43:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 Processor -- start 2022-09-07T19:43:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 -- start start 2022-09-07T19:43:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 0x7fabf4195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf4196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 0x7fabf419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf419af20 con 0x7fabf410aa10 2022-09-07T19:43:35.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf419b090 con 0x7fabf40666c0 2022-09-07T19:43:35.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.895+0000 7fabfa6ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf419b250 con 0x7fabf4066fd0 2022-09-07T19:43:35.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf4196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:35.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf8c9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 0x7fabf419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf4196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34148/0 (socket says 172.21.15.80:34148) 2022-09-07T19:43:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 -- 172.21.15.80:0/1196521110 learned_addr learned my addr 172.21.15.80:0/1196521110 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf3fff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 0x7fabf4195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 -- 172.21.15.80:0/1196521110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 msgr2=0x7fabf4195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:35.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 0x7fabf4195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:35.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 -- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 msgr2=0x7fabf419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:35.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 0x7fabf419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:35.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf37fe700 1 -- 172.21.15.80:0/1196521110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009730 con 0x7fabf4066fd0 2022-09-07T19:43:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.896+0000 7fabf8c9c700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 0x7fabf419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.897+0000 7fabf37fe700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf4196430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fabe800e740 tx=0x7fabe800ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.897+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8005220 con 0x7fabf4066fd0 2022-09-07T19:43:35.904 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.897+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe4009470 con 0x7fabf4066fd0 2022-09-07T19:43:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.897+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fabe8005380 con 0x7fabf4066fd0 2022-09-07T19:43:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.897+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8010ba0 con 0x7fabf4066fd0 2022-09-07T19:43:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.897+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf41a2d20 con 0x7fabf4066fd0 2022-09-07T19:43:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.898+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf4064ea0 con 0x7fabf4066fd0 2022-09-07T19:43:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.900+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fabe801e020 con 0x7fabf4066fd0 2022-09-07T19:43:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.901+0000 7fabf17fa700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fabdc0990d0 0x7fabdc09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.902+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fabe8014070 con 0x7fabf4066fd0 2022-09-07T19:43:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.902+0000 7fabf3fff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fabdc0990d0 0x7fabdc09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.902+0000 7fabf3fff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fabdc0990d0 0x7fabdc09b580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fabe4000c00 tx=0x7fabe4009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:35.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:35.903+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fabe808f320 con 0x7fabf4066fd0 2022-09-07T19:43:36.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.157+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fabf410ff00 con 0x7fabf4066fd0 2022-09-07T19:43:36.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.158+0000 7fabf17fa700 1 -- 172.21.15.80:0/1196521110 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fabe8092940 con 0x7fabf4066fd0 2022-09-07T19:43:36.159 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:36.159 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-09-07T19:43:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fabdc0990d0 msgr2=0x7fabdc09b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fabdc0990d0 0x7fabdc09b580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fabe4000c00 tx=0x7fabe4009eb0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 msgr2=0x7fabf4196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:36.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf4196430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fabe800e740 tx=0x7fabe800ea50 comp rx=0 tx=0).stop 2022-09-07T19:43:36.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 shutdown_connections 2022-09-07T19:43:36.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabf410aa10 0x7fabf419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fabdc0990d0 0x7fabdc09b580 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf40666c0 0x7fabf4195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 --2- 172.21.15.80:0/1196521110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf4066fd0 0x7fabf4196430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.160+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 >> 172.21.15.80:0/1196521110 conn(0x7fabf4073cf0 msgr2=0x7fabf40fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.161+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 shutdown_connections 2022-09-07T19:43:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.161+0000 7fabfa6ff700 1 -- 172.21.15.80:0/1196521110 wait complete. 2022-09-07T19:43:36.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:36 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1196521110' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-09-07T19:43:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:36 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1196521110' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-09-07T19:43:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:36 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1196521110' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-09-07T19:43:36.722 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2022-09-07T19:43:36.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:43:36.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 -- 172.21.15.80:0/2674973561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 msgr2=0x7f1b14108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:36.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/2674973561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b14108240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009b00 tx=0x7f1b0c009e10 comp rx=0 tx=0).stop 2022-09-07T19:43:36.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 -- 172.21.15.80:0/2674973561 shutdown_connections 2022-09-07T19:43:36.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/2674973561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b14108240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/2674973561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b140ffd70 0x7f1b14100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/2674973561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 -- 172.21.15.80:0/2674973561 >> 172.21.15.80:0/2674973561 conn(0x7f1b140fb6b0 msgr2=0x7f1b140fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:36.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 -- 172.21.15.80:0/2674973561 shutdown_connections 2022-09-07T19:43:36.958 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.956+0000 7f1b19f9d700 1 -- 172.21.15.80:0/2674973561 wait complete. 2022-09-07T19:43:36.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.957+0000 7f1b19f9d700 1 Processor -- start 2022-09-07T19:43:36.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 -- start start 2022-09-07T19:43:36.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b140ffd70 0x7f1b14195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:36.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b1419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1419d4a0 con 0x7f1b14100ff0 2022-09-07T19:43:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1419d610 con 0x7f1b14101980 2022-09-07T19:43:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b19f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1419d7d0 con 0x7f1b140ffd70 2022-09-07T19:43:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b13fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b13fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42596/0 (socket says 172.21.15.80:42596) 2022-09-07T19:43:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b13fff700 1 -- 172.21.15.80:0/4104678183 learned_addr learned my addr 172.21.15.80:0/4104678183 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b1979c700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b1419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.958+0000 7f1b18f9b700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b140ffd70 0x7f1b14195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b1979c700 1 -- 172.21.15.80:0/4104678183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b140ffd70 msgr2=0x7f1b14195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b1979c700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b140ffd70 0x7f1b14195920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b1979c700 1 -- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 msgr2=0x7f1b14195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b1979c700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b1979c700 1 -- 172.21.15.80:0/4104678183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009470 con 0x7f1b14101980 2022-09-07T19:43:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b13fff700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b1979c700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b1419ced0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009a20 tx=0x7f1b0c00fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00bbe0 con 0x7f1b14101980 2022-09-07T19:43:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c009730 con 0x7f1b14101980 2022-09-07T19:43:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f1b0c00bd40 con 0x7f1b14101980 2022-09-07T19:43:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0176f0 con 0x7f1b14101980 2022-09-07T19:43:36.967 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.959+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1419dd70 con 0x7f1b14101980 2022-09-07T19:43:36.967 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.960+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1410b530 con 0x7f1b14101980 2022-09-07T19:43:36.968 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.963+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f1b0c027020 con 0x7f1b14101980 2022-09-07T19:43:36.968 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.964+0000 7f1b11ffb700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b04099050 0x7f1b0409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.964+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f1b0c0c41b0 con 0x7f1b14101980 2022-09-07T19:43:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.964+0000 7f1b18f9b700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b04099050 0x7f1b0409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.965+0000 7f1b18f9b700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b04099050 0x7f1b0409b500 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b14100e50 tx=0x7f1b0800b2e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:36.966+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f1b0c090500 con 0x7f1b14101980 2022-09-07T19:43:37.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.159+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b1419e3b0 con 0x7f1b14101980 2022-09-07T19:43:37.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.161+0000 7f1b11ffb700 1 -- 172.21.15.80:0/4104678183 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+23630 (secure 0 0 0) 0x7f1b0c058e60 con 0x7f1b14101980 2022-09-07T19:43:37.161 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:37.162 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:42:43.521940+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:43:37.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b04099050 msgr2=0x7f1b0409b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b04099050 0x7f1b0409b500 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b14100e50 tx=0x7f1b0800b2e0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 msgr2=0x7f1b1419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b1419ced0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009a20 tx=0x7f1b0c00fb70 comp rx=0 tx=0).stop 2022-09-07T19:43:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 shutdown_connections 2022-09-07T19:43:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f1b04099050 0x7f1b0409b500 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b14101980 0x7f1b1419ced0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b140ffd70 0x7f1b14195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 --2- 172.21.15.80:0/4104678183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b14100ff0 0x7f1b14195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 >> 172.21.15.80:0/4104678183 conn(0x7f1b140fb6b0 msgr2=0x7f1b140fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:37.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 shutdown_connections 2022-09-07T19:43:37.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.164+0000 7f1b19f9d700 1 -- 172.21.15.80:0/4104678183 wait complete. 2022-09-07T19:43:37.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-07T19:42:05.026979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-09-07T19:42:06.340517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-07T19:42:10.116527+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-07T19:43:37.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:43:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 -- 172.21.15.80:0/2315411492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fdd00 msgr2=0x7fb8000fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 --2- 172.21.15.80:0/2315411492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fdd00 0x7fb8000fe110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009810 tx=0x7fb7fc009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 -- 172.21.15.80:0/2315411492 shutdown_connections 2022-09-07T19:43:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 --2- 172.21.15.80:0/2315411492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fdd00 0x7fb8000fe110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 --2- 172.21.15.80:0/2315411492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000ff910 0x7fb8001061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 --2- 172.21.15.80:0/2315411492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8000fef80 0x7fb8000ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 -- 172.21.15.80:0/2315411492 >> 172.21.15.80:0/2315411492 conn(0x7fb8000f93f0 msgr2=0x7fb8000fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 -- 172.21.15.80:0/2315411492 shutdown_connections 2022-09-07T19:43:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.423+0000 7fb8073ff700 1 -- 172.21.15.80:0/2315411492 wait complete. 2022-09-07T19:43:37.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.424+0000 7fb8073ff700 1 Processor -- start 2022-09-07T19:43:37.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 -- start start 2022-09-07T19:43:37.428 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000fdd00 0x7fb800195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 0x7fb8001960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8000ff910 0x7fb80019d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80019d6f0 con 0x7fb8000fef80 2022-09-07T19:43:37.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80019d860 con 0x7fb8000fdd00 2022-09-07T19:43:37.430 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb8073ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80019da20 con 0x7fb8000ff910 2022-09-07T19:43:37.430 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb80499a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 0x7fb8001960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb80519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000fdd00 0x7fb800195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb80499a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 0x7fb8001960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42620/0 (socket says 172.21.15.80:42620) 2022-09-07T19:43:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.425+0000 7fb80499a700 1 -- 172.21.15.80:0/4113573564 learned_addr learned my addr 172.21.15.80:0/4113573564 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80599c700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8000ff910 0x7fb80019d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80519b700 1 -- 172.21.15.80:0/4113573564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8000ff910 msgr2=0x7fb80019d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80519b700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8000ff910 0x7fb80019d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80519b700 1 -- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 msgr2=0x7fb8001960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80519b700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 0x7fb8001960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80519b700 1 -- 172.21.15.80:0/4113573564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009470 con 0x7fb8000fdd00 2022-09-07T19:43:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80499a700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 0x7fb8001960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb80519b700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000fdd00 0x7fb800195b70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc006010 tx=0x7fb7fc00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc01d070 con 0x7fb8000fdd00 2022-09-07T19:43:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.426+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80019dca0 con 0x7fb8000fdd00 2022-09-07T19:43:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.427+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb7fc00f880 con 0x7fb8000fdd00 2022-09-07T19:43:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.427+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc004860 con 0x7fb8000fdd00 2022-09-07T19:43:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.427+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80019e1a0 con 0x7fb8000fdd00 2022-09-07T19:43:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.428+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8001094b0 con 0x7fb8000fdd00 2022-09-07T19:43:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.429+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fb7fc028030 con 0x7fb8000fdd00 2022-09-07T19:43:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.431+0000 7fb7f67fc700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7ec099050 0x7fb7ec09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.431+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fb7fc0c32a0 con 0x7fb8000fdd00 2022-09-07T19:43:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.431+0000 7fb80499a700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7ec099050 0x7fb7ec09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.432+0000 7fb80499a700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7ec099050 0x7fb7ec09b500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00057d0 tx=0x7fb7f000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.433+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb7fc08f5f0 con 0x7fb8000fdd00 2022-09-07T19:43:37.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:37 smithi080 ceph-mon[90124]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:43:37.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:37 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4104678183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:43:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:37 smithi154 ceph-mon[96967]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:43:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:37 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4104678183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:43:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.624+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb80019e980 con 0x7fb8000fdd00 2022-09-07T19:43:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.625+0000 7fb7f67fc700 1 -- 172.21.15.80:0/4113573564 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7fc026020 con 0x7fb8000fdd00 2022-09-07T19:43:37.625 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:43:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7ec099050 msgr2=0x7fb7ec09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7ec099050 0x7fb7ec09b500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00057d0 tx=0x7fb7f000b390 comp rx=0 tx=0).stop 2022-09-07T19:43:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000fdd00 msgr2=0x7fb800195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000fdd00 0x7fb800195b70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc006010 tx=0x7fb7fc00f690 comp rx=0 tx=0).stop 2022-09-07T19:43:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 shutdown_connections 2022-09-07T19:43:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb7ec099050 0x7fb7ec09b500 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8000ff910 0x7fb80019d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8000fdd00 0x7fb800195b70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 --2- 172.21.15.80:0/4113573564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8000fef80 0x7fb8001960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 >> 172.21.15.80:0/4113573564 conn(0x7fb8000f93f0 msgr2=0x7fb8000fb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 shutdown_connections 2022-09-07T19:43:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.628+0000 7fb8073ff700 1 -- 172.21.15.80:0/4113573564 wait complete. 2022-09-07T19:43:37.654 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-07T19:43:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:37 smithi155 ceph-mon[97606]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:43:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:37 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4104678183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:43:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2534475828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fdd00 msgr2=0x7f90a80fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2534475828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fdd00 0x7f90a80fe110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9098009810 tx=0x7f9098009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2534475828 shutdown_connections 2022-09-07T19:43:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2534475828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90a80ff910 0x7f90a81061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2534475828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fdd00 0x7f90a80fe110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2534475828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fef80 0x7f90a80ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2534475828 >> 172.21.15.80:0/2534475828 conn(0x7f90a80f93f0 msgr2=0x7f90a80fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:37.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2534475828 shutdown_connections 2022-09-07T19:43:37.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.884+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2534475828 wait complete. 2022-09-07T19:43:37.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.885+0000 7f90ad5ff700 1 Processor -- start 2022-09-07T19:43:37.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 -- start start 2022-09-07T19:43:37.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 0x7f90a8195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fef80 0x7f90a81960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90a80ff910 0x7f90a819d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a819d6f0 con 0x7f90a80fdd00 2022-09-07T19:43:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a819d860 con 0x7f90a80ff910 2022-09-07T19:43:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90ad5ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a819da20 con 0x7f90a80fef80 2022-09-07T19:43:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90a6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 0x7f90a8195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90a6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 0x7f90a8195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42640/0 (socket says 172.21.15.80:42640) 2022-09-07T19:43:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90a6ffd700 1 -- 172.21.15.80:0/2362775266 learned_addr learned my addr 172.21.15.80:0/2362775266 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90a77fe700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90a80ff910 0x7f90a819d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.886+0000 7f90a67fc700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fef80 0x7f90a81960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.904 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90a6ffd700 1 -- 172.21.15.80:0/2362775266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fef80 msgr2=0x7f90a81960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.904 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90a6ffd700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fef80 0x7f90a81960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90a6ffd700 1 -- 172.21.15.80:0/2362775266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90a80ff910 msgr2=0x7f90a819d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:37.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90a6ffd700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90a80ff910 0x7f90a819d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90a6ffd700 1 -- 172.21.15.80:0/2362775266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098009470 con 0x7f90a80fdd00 2022-09-07T19:43:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90a6ffd700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 0x7f90a8195b70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9098006010 tx=0x7f909800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909801d070 con 0x7f90a80fdd00 2022-09-07T19:43:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a819dca0 con 0x7f90a80fdd00 2022-09-07T19:43:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f909800f8b0 con 0x7f90a80fdd00 2022-09-07T19:43:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980047f0 con 0x7f90a80fdd00 2022-09-07T19:43:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.887+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a819e1a0 con 0x7f90a80fdd00 2022-09-07T19:43:37.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.888+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a81094b0 con 0x7f90a80fdd00 2022-09-07T19:43:37.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.890+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f9098028030 con 0x7f90a80fdd00 2022-09-07T19:43:37.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.891+0000 7f908bfff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9090099050 0x7f909009b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:37.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.892+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f90980c33a0 con 0x7f90a80fdd00 2022-09-07T19:43:37.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.892+0000 7f90a67fc700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9090099050 0x7f909009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:37.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.892+0000 7f90a67fc700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9090099050 0x7f909009b500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f909c005fd0 tx=0x7f909c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:37.913 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:37.895+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f909808f750 con 0x7f90a80fdd00 2022-09-07T19:43:38.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.088+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90a819e9b0 con 0x7f90a80fdd00 2022-09-07T19:43:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.088+0000 7f908bfff700 1 -- 172.21.15.80:0/2362775266 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9098092d70 con 0x7f90a80fdd00 2022-09-07T19:43:38.088 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:43:38.090 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9090099050 msgr2=0x7f909009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9090099050 0x7f909009b500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f909c005fd0 tx=0x7f909c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 msgr2=0x7f90a8195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 0x7f90a8195b70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9098006010 tx=0x7f909800f690 comp rx=0 tx=0).stop 2022-09-07T19:43:38.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 shutdown_connections 2022-09-07T19:43:38.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90a80fdd00 0x7f90a8195b70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9090099050 0x7f909009b500 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90a80ff910 0x7f90a819d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 --2- 172.21.15.80:0/2362775266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90a80fef80 0x7f90a81960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 >> 172.21.15.80:0/2362775266 conn(0x7f90a80f93f0 msgr2=0x7f90a80fb720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:38.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 shutdown_connections 2022-09-07T19:43:38.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.091+0000 7f90ad5ff700 1 -- 172.21.15.80:0/2362775266 wait complete. 2022-09-07T19:43:38.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-07T19:43:38.348 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.348+0000 7f14f77ff700 1 -- 172.21.15.80:0/3364796478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00fefc0 msgr2=0x7f14f00ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.348+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3364796478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00fefc0 0x7f14f00ff410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009810 tx=0x7f14e0009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:38.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 -- 172.21.15.80:0/3364796478 shutdown_connections 2022-09-07T19:43:38.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3364796478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f00fdd40 0x7f14f00fe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.349 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3364796478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14f00ff950 0x7f14f0106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3364796478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00fefc0 0x7f14f00ff410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 -- 172.21.15.80:0/3364796478 >> 172.21.15.80:0/3364796478 conn(0x7f14f00f9430 msgr2=0x7f14f00fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:38.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 -- 172.21.15.80:0/3364796478 shutdown_connections 2022-09-07T19:43:38.350 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.349+0000 7f14f77ff700 1 -- 172.21.15.80:0/3364796478 wait complete. 2022-09-07T19:43:38.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 Processor -- start 2022-09-07T19:43:38.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 -- start start 2022-09-07T19:43:38.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14f00fdd40 0x7f14f0072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.353 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f00fefc0 0x7f14f00710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 0x7f14f0071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0071b50 con 0x7f14f00fefc0 2022-09-07T19:43:38.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0071cc0 con 0x7f14f00ff950 2022-09-07T19:43:38.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.350+0000 7f14f77ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0071e80 con 0x7f14f00fdd40 2022-09-07T19:43:38.354 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 0x7f14f0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 0x7f14f0071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:55526/0 (socket says 172.21.15.80:55526) 2022-09-07T19:43:38.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f559b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14f00fdd40 0x7f14f0072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.355 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 -- 172.21.15.80:0/3367779404 learned_addr learned my addr 172.21.15.80:0/3367779404 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:38.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f4d9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f00fefc0 0x7f14f00710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.356 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 -- 172.21.15.80:0/3367779404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14f00fdd40 msgr2=0x7f14f0072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14f00fdd40 0x7f14f0072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.357 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 -- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f00fefc0 msgr2=0x7f14f00710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f00fefc0 0x7f14f00710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.358 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 -- 172.21.15.80:0/3367779404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0009470 con 0x7f14f00ff950 2022-09-07T19:43:38.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.351+0000 7f14f5d9c700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 0x7f14f0071610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14e800eaf0 tx=0x7f14e800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:38.359 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.352+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8009960 con 0x7f14f00ff950 2022-09-07T19:43:38.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.352+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f14e800ce70 con 0x7f14f00ff950 2022-09-07T19:43:38.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.352+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80058b0 con 0x7f14f00ff950 2022-09-07T19:43:38.360 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.352+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f01a2180 con 0x7f14f00ff950 2022-09-07T19:43:38.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.352+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f01a25b0 con 0x7f14f00ff950 2022-09-07T19:43:38.361 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.353+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f01094f0 con 0x7f14f00ff950 2022-09-07T19:43:38.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.355+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f14e801e020 con 0x7f14f00ff950 2022-09-07T19:43:38.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.356+0000 7f14e67fc700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f14dc0990d0 0x7f14dc09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.356+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f14e8014070 con 0x7f14f00ff950 2022-09-07T19:43:38.363 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.356+0000 7f14f559b700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f14dc0990d0 0x7f14dc09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.357+0000 7f14f559b700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f14dc0990d0 0x7f14dc09b580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f14f00fee20 tx=0x7f14ec005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:38.364 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.358+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f14e808f280 con 0x7f14f00ff950 2022-09-07T19:43:38.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:38 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4113573564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:43:38.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:38 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2362775266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:43:38.549 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.550+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14f0105230 con 0x7f14f00ff950 2022-09-07T19:43:38.550 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.551+0000 7f14e67fc700 1 -- 172.21.15.80:0/3367779404 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14e80928a0 con 0x7f14f00ff950 2022-09-07T19:43:38.550 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2022-09-07T19:43:38.553 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f14dc0990d0 msgr2=0x7f14dc09b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.553 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f14dc0990d0 0x7f14dc09b580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f14f00fee20 tx=0x7f14ec005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.553 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 msgr2=0x7f14f0071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.554 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 0x7f14f0071610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14e800eaf0 tx=0x7f14e800ee00 comp rx=0 tx=0).stop 2022-09-07T19:43:38.554 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 shutdown_connections 2022-09-07T19:43:38.554 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f14dc0990d0 0x7f14dc09b580 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.554 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f00ff950 0x7f14f0071610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.555 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14f00fdd40 0x7f14f0072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.555 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 --2- 172.21.15.80:0/3367779404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f00fefc0 0x7f14f00710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.555 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.553+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 >> 172.21.15.80:0/3367779404 conn(0x7f14f00f9430 msgr2=0x7f14f01024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:38.555 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.554+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 shutdown_connections 2022-09-07T19:43:38.556 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.554+0000 7f14f77ff700 1 -- 172.21.15.80:0/3367779404 wait complete. 2022-09-07T19:43:38.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-07T19:43:38.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:38 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4113573564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:43:38.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:38 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2362775266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:43:38.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:38 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4113573564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:43:38.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:38 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2362775266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:43:38.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 -- 172.21.15.80:0/86746960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300ff910 msgr2=0x7f6f301061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 --2- 172.21.15.80:0/86746960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300ff910 0x7f6f301061d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009b00 tx=0x7f6f28009e10 comp rx=0 tx=0).stop 2022-09-07T19:43:38.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 -- 172.21.15.80:0/86746960 shutdown_connections 2022-09-07T19:43:38.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 --2- 172.21.15.80:0/86746960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300fdd00 0x7f6f300fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 --2- 172.21.15.80:0/86746960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300ff910 0x7f6f301061d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 --2- 172.21.15.80:0/86746960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fef80 0x7f6f300ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 -- 172.21.15.80:0/86746960 >> 172.21.15.80:0/86746960 conn(0x7f6f300f93f0 msgr2=0x7f6f300fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:38.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 -- 172.21.15.80:0/86746960 shutdown_connections 2022-09-07T19:43:38.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.809+0000 7f6f34bff700 1 -- 172.21.15.80:0/86746960 wait complete. 2022-09-07T19:43:38.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.810+0000 7f6f34bff700 1 Processor -- start 2022-09-07T19:43:38.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 -- start start 2022-09-07T19:43:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fdd00 0x7f6f30195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300fef80 0x7f6f30196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300ff910 0x7f6f3019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3019d6b0 con 0x7f6f300ff910 2022-09-07T19:43:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3019d820 con 0x7f6f300fef80 2022-09-07T19:43:38.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f34bff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3019d9e0 con 0x7f6f300fdd00 2022-09-07T19:43:38.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f2dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300fef80 0x7f6f30196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f2ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300ff910 0x7f6f3019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f2e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fdd00 0x7f6f30195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f2dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300fef80 0x7f6f30196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:55556/0 (socket says 172.21.15.80:55556) 2022-09-07T19:43:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f2dd9b700 1 -- 172.21.15.80:0/1942687448 learned_addr learned my addr 172.21.15.80:0/1942687448 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.811+0000 7f6f2e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fdd00 0x7f6f30195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34242/0 (socket says 172.21.15.80:34242) 2022-09-07T19:43:38.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f2ed9d700 1 -- 172.21.15.80:0/1942687448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fdd00 msgr2=0x7f6f30195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f2ed9d700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fdd00 0x7f6f30195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f2ed9d700 1 -- 172.21.15.80:0/1942687448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300fef80 msgr2=0x7f6f30196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:38.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f2ed9d700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300fef80 0x7f6f30196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:38.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f2ed9d700 1 -- 172.21.15.80:0/1942687448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009730 con 0x7f6f300ff910 2022-09-07T19:43:38.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f2ed9d700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300ff910 0x7f6f3019d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009a20 tx=0x7f6f2800f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:38.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800b9e0 con 0x7f6f300ff910 2022-09-07T19:43:38.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3019dc60 con 0x7f6f300ff910 2022-09-07T19:43:38.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f6f28005040 con 0x7f6f300ff910 2022-09-07T19:43:38.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.812+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28017660 con 0x7f6f300ff910 2022-09-07T19:43:38.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.813+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3019e130 con 0x7f6f300ff910 2022-09-07T19:43:38.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.814+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f301094c0 con 0x7f6f300ff910 2022-09-07T19:43:38.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.815+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f6f28027020 con 0x7f6f300ff910 2022-09-07T19:43:38.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.817+0000 7f6f1f7fe700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6f18099050 0x7f6f1809b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.817+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f6f280c3e70 con 0x7f6f300ff910 2022-09-07T19:43:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.817+0000 7f6f2e59c700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6f18099050 0x7f6f1809b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.818+0000 7f6f2e59c700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6f18099050 0x7f6f1809b500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f300fede0 tx=0x7f6f20005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:38.821+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f6f280901c0 con 0x7f6f300ff910 2022-09-07T19:43:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.011+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6f3019e960 con 0x7f6f300ff910 2022-09-07T19:43:39.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.012+0000 7f6f1f7fe700 1 -- 172.21.15.80:0/1942687448 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6f280937e0 con 0x7f6f300ff910 2022-09-07T19:43:39.012 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:43:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.014+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6f18099050 msgr2=0x7f6f1809b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6f18099050 0x7f6f1809b500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f300fede0 tx=0x7f6f20005f60 comp rx=0 tx=0).stop 2022-09-07T19:43:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300ff910 msgr2=0x7f6f3019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300ff910 0x7f6f3019d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009a20 tx=0x7f6f2800f870 comp rx=0 tx=0).stop 2022-09-07T19:43:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 shutdown_connections 2022-09-07T19:43:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f300ff910 0x7f6f3019d0e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f6f18099050 0x7f6f1809b500 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f300fdd00 0x7f6f30195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 --2- 172.21.15.80:0/1942687448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f300fef80 0x7f6f30196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 >> 172.21.15.80:0/1942687448 conn(0x7f6f300f93f0 msgr2=0x7f6f300fb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 shutdown_connections 2022-09-07T19:43:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.015+0000 7f6f34bff700 1 -- 172.21.15.80:0/1942687448 wait complete. 2022-09-07T19:43:39.042 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:43:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.269+0000 7f9fc699d700 1 -- 172.21.15.80:0/136253497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0101980 msgr2=0x7f9fc0108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.269+0000 7f9fc699d700 1 --2- 172.21.15.80:0/136253497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0101980 0x7f9fc0108220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009bb0 tx=0x7f9fb8009ec0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 -- 172.21.15.80:0/136253497 shutdown_connections 2022-09-07T19:43:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 --2- 172.21.15.80:0/136253497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0101980 0x7f9fc0108220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 --2- 172.21.15.80:0/136253497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 --2- 172.21.15.80:0/136253497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc0100fd0 0x7f9fc0101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 -- 172.21.15.80:0/136253497 >> 172.21.15.80:0/136253497 conn(0x7f9fc00fb4d0 msgr2=0x7f9fc00fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 -- 172.21.15.80:0/136253497 shutdown_connections 2022-09-07T19:43:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.270+0000 7f9fc699d700 1 -- 172.21.15.80:0/136253497 wait complete. 2022-09-07T19:43:39.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 Processor -- start 2022-09-07T19:43:39.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 -- start start 2022-09-07T19:43:39.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0100fd0 0x7f9fc0195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc0101980 0x7f9fc019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc019d3e0 con 0x7f9fc0101980 2022-09-07T19:43:39.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc019d550 con 0x7f9fc0100fd0 2022-09-07T19:43:39.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.271+0000 7f9fc699d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc019d710 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34264/0 (socket says 172.21.15.80:34264) 2022-09-07T19:43:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 -- 172.21.15.80:0/4128345077 learned_addr learned my addr 172.21.15.80:0/4128345077 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc519a700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0100fd0 0x7f9fc0195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc619c700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc0101980 0x7f9fc019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 -- 172.21.15.80:0/4128345077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0100fd0 msgr2=0x7f9fc0195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0100fd0 0x7f9fc0195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 -- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc0101980 msgr2=0x7f9fc019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc0101980 0x7f9fc019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc599b700 1 -- 172.21.15.80:0/4128345077 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80097e0 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.272+0000 7f9fc519a700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0100fd0 0x7f9fc0195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.273+0000 7f9fc599b700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0195860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00e740 tx=0x7f9fbc00ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.273+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc005220 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.273+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc019d9f0 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.273+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f9fbc005380 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.273+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc004b70 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.273+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc019df00 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.274+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc010b4b0 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.276+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f9fbc01e020 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.277+0000 7f9fb6ffd700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9fac099050 0x7f9fac09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.277+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f9fbc014070 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.277+0000 7f9fc519a700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9fac099050 0x7f9fac09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.278+0000 7f9fc519a700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9fac099050 0x7f9fac09b500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0005fd0 tx=0x7f9fb0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.284 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.281+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f9fbc08ebe0 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:39 smithi080 ceph-mon[90124]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:39.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:39 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3367779404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:43:39.369 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:39 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1942687448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:43:39.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.523+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fc005f120 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.529 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.525+0000 7f9fb6ffd700 1 -- 172.21.15.80:0/4128345077 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10733 (secure 0 0 0) 0x7f9fbc092200 con 0x7f9fc00ffdf0 2022-09-07T19:43:39.529 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:39.530 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-07T19:42:06.917499+0000","modified":"2022-09-07T19:42:38.506873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24575,"mds_1":24569,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24500":{"gid":24500,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24569":{"gid":24569,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-07T19:43:39.531 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9fac099050 msgr2=0x7f9fac09b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.531 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9fac099050 0x7f9fac09b500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0005fd0 tx=0x7f9fb0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.532 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 msgr2=0x7f9fc0195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.532 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0195860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00e740 tx=0x7f9fbc00ea50 comp rx=0 tx=0).stop 2022-09-07T19:43:39.532 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 shutdown_connections 2022-09-07T19:43:39.532 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc0101980 0x7f9fc019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.533 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9fac099050 0x7f9fac09b500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.533 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc00ffdf0 0x7f9fc0195860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.533 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 --2- 172.21.15.80:0/4128345077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc0100fd0 0x7f9fc0195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.533 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 >> 172.21.15.80:0/4128345077 conn(0x7f9fc00fb4d0 msgr2=0x7f9fc00fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.534 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 shutdown_connections 2022-09-07T19:43:39.534 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.527+0000 7f9fc699d700 1 -- 172.21.15.80:0/4128345077 wait complete. 2022-09-07T19:43:39.534 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2022-09-07T19:43:39.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2022-09-07T19:42:06.917499+0000', 'modified': '2022-09-07T19:42:38.506873+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24575, 'mds_1': 24569, 'mds_2': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24500': {'gid': 24500, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/1088711156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1088711156}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1088711156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6837/415293574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 415293574}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 415293574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6839/560140413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 560140413}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 560140413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.154:6837/2976291086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 2976291086}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 2976291086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24569': {'gid': 24569, 'name': 'a', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.80:6841/1430605646', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6840', 'nonce': 1430605646}, {'type': 'v1', 'addr': '172.21.15.80:6841', 'nonce': 1430605646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6839/545932828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 545932828}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 545932828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-09-07T19:43:39.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2022-09-07T19:43:39.555 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2022-09-07T19:43:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:39 smithi154 ceph-mon[96967]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:39 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3367779404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:43:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:39 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1942687448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:43:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:39 smithi155 ceph-mon[97606]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:39 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3367779404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:43:39.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:39 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1942687448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:43:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 -- 172.21.15.80:0/1088474272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c101b30 msgr2=0x7fea9c1083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 --2- 172.21.15.80:0/1088474272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c101b30 0x7fea9c1083f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fea94009bb0 tx=0x7fea94009ec0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 -- 172.21.15.80:0/1088474272 shutdown_connections 2022-09-07T19:43:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 --2- 172.21.15.80:0/1088474272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c101b30 0x7fea9c1083f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 --2- 172.21.15.80:0/1088474272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c0fff20 0x7fea9c100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 --2- 172.21.15.80:0/1088474272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c1011a0 0x7fea9c1015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 -- 172.21.15.80:0/1088474272 >> 172.21.15.80:0/1088474272 conn(0x7fea9c0fb6b0 msgr2=0x7fea9c0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 -- 172.21.15.80:0/1088474272 shutdown_connections 2022-09-07T19:43:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.784+0000 7feaa3bff700 1 -- 172.21.15.80:0/1088474272 wait complete. 2022-09-07T19:43:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.785+0000 7feaa3bff700 1 Processor -- start 2022-09-07T19:43:39.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 -- start start 2022-09-07T19:43:39.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 0x7fea9c195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 0x7fea9c196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101b30 0x7fea9c19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c19d6a0 con 0x7fea9c1011a0 2022-09-07T19:43:39.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c19d810 con 0x7fea9c101b30 2022-09-07T19:43:39.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa3bff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c19d9d0 con 0x7fea9c0fff20 2022-09-07T19:43:39.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa119a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 0x7fea9c196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa199b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 0x7fea9c195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa219c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101b30 0x7fea9c19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa199b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 0x7fea9c195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34280/0 (socket says 172.21.15.80:34280) 2022-09-07T19:43:39.792 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa119a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 0x7fea9c196060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42710/0 (socket says 172.21.15.80:42710) 2022-09-07T19:43:39.792 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.786+0000 7feaa199b700 1 -- 172.21.15.80:0/419009146 learned_addr learned my addr 172.21.15.80:0/419009146 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:39.792 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa199b700 1 -- 172.21.15.80:0/419009146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101b30 msgr2=0x7fea9c19d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.792 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa199b700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101b30 0x7fea9c19d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa199b700 1 -- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 msgr2=0x7fea9c196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa199b700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 0x7fea9c196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa199b700 1 -- 172.21.15.80:0/419009146 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940097e0 con 0x7fea9c0fff20 2022-09-07T19:43:39.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa119a700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 0x7fea9c196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:39.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa199b700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 0x7fea9c195b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e710 tx=0x7fea9800ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7fea92ffd700 1 -- 172.21.15.80:0/419009146 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98004220 con 0x7fea9c0fff20 2022-09-07T19:43:39.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7fea92ffd700 1 -- 172.21.15.80:0/419009146 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fea98004380 con 0x7fea9c0fff20 2022-09-07T19:43:39.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.787+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c19dcb0 con 0x7fea9c0fff20 2022-09-07T19:43:39.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.788+0000 7fea92ffd700 1 -- 172.21.15.80:0/419009146 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98003cf0 con 0x7fea9c0fff20 2022-09-07T19:43:39.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.788+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c19e1c0 con 0x7fea9c0fff20 2022-09-07T19:43:39.802 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.791+0000 7fea92ffd700 1 -- 172.21.15.80:0/419009146 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7fea9801e020 con 0x7fea9c0fff20 2022-09-07T19:43:39.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.792+0000 7feab712cb80 1 Processor -- start 2022-09-07T19:43:39.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 -- start start 2022-09-07T19:43:39.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ac6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e49af080 con 0x55e5e4ac61f0 2022-09-07T19:43:39.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4a199e0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7feab712cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4a13180 con 0x55e5e4ac5430 2022-09-07T19:43:39.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.793+0000 7fea92ffd700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fea88099050 0x7fea8809b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa119a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ac6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa119a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ac6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42720/0 (socket says 172.21.15.80:42720) 2022-09-07T19:43:39.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7fea92ffd700 1 -- 172.21.15.80:0/419009146 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fea98014070 con 0x7fea9c0fff20 2022-09-07T19:43:39.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa119a700 1 -- 172.21.15.80:0/1948281021 learned_addr learned my addr 172.21.15.80:0/1948281021 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:39.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa219c700 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa219c700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fea88099050 0x7fea8809b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 -- 172.21.15.80:0/1948281021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 msgr2=0x55e5e4ac4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 -- 172.21.15.80:0/1948281021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 msgr2=0x55e5e4ac6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ac6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 -- 172.21.15.80:0/1948281021 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5e489b5e0 con 0x55e5e4ac5430 2022-09-07T19:43:39.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa119a700 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ac6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:39.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.794+0000 7feaa199b700 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac5c60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea980c2a20 tx=0x7fea980c0380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4126cbfbafd1986 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7fea87fff700 1 -- 172.21.15.80:0/1948281021 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980a8070 con 0x55e5e4ac5430 2022-09-07T19:43:39.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7fea87fff700 1 -- 172.21.15.80:0/1948281021 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fea98003e50 con 0x55e5e4ac5430 2022-09-07T19:43:39.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7fea87fff700 1 -- 172.21.15.80:0/1948281021 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98092bf0 con 0x55e5e4ac5430 2022-09-07T19:43:39.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 -- 172.21.15.80:0/1948281021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac5430 msgr2=0x55e5e4ac5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac5c60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea980c2a20 tx=0x7fea980c0380 comp rx=0 tx=0).stop 2022-09-07T19:43:39.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feaa219c700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fea88099050 0x7fea8809b500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea94009b80 tx=0x7fea94005ae0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 -- 172.21.15.80:0/1948281021 shutdown_connections 2022-09-07T19:43:39.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ac6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 --2- 172.21.15.80:0/1948281021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac5c60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 -- 172.21.15.80:0/1948281021 >> 172.21.15.80:0/1948281021 conn(0x55e5e4ac0fa0 msgr2=0x55e5e4abf370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 -- 172.21.15.80:0/1948281021 shutdown_connections 2022-09-07T19:43:39.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.795+0000 7feab712cb80 1 -- 172.21.15.80:0/1948281021 wait complete. 2022-09-07T19:43:39.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.796+0000 7feab712cb80 1 -- start start 2022-09-07T19:43:39.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.796+0000 7feab712cb80 1 Processor -- start 2022-09-07T19:43:39.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ace540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4acea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e49010c0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4ad6000 con 0x55e5e4ac5430 2022-09-07T19:43:39.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4ad6190 con 0x55e5e4ac61f0 2022-09-07T19:43:39.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feab712cb80 10 client.0 _ll_register_callbacks cb 0x55e5e49be370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:43:39.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ace540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa219c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ace540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42734/0 (socket says 172.21.15.80:42734) 2022-09-07T19:43:39.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 -- 172.21.15.80:0/569283888 learned_addr learned my addr 172.21.15.80:0/569283888 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:39.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa119a700 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4acea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 -- 172.21.15.80:0/569283888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 msgr2=0x55e5e4ad5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 -- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 msgr2=0x55e5e4acea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4acea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.797+0000 7feaa199b700 1 -- 172.21.15.80:0/569283888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c009c00 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7feaa199b700 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ace540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e6e0 tx=0x7fea98003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4bb30956830da7 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7fea857fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:43:39.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7fea857fa700 1 -- 172.21.15.80:0/569283888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980a8070 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7fea857fa700 1 -- 172.21.15.80:0/569283888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fea98092990 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5e4ab7aa0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7fea857fa700 1 -- 172.21.15.80:0/569283888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea98093090 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7feab712cb80 10 client.15003 fetch_fsmap learned FSMap version 24 2022-09-07T19:43:39.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.798+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fea9c19e1c0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7fea857fa700 1 -- 172.21.15.80:0/569283888 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x55e5e4ab7aa0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7fea857fa700 1 -- 172.21.15.80:0/569283888 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fea980a9cd0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feab712cb80 10 client.15003 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:43:39.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feab712cb80 10 client.15003 resolve_mds: resolved name 'h' to daemon mds.h 2022-09-07T19:43:39.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feab712cb80 20 client.15003 populate_metadata read hostname 'smithi080' 2022-09-07T19:43:39.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feab712cb80 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4ad9580 0x55e5e4ade840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feab712cb80 4 client.15003 mds_command: new command op to 24533 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:43:39.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 --> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5e4a944c0 con 0x55e5e4ad9580 2022-09-07T19:43:39.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.799+0000 7feaa119a700 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4ad9580 0x55e5e4ade840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.800+0000 7fea857fa700 10 client.15003 ms_handle_connect on v2:172.21.15.154:6836/2976291086 2022-09-07T19:43:39.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.800+0000 7feaa119a700 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4ad9580 0x55e5e4ade840 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f4d5c6812a633190 server_cookie=1e99cf2b8d79c7c3 in_seq=0 out_seq=0 2022-09-07T19:43:39.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7fea857fa700 1 -- 172.21.15.80:0/569283888 <== mds.2 v2:172.21.15.154:6836/2976291086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x55e5e4a944c0 con 0x55e5e4ad9580 2022-09-07T19:43:39.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7fea857fa700 10 client.15003 handle_command_reply: tid=0 2022-09-07T19:43:39.823 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 client.15003 shutdown 2022-09-07T19:43:39.823 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 msgr2=0x55e5e4ace540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.823 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ace540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e6e0 tx=0x7fea98003710 comp rx=0 tx=0).stop 2022-09-07T19:43:39.823 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 shutdown_connections 2022-09-07T19:43:39.824 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4ad9580 0x55e5e4ade840 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.824 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ace540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.824 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7fea857fa700 0 client.15003 ms_handle_reset on v2:172.21.15.154:6836/2976291086 2022-09-07T19:43:39.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 --2- 172.21.15.80:0/569283888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4acea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 >> 172.21.15.80:0/569283888 conn(0x55e5e4ac0fa0 msgr2=0x55e5e4abea40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 shutdown_connections 2022-09-07T19:43:39.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.801+0000 7feab712cb80 1 -- 172.21.15.80:0/569283888 wait complete. 2022-09-07T19:43:39.826 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.802+0000 7feab712cb80 20 client.15003 trim_cache size 0 max 16384 2022-09-07T19:43:39.832 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 Processor -- start 2022-09-07T19:43:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 -- start start 2022-09-07T19:43:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ace2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4aba330 con 0x55e5e4ac5430 2022-09-07T19:43:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4a944c0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.819+0000 7feab712cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4925ed0 con 0x55e5e4ac61f0 2022-09-07T19:43:39.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa219c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ace2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa219c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ace2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34312/0 (socket says 172.21.15.80:34312) 2022-09-07T19:43:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa219c700 1 -- 172.21.15.80:0/3260124179 learned_addr learned my addr 172.21.15.80:0/3260124179 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:39.835 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa119a700 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 -- 172.21.15.80:0/3260124179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 msgr2=0x55e5e4ace2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ace2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 -- 172.21.15.80:0/3260124179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac5430 msgr2=0x55e5e4ac93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 -- 172.21.15.80:0/3260124179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5e4847d90 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa219c700 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ace2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa119a700 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:39.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.820+0000 7feaa199b700 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac8e90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea9800ed70 tx=0x7fea980c0380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c17c2834775bc0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7fea90bff700 1 -- 172.21.15.80:0/3260124179 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980a8040 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7fea90bff700 1 -- 172.21.15.80:0/3260124179 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fea9800c950 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7fea90bff700 1 -- 172.21.15.80:0/3260124179 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98099c30 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 -- 172.21.15.80:0/3260124179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 msgr2=0x55e5e4ac8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac8e90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea9800ed70 tx=0x7fea980c0380 comp rx=0 tx=0).stop 2022-09-07T19:43:39.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 -- 172.21.15.80:0/3260124179 shutdown_connections 2022-09-07T19:43:39.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ace2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ac8e90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 --2- 172.21.15.80:0/3260124179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac5430 0x55e5e4ac93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 -- 172.21.15.80:0/3260124179 >> 172.21.15.80:0/3260124179 conn(0x55e5e4ac0fa0 msgr2=0x55e5e4ae2860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 -- 172.21.15.80:0/3260124179 shutdown_connections 2022-09-07T19:43:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.821+0000 7feab712cb80 1 -- 172.21.15.80:0/3260124179 wait complete. 2022-09-07T19:43:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 -- start start 2022-09-07T19:43:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 Processor -- start 2022-09-07T19:43:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ad2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4ad26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4b2b7e0 con 0x55e5e4ac61f0 2022-09-07T19:43:39.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4b2b920 con 0x55e5e4ac5430 2022-09-07T19:43:39.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.822+0000 7feab712cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5e4b2bab0 con 0x55e5e4ac4ae0 2022-09-07T19:43:39.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feab712cb80 10 client.0 _ll_register_callbacks cb 0x55e5e49be370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:43:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa119a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4ad26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42752/0 (socket says 172.21.15.80:42752) 2022-09-07T19:43:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 -- 172.21.15.80:0/719478639 learned_addr learned my addr 172.21.15.80:0/719478639 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:39.844 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa199b700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ad2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.844 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 -- 172.21.15.80:0/719478639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac4ae0 msgr2=0x55e5e4ad2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.844 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ad2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.844 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 -- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 msgr2=0x55e5e4ad26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:39.845 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4ad26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.845 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa219c700 1 -- 172.21.15.80:0/719478639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c012170 con 0x55e5e4ac61f0 2022-09-07T19:43:39.845 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.823+0000 7feaa119a700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4ad26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:39.845 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7feaa219c700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad2c00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea9400bed0 tx=0x7fea940094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934d7ac03a385fc9 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:39.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7fea857fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:43:39.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7fea857fa700 1 -- 172.21.15.80:0/719478639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94005040 con 0x55e5e4ac61f0 2022-09-07T19:43:39.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5e4a0c6f0 con 0x55e5e4ac61f0 2022-09-07T19:43:39.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7fea857fa700 1 -- 172.21.15.80:0/719478639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7fea940051a0 con 0x55e5e4ac61f0 2022-09-07T19:43:39.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7fea857fa700 1 -- 172.21.15.80:0/719478639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea94005360 con 0x55e5e4ac61f0 2022-09-07T19:43:39.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7feab712cb80 10 client.15009 fetch_fsmap learned FSMap version 24 2022-09-07T19:43:39.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fea94020070 con 0x55e5e4ac61f0 2022-09-07T19:43:39.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7fea857fa700 1 -- 172.21.15.80:0/719478639 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x55e5e4a0c6f0 con 0x55e5e4ac61f0 2022-09-07T19:43:39.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.824+0000 7fea857fa700 1 -- 172.21.15.80:0/719478639 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fea94031070 con 0x55e5e4ac61f0 2022-09-07T19:43:39.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feab712cb80 10 client.15009 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:43:39.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feab712cb80 10 client.15009 resolve_mds: resolved name 'h' to daemon mds.h 2022-09-07T19:43:39.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feab712cb80 20 client.15009 populate_metadata read hostname 'smithi080' 2022-09-07T19:43:39.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feab712cb80 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4b308e0 0x55e5e4b2d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:39.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feab712cb80 4 client.15009 mds_command: new command op to 24533 tid=0[{"prefix": "status"}] 2022-09-07T19:43:39.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 --> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e5e4a0c410 con 0x55e5e4b308e0 2022-09-07T19:43:39.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feaa199b700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4b308e0 0x55e5e4b2d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:39.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7feaa199b700 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4b308e0 0x55e5e4b2d250 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2282c25de342ae39 server_cookie=a781474d92ddfde9 in_seq=0 out_seq=0 2022-09-07T19:43:39.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.825+0000 7fea857fa700 10 client.15009 ms_handle_connect on v2:172.21.15.154:6836/2976291086 2022-09-07T19:43:39.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7fea857fa700 1 -- 172.21.15.80:0/719478639 <== mds.2 v2:172.21.15.154:6836/2976291086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55e5e4a0c410 con 0x55e5e4b308e0 2022-09-07T19:43:39.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7fea857fa700 10 client.15009 handle_command_reply: tid=0 2022-09-07T19:43:39.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 client.15009 shutdown 2022-09-07T19:43:39.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 msgr2=0x55e5e4ad2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad2c00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea9400bed0 tx=0x7fea940094c0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 shutdown_connections 2022-09-07T19:43:39.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x55e5e4b308e0 0x55e5e4b2d250 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5e4ac61f0 0x55e5e4ad2c00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5e4ac4ae0 0x55e5e4ad2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7fea857fa700 0 client.15009 ms_handle_reset on v2:172.21.15.154:6836/2976291086 2022-09-07T19:43:39.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 --2- 172.21.15.80:0/719478639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5e4ac5430 0x55e5e4ad26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 >> 172.21.15.80:0/719478639 conn(0x55e5e4ac0fa0 msgr2=0x55e5e4ac8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 shutdown_connections 2022-09-07T19:43:39.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 1 -- 172.21.15.80:0/719478639 wait complete. 2022-09-07T19:43:39.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.826+0000 7feab712cb80 20 client.15009 trim_cache size 0 max 16384 2022-09-07T19:43:39.854 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:43:39.855 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:43:39.855 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2022-09-07T19:43:39.855 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24533, 2022-09-07T19:43:39.855 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:43:39.856 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:43:39.856 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:43:39.856 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 62.326604304, 2022-09-07T19:43:39.856 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 24, 2022-09-07T19:43:39.857 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2022-09-07T19:43:39.857 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2022-09-07T19:43:39.857 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 111.99884216300001 2022-09-07T19:43:39.857 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:43:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fea88099050 msgr2=0x7fea8809b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fea88099050 0x7fea8809b500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea94009b80 tx=0x7fea94005ae0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 msgr2=0x7fea9c195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 0x7fea9c195b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e710 tx=0x7fea9800ea20 comp rx=0 tx=0).stop 2022-09-07T19:43:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 shutdown_connections 2022-09-07T19:43:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fea88099050 0x7fea8809b500 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101b30 0x7fea9c19d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c0fff20 0x7fea9c195b20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 --2- 172.21.15.80:0/419009146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea9c1011a0 0x7fea9c196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:39.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 >> 172.21.15.80:0/419009146 conn(0x7fea9c0fb6b0 msgr2=0x7fea9c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:39.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 shutdown_connections 2022-09-07T19:43:39.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:39.827+0000 7feaa3bff700 1 -- 172.21.15.80:0/419009146 wait complete. 2022-09-07T19:43:39.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2022-09-07T19:43:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 -- 172.21.15.80:0/3906422173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb81038e0 msgr2=0x7efeb8105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 --2- 172.21.15.80:0/3906422173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb81038e0 0x7efeb8105d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009bb0 tx=0x7efeb0009ec0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 -- 172.21.15.80:0/3906422173 shutdown_connections 2022-09-07T19:43:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 --2- 172.21.15.80:0/3906422173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 --2- 172.21.15.80:0/3906422173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb81038e0 0x7efeb8105d60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 --2- 172.21.15.80:0/3906422173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb8100df0 0x7efeb8103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 -- 172.21.15.80:0/3906422173 >> 172.21.15.80:0/3906422173 conn(0x7efeb80f82e0 msgr2=0x7efeb80fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 -- 172.21.15.80:0/3906422173 shutdown_connections 2022-09-07T19:43:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.091+0000 7efebe3ff700 1 -- 172.21.15.80:0/3906422173 wait complete. 2022-09-07T19:43:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.092+0000 7efebe3ff700 1 Processor -- start 2022-09-07T19:43:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 -- start start 2022-09-07T19:43:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb8195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb8100df0 0x7efeb8196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb81038e0 0x7efeb819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb819d650 con 0x7efeb8066bf0 2022-09-07T19:43:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb819d7c0 con 0x7efeb81038e0 2022-09-07T19:43:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebe3ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb819d980 con 0x7efeb8100df0 2022-09-07T19:43:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efeb7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb8195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efeb7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb8195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42770/0 (socket says 172.21.15.80:42770) 2022-09-07T19:43:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efeb7fff700 1 -- 172.21.15.80:0/1452882797 learned_addr learned my addr 172.21.15.80:0/1452882797 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efeb77fe700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb8100df0 0x7efeb8196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.093+0000 7efebc99c700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb81038e0 0x7efeb819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb7fff700 1 -- 172.21.15.80:0/1452882797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb8100df0 msgr2=0x7efeb8196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb7fff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb8100df0 0x7efeb8196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb7fff700 1 -- 172.21.15.80:0/1452882797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb81038e0 msgr2=0x7efeb819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb7fff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb81038e0 0x7efeb819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb7fff700 1 -- 172.21.15.80:0/1452882797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00097e0 con 0x7efeb8066bf0 2022-09-07T19:43:40.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb7fff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb8195ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efea800e6e0 tx=0x7efea800e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb57fa700 1 -- 172.21.15.80:0/1452882797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8009500 con 0x7efeb8066bf0 2022-09-07T19:43:40.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb819dc60 con 0x7efeb8066bf0 2022-09-07T19:43:40.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb57fa700 1 -- 172.21.15.80:0/1452882797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efea8010da0 con 0x7efeb8066bf0 2022-09-07T19:43:40.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.094+0000 7efeb57fa700 1 -- 172.21.15.80:0/1452882797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea80173d0 con 0x7efeb8066bf0 2022-09-07T19:43:40.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.095+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb819e1c0 con 0x7efeb8066bf0 2022-09-07T19:43:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.098+0000 7efeb57fa700 1 -- 172.21.15.80:0/1452882797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7efea800c040 con 0x7efeb8066bf0 2022-09-07T19:43:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.099+0000 7efed1986b80 1 Processor -- start 2022-09-07T19:43:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 -- start start 2022-09-07T19:43:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efeb57fa700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efea00990d0 0x7efea009b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b7def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7f1f0 0x560921b7f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921a68080 con 0x560921b7e430 2022-09-07T19:43:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921ad29e0 con 0x560921b7f1f0 2022-09-07T19:43:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efed1986b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921acc180 con 0x560921b7dae0 2022-09-07T19:43:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.100+0000 7efeb57fa700 1 -- 172.21.15.80:0/1452882797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7efea8014070 con 0x7efeb8066bf0 2022-09-07T19:43:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efebc99c700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efea00990d0 0x7efea009b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b7def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b7ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42784/0 (socket says 172.21.15.80:42784) 2022-09-07T19:43:40.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb77fe700 1 -- 172.21.15.80:0/3222674845 learned_addr learned my addr 172.21.15.80:0/3222674845 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efebc99c700 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7f1f0 0x560921b7f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 -- 172.21.15.80:0/3222674845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7f1f0 msgr2=0x560921b7f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7f1f0 0x560921b7f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 -- 172.21.15.80:0/3222674845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 msgr2=0x560921b7ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b7ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 -- 172.21.15.80:0/3222674845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609219545e0 con 0x560921b7dae0 2022-09-07T19:43:40.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efebc99c700 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7f1f0 0x560921b7f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:43:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb77fe700 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.101+0000 7efeb7fff700 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b7def0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efea80927c0 tx=0x7efea8092600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff867047a88dd16 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efebc99c700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efea00990d0 0x7efea009b580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c010 tx=0x7efeb000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efe9a7fc700 1 -- 172.21.15.80:0/3222674845 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8092190 con 0x560921b7dae0 2022-09-07T19:43:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efe9a7fc700 1 -- 172.21.15.80:0/3222674845 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efea8092f30 con 0x560921b7dae0 2022-09-07T19:43:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efe9a7fc700 1 -- 172.21.15.80:0/3222674845 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8092cf0 con 0x560921b7dae0 2022-09-07T19:43:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 -- 172.21.15.80:0/3222674845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 msgr2=0x560921b7def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b7def0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efea80927c0 tx=0x7efea8092600 comp rx=0 tx=0).stop 2022-09-07T19:43:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 -- 172.21.15.80:0/3222674845 shutdown_connections 2022-09-07T19:43:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7f1f0 0x560921b7f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b7def0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 --2- 172.21.15.80:0/3222674845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.102+0000 7efed1986b80 1 -- 172.21.15.80:0/3222674845 >> 172.21.15.80:0/3222674845 conn(0x560921b79fa0 msgr2=0x560921b78370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.103+0000 7efed1986b80 1 -- 172.21.15.80:0/3222674845 shutdown_connections 2022-09-07T19:43:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.103+0000 7efed1986b80 1 -- 172.21.15.80:0/3222674845 wait complete. 2022-09-07T19:43:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.103+0000 7efed1986b80 1 -- start start 2022-09-07T19:43:40.116 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.103+0000 7efed1986b80 1 Processor -- start 2022-09-07T19:43:40.116 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.116 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 0x560921b87a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.116 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.116 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609219ba0c0 con 0x560921b7f1f0 2022-09-07T19:43:40.117 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921b8f010 con 0x560921b7dae0 2022-09-07T19:43:40.117 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921b8f1a0 con 0x560921b7e430 2022-09-07T19:43:40.117 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efed1986b80 10 client.0 _ll_register_callbacks cb 0x560921a77370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:43:40.117 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 0x560921b87a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efeb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 0x560921b87a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34360/0 (socket says 172.21.15.80:34360) 2022-09-07T19:43:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efeb77fe700 1 -- 172.21.15.80:0/2699026360 learned_addr learned my addr 172.21.15.80:0/2699026360 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.104+0000 7efebc99c700 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efeb77fe700 1 -- 172.21.15.80:0/2699026360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 msgr2=0x560921b87550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.119 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efeb77fe700 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b87550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.119 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efeb77fe700 1 -- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 msgr2=0x560921b8ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.119 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efeb77fe700 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b8ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.119 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efeb77fe700 1 -- 172.21.15.80:0/2699026360 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac00b870 con 0x560921b7e430 2022-09-07T19:43:40.120 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efeb77fe700 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 0x560921b87a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efeac005780 tx=0x7efeac00bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a2ffab77f35f43 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.120 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.105+0000 7efe937fe700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2022-09-07T19:43:40.120 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efe937fe700 1 -- 172.21.15.80:0/2699026360 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac016070 con 0x560921b7e430 2022-09-07T19:43:40.120 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560921b70aa0 con 0x560921b7e430 2022-09-07T19:43:40.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efe937fe700 1 -- 172.21.15.80:0/2699026360 <== mon.1 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7efeac003be0 con 0x560921b7e430 2022-09-07T19:43:40.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efe937fe700 1 -- 172.21.15.80:0/2699026360 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeac003da0 con 0x560921b7e430 2022-09-07T19:43:40.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efed1986b80 10 client.25093 fetch_fsmap learned FSMap version 24 2022-09-07T19:43:40.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7efeb819e1c0 con 0x560921b7e430 2022-09-07T19:43:40.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efe937fe700 1 -- 172.21.15.80:0/2699026360 <== mon.1 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x560921b70aa0 con 0x560921b7e430 2022-09-07T19:43:40.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.106+0000 7efe937fe700 1 -- 172.21.15.80:0/2699026360 <== mon.1 v2:172.21.15.155:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7efeac01b520 con 0x560921b7e430 2022-09-07T19:43:40.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efed1986b80 10 client.25093 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:43:40.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efed1986b80 10 client.25093 resolve_mds: resolved name 'a' to daemon mds.a 2022-09-07T19:43:40.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efed1986b80 20 client.25093 populate_metadata read hostname 'smithi080' 2022-09-07T19:43:40.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efed1986b80 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921b92930 0x560921b97c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efed1986b80 4 client.25093 mds_command: new command op to 24569 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:43:40.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 --> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560921b4d4c0 con 0x560921b92930 2022-09-07T19:43:40.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efeb7fff700 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921b92930 0x560921b97c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efeb7fff700 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921b92930 0x560921b97c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78963425b81c48ec server_cookie=7cd798a1696e8b7c in_seq=0 out_seq=0 2022-09-07T19:43:40.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.107+0000 7efe937fe700 10 client.25093 ms_handle_connect on v2:172.21.15.80:6840/1430605646 2022-09-07T19:43:40.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.108+0000 7efe937fe700 1 -- 172.21.15.80:0/2699026360 <== mds.1 v2:172.21.15.80:6840/1430605646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x560921b4d4c0 con 0x560921b92930 2022-09-07T19:43:40.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.108+0000 7efe937fe700 10 client.25093 handle_command_reply: tid=0 2022-09-07T19:43:40.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.108+0000 7efed1986b80 1 client.25093 shutdown 2022-09-07T19:43:40.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 msgr2=0x560921b87a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 0x560921b87a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efeac005780 tx=0x7efeac00bf60 comp rx=0 tx=0).stop 2022-09-07T19:43:40.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 shutdown_connections 2022-09-07T19:43:40.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b8ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921b92930 0x560921b97c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b87550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 --2- 172.21.15.80:0/2699026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7e430 0x560921b87a90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 >> 172.21.15.80:0/2699026360 conn(0x560921b79fa0 msgr2=0x560921b77a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efe937fe700 0 client.25093 ms_handle_reset on v2:172.21.15.80:6840/1430605646 2022-09-07T19:43:40.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 shutdown_connections 2022-09-07T19:43:40.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 1 -- 172.21.15.80:0/2699026360 wait complete. 2022-09-07T19:43:40.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.109+0000 7efed1986b80 20 client.25093 trim_cache size 0 max 16384 2022-09-07T19:43:40.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 Processor -- start 2022-09-07T19:43:40.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 -- start start 2022-09-07T19:43:40.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b9bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 0x560921b81e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b85270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921a90050 con 0x560921b7f1f0 2022-09-07T19:43:40.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921a6e4f0 con 0x560921b7e430 2022-09-07T19:43:40.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.127+0000 7efed1986b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921958a30 con 0x560921b7dae0 2022-09-07T19:43:40.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 0x560921b81e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b9bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efebc99c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b85270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 0x560921b81e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:55658/0 (socket says 172.21.15.80:55658) 2022-09-07T19:43:40.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb77fe700 1 -- 172.21.15.80:0/2204623710 learned_addr learned my addr 172.21.15.80:0/2204623710 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb7fff700 1 -- 172.21.15.80:0/2204623710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 msgr2=0x560921b81e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb7fff700 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 0x560921b81e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb7fff700 1 -- 172.21.15.80:0/2204623710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 msgr2=0x560921b85270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb7fff700 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b85270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb7fff700 1 -- 172.21.15.80:0/2204623710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560921900d90 con 0x560921b7dae0 2022-09-07T19:43:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.128+0000 7efeb77fe700 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 0x560921b81e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efeb7fff700 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b9bc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efea8092530 tx=0x7efea807cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f45ddb9cabbe33 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efe9affd700 1 -- 172.21.15.80:0/2204623710 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea80928b0 con 0x560921b7dae0 2022-09-07T19:43:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efe9affd700 1 -- 172.21.15.80:0/2204623710 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efea807cec0 con 0x560921b7dae0 2022-09-07T19:43:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efe9affd700 1 -- 172.21.15.80:0/2204623710 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8092a90 con 0x560921b7dae0 2022-09-07T19:43:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 -- 172.21.15.80:0/2204623710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 msgr2=0x560921b9bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b9bc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efea8092530 tx=0x7efea807cce0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 -- 172.21.15.80:0/2204623710 shutdown_connections 2022-09-07T19:43:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7f1f0 0x560921b85270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7dae0 0x560921b9bc30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 --2- 172.21.15.80:0/2204623710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7e430 0x560921b81e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.129+0000 7efed1986b80 1 -- 172.21.15.80:0/2204623710 >> 172.21.15.80:0/2204623710 conn(0x560921b79fa0 msgr2=0x560921b8f580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.130+0000 7efed1986b80 1 -- 172.21.15.80:0/2204623710 shutdown_connections 2022-09-07T19:43:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.130+0000 7efed1986b80 1 -- 172.21.15.80:0/2204623710 wait complete. 2022-09-07T19:43:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.130+0000 7efed1986b80 1 -- start start 2022-09-07T19:43:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.130+0000 7efed1986b80 1 Processor -- start 2022-09-07T19:43:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b8b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b8b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7f1f0 0x560921b8bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921b8cb80 con 0x560921b7e430 2022-09-07T19:43:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921be4bb0 con 0x560921b7dae0 2022-09-07T19:43:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560921be4cf0 con 0x560921b7f1f0 2022-09-07T19:43:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efed1986b80 10 client.0 _ll_register_callbacks cb 0x560921a77370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:43:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b8b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.145 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efeb77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b8b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42808/0 (socket says 172.21.15.80:42808) 2022-09-07T19:43:40.145 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efeb77fe700 1 -- 172.21.15.80:0/814496886 learned_addr learned my addr 172.21.15.80:0/814496886 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.145 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efebc99c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7f1f0 0x560921b8bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.145 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.131+0000 7efeb7fff700 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b8b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efebc99c700 1 -- 172.21.15.80:0/814496886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 msgr2=0x560921b8b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efebc99c700 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b8b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efebc99c700 1 -- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 msgr2=0x560921b8b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efebc99c700 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b8b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efebc99c700 1 -- 172.21.15.80:0/814496886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb819e1c0 con 0x560921b7f1f0 2022-09-07T19:43:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efebc99c700 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7f1f0 0x560921b8bb10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009b80 tx=0x7efeb00094c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f8dfabfa65bd20e server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efe937fe700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2022-09-07T19:43:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efe937fe700 1 -- 172.21.15.80:0/814496886 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb002e050 con 0x560921b7f1f0 2022-09-07T19:43:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efea8092f30 con 0x560921b7f1f0 2022-09-07T19:43:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.132+0000 7efe937fe700 1 -- 172.21.15.80:0/814496886 <== mon.1 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7efeb0005240 con 0x560921b7f1f0 2022-09-07T19:43:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efe937fe700 1 -- 172.21.15.80:0/814496886 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeb0005400 con 0x560921b7f1f0 2022-09-07T19:43:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 10 client.25099 fetch_fsmap learned FSMap version 24 2022-09-07T19:43:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5609219545e0 con 0x560921b7f1f0 2022-09-07T19:43:40.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efe937fe700 1 -- 172.21.15.80:0/814496886 <== mon.1 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7efea8092f30 con 0x560921b7f1f0 2022-09-07T19:43:40.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efe937fe700 1 -- 172.21.15.80:0/814496886 <== mon.1 v2:172.21.15.155:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7efeb0017a90 con 0x560921b7f1f0 2022-09-07T19:43:40.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 10 client.25099 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:43:40.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 10 client.25099 resolve_mds: resolved name 'a' to daemon mds.a 2022-09-07T19:43:40.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 20 client.25099 populate_metadata read hostname 'smithi080' 2022-09-07T19:43:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921be99a0 0x560921be6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 4 client.25099 mds_command: new command op to 24569 tid=0[{"prefix": "status"}] 2022-09-07T19:43:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 --> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560921ac56f0 con 0x560921be99a0 2022-09-07T19:43:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.133+0000 7efeb7fff700 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921be99a0 0x560921be6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efeb7fff700 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921be99a0 0x560921be6310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a79f0bf8d73ffda server_cookie=28df6a5023fc5859 in_seq=0 out_seq=0 2022-09-07T19:43:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efe937fe700 10 client.25099 ms_handle_connect on v2:172.21.15.80:6840/1430605646 2022-09-07T19:43:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efe937fe700 1 -- 172.21.15.80:0/814496886 <== mds.1 v2:172.21.15.80:6840/1430605646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x560921ac56f0 con 0x560921be99a0 2022-09-07T19:43:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efe937fe700 10 client.25099 handle_command_reply: tid=0 2022-09-07T19:43:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efed1986b80 1 client.25099 shutdown 2022-09-07T19:43:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7f1f0 msgr2=0x560921b8bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.134+0000 7efed1986b80 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7f1f0 0x560921b8bb10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009b80 tx=0x7efeb00094c0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 shutdown_connections 2022-09-07T19:43:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x560921be99a0 0x560921be6310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560921b7f1f0 0x560921b8bb10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560921b7dae0 0x560921b8b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 --2- 172.21.15.80:0/814496886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560921b7e430 0x560921b8b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efe937fe700 0 client.25099 ms_handle_reset on v2:172.21.15.80:6840/1430605646 2022-09-07T19:43:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 >> 172.21.15.80:0/814496886 conn(0x560921b79fa0 msgr2=0x560921b8f580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 shutdown_connections 2022-09-07T19:43:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 1 -- 172.21.15.80:0/814496886 wait complete. 2022-09-07T19:43:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.135+0000 7efed1986b80 20 client.25099 trim_cache size 0 max 16384 2022-09-07T19:43:40.155 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:43:40.155 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:43:40.155 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2022-09-07T19:43:40.156 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24569, 2022-09-07T19:43:40.156 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:43:40.156 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:43:40.156 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:43:40.157 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 63.639575499000003, 2022-09-07T19:43:40.157 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 24, 2022-09-07T19:43:40.157 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2022-09-07T19:43:40.157 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2022-09-07T19:43:40.157 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 103.037818921 2022-09-07T19:43:40.158 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:43:40.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efea00990d0 msgr2=0x7efea009b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efea00990d0 0x7efea009b580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c010 tx=0x7efeb000b540 comp rx=0 tx=0).stop 2022-09-07T19:43:40.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 msgr2=0x7efeb8195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb8195ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efea800e6e0 tx=0x7efea800e9f0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 shutdown_connections 2022-09-07T19:43:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb8066bf0 0x7efeb8195ad0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7efea00990d0 0x7efea009b580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb81038e0 0x7efeb819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 --2- 172.21.15.80:0/1452882797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb8100df0 0x7efeb8196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 >> 172.21.15.80:0/1452882797 conn(0x7efeb80f82e0 msgr2=0x7efeb81045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 shutdown_connections 2022-09-07T19:43:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.136+0000 7efebe3ff700 1 -- 172.21.15.80:0/1452882797 wait complete. 2022-09-07T19:43:40.162 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-09-07T19:43:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 -- 172.21.15.80:0/1810748547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7480100df0 msgr2=0x7f7480103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 --2- 172.21.15.80:0/1810748547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7480100df0 0x7f7480103250 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7474009810 tx=0x7f7474009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 -- 172.21.15.80:0/1810748547 shutdown_connections 2022-09-07T19:43:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 --2- 172.21.15.80:0/1810748547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74801038e0 0x7f7480105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 --2- 172.21.15.80:0/1810748547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480066bf0 0x7f74801008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 --2- 172.21.15.80:0/1810748547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7480100df0 0x7f7480103250 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 -- 172.21.15.80:0/1810748547 >> 172.21.15.80:0/1810748547 conn(0x7f74800f82e0 msgr2=0x7f74800fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 -- 172.21.15.80:0/1810748547 shutdown_connections 2022-09-07T19:43:40.393 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.392+0000 7f74857ff700 1 -- 172.21.15.80:0/1810748547 wait complete. 2022-09-07T19:43:40.395 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.393+0000 7f74857ff700 1 Processor -- start 2022-09-07T19:43:40.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.393+0000 7f74857ff700 1 -- start start 2022-09-07T19:43:40.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f74857ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7480066bf0 0x7f7480195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f74857ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 0x7f7480196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.396 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f74857ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74801038e0 0x7f748019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f74857ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748019d6c0 con 0x7f74801038e0 2022-09-07T19:43:40.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f74857ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748019d830 con 0x7f7480100df0 2022-09-07T19:43:40.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f74857ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748019d9f0 con 0x7f7480066bf0 2022-09-07T19:43:40.397 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f747f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74801038e0 0x7f748019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f747e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 0x7f7480196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f747e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 0x7f7480196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:55690/0 (socket says 172.21.15.80:55690) 2022-09-07T19:43:40.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f747e7fc700 1 -- 172.21.15.80:0/1515301148 learned_addr learned my addr 172.21.15.80:0/1515301148 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.398 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.394+0000 7f747effd700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7480066bf0 0x7f7480195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747e7fc700 1 -- 172.21.15.80:0/1515301148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7480066bf0 msgr2=0x7f7480195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747e7fc700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7480066bf0 0x7f7480195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747e7fc700 1 -- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74801038e0 msgr2=0x7f748019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747e7fc700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74801038e0 0x7f748019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.399 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747e7fc700 1 -- 172.21.15.80:0/1515301148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009470 con 0x7f7480100df0 2022-09-07T19:43:40.400 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747f7fe700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74801038e0 0x7f748019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:40.400 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f747e7fc700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 0x7f7480196080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f747400f690 tx=0x7f747400f6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.400 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f7467fff700 1 -- 172.21.15.80:0/1515301148 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747401d070 con 0x7f7480100df0 2022-09-07T19:43:40.400 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748019dc70 con 0x7f7480100df0 2022-09-07T19:43:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f7467fff700 1 -- 172.21.15.80:0/1515301148 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f747400f8e0 con 0x7f7480100df0 2022-09-07T19:43:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f7467fff700 1 -- 172.21.15.80:0/1515301148 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740047f0 con 0x7f7480100df0 2022-09-07T19:43:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.395+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748019e170 con 0x7f7480100df0 2022-09-07T19:43:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.400+0000 7f7467fff700 1 -- 172.21.15.80:0/1515301148 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 127718+0+0 (secure 0 0 0) 0x7f7474028030 con 0x7f7480100df0 2022-09-07T19:43:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.401+0000 7f7498d1fb80 1 Processor -- start 2022-09-07T19:43:40.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.401+0000 7f7498d1fb80 1 -- start start 2022-09-07T19:43:40.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda6fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda70c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7467fff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f74680990d0 0x7f746809b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda71640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed95a080 con 0x5633eda70430 2022-09-07T19:43:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed9c49e0 con 0x5633eda711f0 2022-09-07T19:43:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed9be180 con 0x5633eda6fae0 2022-09-07T19:43:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f7467fff700 1 -- 172.21.15.80:0/1515301148 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f74740c3390 con 0x7f7480100df0 2022-09-07T19:43:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f747effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda70c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f747f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda6fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f747effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda70c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42830/0 (socket says 172.21.15.80:42830) 2022-09-07T19:43:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f747effd700 1 -- 172.21.15.80:0/1712723915 learned_addr learned my addr 172.21.15.80:0/1712723915 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f747e7fc700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f74680990d0 0x7f746809b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.402+0000 7f747f7fe700 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda71640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747effd700 1 -- 172.21.15.80:0/1712723915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 msgr2=0x5633eda6fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747effd700 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda6fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747effd700 1 -- 172.21.15.80:0/1712723915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 msgr2=0x5633eda71640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747effd700 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda71640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747effd700 1 -- 172.21.15.80:0/1712723915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ed8465e0 con 0x5633eda70430 2022-09-07T19:43:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747e7fc700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f74680990d0 0x7f746809b580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f74740c0e50 tx=0x7f7474009b20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f747effd700 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda70c60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7470009b60 tx=0x7f7470009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf8985ff5d6814d server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f74657fa700 1 -- 172.21.15.80:0/1712723915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470004310 con 0x5633eda70430 2022-09-07T19:43:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f74657fa700 1 -- 172.21.15.80:0/1712723915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f7470011dd0 con 0x5633eda70430 2022-09-07T19:43:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.403+0000 7f74657fa700 1 -- 172.21.15.80:0/1712723915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470003e90 con 0x5633eda70430 2022-09-07T19:43:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 -- 172.21.15.80:0/1712723915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 msgr2=0x5633eda70c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda70c60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7470009b60 tx=0x7f7470009e70 comp rx=0 tx=0).stop 2022-09-07T19:43:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 -- 172.21.15.80:0/1712723915 shutdown_connections 2022-09-07T19:43:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda71640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda6fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/1712723915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda70c60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 -- 172.21.15.80:0/1712723915 >> 172.21.15.80:0/1712723915 conn(0x5633eda6bfa0 msgr2=0x5633eda6a370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 -- 172.21.15.80:0/1712723915 shutdown_connections 2022-09-07T19:43:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.404+0000 7f7498d1fb80 1 -- 172.21.15.80:0/1712723915 wait complete. 2022-09-07T19:43:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.405+0000 7f7498d1fb80 1 -- start start 2022-09-07T19:43:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.405+0000 7f7498d1fb80 1 Processor -- start 2022-09-07T19:43:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.405+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda794e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda79a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633eda80a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed8ac0c0 con 0x5633eda711f0 2022-09-07T19:43:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633eda80fa0 con 0x5633eda70430 2022-09-07T19:43:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633eda81130 con 0x5633eda6fae0 2022-09-07T19:43:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f7498d1fb80 10 client.0 _ll_register_callbacks cb 0x5633ed969370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:43:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda794e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34414/0 (socket says 172.21.15.80:34414) 2022-09-07T19:43:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 -- 172.21.15.80:0/624131489 learned_addr learned my addr 172.21.15.80:0/624131489 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747effd700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda79a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633eda80a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 -- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 msgr2=0x5633eda79a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda79a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 -- 172.21.15.80:0/624131489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 msgr2=0x5633eda80a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633eda80a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.406+0000 7f747f7fe700 1 -- 172.21.15.80:0/624131489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7470009790 con 0x5633eda6fae0 2022-09-07T19:43:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f747f7fe700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda794e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f747800fa70 tx=0x7f7478004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e08598e343f9837 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f745e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2022-09-07T19:43:40.422 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f745e7fc700 1 -- 172.21.15.80:0/624131489 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747800fe40 con 0x5633eda6fae0 2022-09-07T19:43:40.422 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633eda62aa0 con 0x5633eda6fae0 2022-09-07T19:43:40.422 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f745e7fc700 1 -- 172.21.15.80:0/624131489 <== mon.1 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f7478004a30 con 0x5633eda6fae0 2022-09-07T19:43:40.422 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f745e7fc700 1 -- 172.21.15.80:0/624131489 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7478004bf0 con 0x5633eda6fae0 2022-09-07T19:43:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f7498d1fb80 10 client.25111 fetch_fsmap learned FSMap version 24 2022-09-07T19:43:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.407+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5633ed7f2d90 con 0x5633eda6fae0 2022-09-07T19:43:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f745e7fc700 1 -- 172.21.15.80:0/624131489 <== mon.1 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x5633eda62aa0 con 0x5633eda6fae0 2022-09-07T19:43:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f745e7fc700 1 -- 172.21.15.80:0/624131489 <== mon.1 v2:172.21.15.155:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f747800ec30 con 0x5633eda6fae0 2022-09-07T19:43:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f7498d1fb80 10 client.25111 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:43:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f7498d1fb80 10 client.25111 resolve_mds: resolved name 'b' to daemon mds.b 2022-09-07T19:43:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f7498d1fb80 20 client.25111 populate_metadata read hostname 'smithi080' 2022-09-07T19:43:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633eda847c0 0x5633eda89ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f7498d1fb80 4 client.25111 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:43:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.408+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 --> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633eda3f4c0 con 0x5633eda847c0 2022-09-07T19:43:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.409+0000 7f747effd700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633eda847c0 0x5633eda89ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.409+0000 7f747effd700 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633eda847c0 0x5633eda89ac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef210115031bd67e server_cookie=c41eaaa86234a638 in_seq=0 out_seq=0 2022-09-07T19:43:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.409+0000 7f745e7fc700 10 client.25111 ms_handle_connect on v2:172.21.15.154:6838/545932828 2022-09-07T19:43:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f745e7fc700 1 -- 172.21.15.80:0/624131489 <== mds.0 v2:172.21.15.154:6838/545932828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x5633eda3f4c0 con 0x5633eda847c0 2022-09-07T19:43:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f745e7fc700 10 client.25111 handle_command_reply: tid=0 2022-09-07T19:43:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f7498d1fb80 1 client.25111 shutdown 2022-09-07T19:43:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 msgr2=0x5633eda794e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.427 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda794e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f747800fa70 tx=0x7f7478004950 comp rx=0 tx=0).stop 2022-09-07T19:43:40.427 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 shutdown_connections 2022-09-07T19:43:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.410+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633eda847c0 0x5633eda89ac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633eda80a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.430 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda794e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.430 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f745e7fc700 0 client.25111 ms_handle_reset on v2:172.21.15.154:6838/545932828 2022-09-07T19:43:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/624131489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda79a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 >> 172.21.15.80:0/624131489 conn(0x5633eda6bfa0 msgr2=0x5633eda69a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 shutdown_connections 2022-09-07T19:43:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 1 -- 172.21.15.80:0/624131489 wait complete. 2022-09-07T19:43:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.411+0000 7f7498d1fb80 20 client.25111 trim_cache size 0 max 16384 2022-09-07T19:43:40.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 Processor -- start 2022-09-07T19:43:40.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 -- start start 2022-09-07T19:43:40.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda77250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda77790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda79290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed982050 con 0x5633eda70430 2022-09-07T19:43:40.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed9604f0 con 0x5633eda711f0 2022-09-07T19:43:40.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.429+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ed84aa30 con 0x5633eda6fae0 2022-09-07T19:43:40.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda77790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda77790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42848/0 (socket says 172.21.15.80:42848) 2022-09-07T19:43:40.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 -- 172.21.15.80:0/3107630086 learned_addr learned my addr 172.21.15.80:0/3107630086 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda77250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.448 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda79290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.448 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 -- 172.21.15.80:0/3107630086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 msgr2=0x5633eda77250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.448 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda77250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.449 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 -- 172.21.15.80:0/3107630086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 msgr2=0x5633eda79290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.449 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda79290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.449 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 -- 172.21.15.80:0/3107630086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ed7f1260 con 0x5633eda70430 2022-09-07T19:43:40.449 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda77250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:43:40.450 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f747effd700 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda77790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f747001a000 tx=0x7f7470009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db474374da24e41 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.450 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.430+0000 7f7465ffb700 1 -- 172.21.15.80:0/3107630086 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470003ae0 con 0x5633eda70430 2022-09-07T19:43:40.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7465ffb700 1 -- 172.21.15.80:0/3107630086 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f7470003c40 con 0x5633eda70430 2022-09-07T19:43:40.451 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7465ffb700 1 -- 172.21.15.80:0/3107630086 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747001a440 con 0x5633eda70430 2022-09-07T19:43:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3107630086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 msgr2=0x5633eda77790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda77790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f747001a000 tx=0x7f7470009500 comp rx=0 tx=0).stop 2022-09-07T19:43:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3107630086 shutdown_connections 2022-09-07T19:43:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda711f0 0x5633eda79290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda77250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.454 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3107630086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda70430 0x5633eda77790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.455 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3107630086 >> 172.21.15.80:0/3107630086 conn(0x5633eda6bfa0 msgr2=0x5633eda73e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.455 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3107630086 shutdown_connections 2022-09-07T19:43:40.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.431+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3107630086 wait complete. 2022-09-07T19:43:40.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.432+0000 7f7498d1fb80 1 -- start start 2022-09-07T19:43:40.457 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.432+0000 7f7498d1fb80 1 Processor -- start 2022-09-07T19:43:40.457 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda7d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.458 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda7ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.458 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633edad6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633edad6fa0 con 0x5633eda711f0 2022-09-07T19:43:40.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633edad70e0 con 0x5633eda70430 2022-09-07T19:43:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633edad7270 con 0x5633eda6fae0 2022-09-07T19:43:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f7498d1fb80 10 client.0 _ll_register_callbacks cb 0x5633ed969370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:43:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f747f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda7d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f747f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda7d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:34432/0 (socket says 172.21.15.80:34432) 2022-09-07T19:43:40.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f747f7fe700 1 -- 172.21.15.80:0/3900977724 learned_addr learned my addr 172.21.15.80:0/3900977724 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:40.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633edad6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.433+0000 7f747effd700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda7ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f747f7fe700 1 -- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 msgr2=0x5633eda7ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda7ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f747f7fe700 1 -- 172.21.15.80:0/3900977724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 msgr2=0x5633edad6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:43:40.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633edad6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f747f7fe700 1 -- 172.21.15.80:0/3900977724 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747001e040 con 0x5633eda6fae0 2022-09-07T19:43:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f747f7fe700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda7d8b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f747800f9f0 tx=0x7f7478004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ca06aa39d1a056 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f745e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2022-09-07T19:43:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f745e7fc700 1 -- 172.21.15.80:0/3900977724 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780043d0 con 0x5633eda6fae0 2022-09-07T19:43:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7470011dd0 con 0x5633eda6fae0 2022-09-07T19:43:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f745e7fc700 1 -- 172.21.15.80:0/3900977724 <== mon.1 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f7478004740 con 0x5633eda6fae0 2022-09-07T19:43:40.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f745e7fc700 1 -- 172.21.15.80:0/3900977724 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f747800e870 con 0x5633eda6fae0 2022-09-07T19:43:40.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f7498d1fb80 10 client.25117 fetch_fsmap learned FSMap version 24 2022-09-07T19:43:40.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.434+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5633ed8bfa30 con 0x5633eda6fae0 2022-09-07T19:43:40.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f745e7fc700 1 -- 172.21.15.80:0/3900977724 <== mon.1 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f7470011dd0 con 0x5633eda6fae0 2022-09-07T19:43:40.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f745e7fc700 1 -- 172.21.15.80:0/3900977724 <== mon.1 v2:172.21.15.155:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f7478023440 con 0x5633eda6fae0 2022-09-07T19:43:40.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f7498d1fb80 10 client.25117 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:43:40.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f7498d1fb80 10 client.25117 resolve_mds: resolved name 'b' to daemon mds.b 2022-09-07T19:43:40.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f7498d1fb80 20 client.25117 populate_metadata read hostname 'smithi080' 2022-09-07T19:43:40.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633edadbff0 0x5633edad8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:40.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f7498d1fb80 4 client.25117 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2022-09-07T19:43:40.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 --> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5633ed9b76f0 con 0x5633edadbff0 2022-09-07T19:43:40.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.435+0000 7f747effd700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633edadbff0 0x5633edad8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:40.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f747effd700 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633edadbff0 0x5633edad8940 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc42b1090be195e6 server_cookie=ce86554ef07f7a2b in_seq=0 out_seq=0 2022-09-07T19:43:40.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f745e7fc700 10 client.25117 ms_handle_connect on v2:172.21.15.154:6838/545932828 2022-09-07T19:43:40.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f745e7fc700 1 -- 172.21.15.80:0/3900977724 <== mds.0 v2:172.21.15.154:6838/545932828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5633ed9b76f0 con 0x5633edadbff0 2022-09-07T19:43:40.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f745e7fc700 10 client.25117 handle_command_reply: tid=0 2022-09-07T19:43:40.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 client.25117 shutdown 2022-09-07T19:43:40.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 msgr2=0x5633eda7d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda7d8b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f747800f9f0 tx=0x7f7478004950 comp rx=0 tx=0).stop 2022-09-07T19:43:40.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 shutdown_connections 2022-09-07T19:43:40.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x5633edadbff0 0x5633edad8940 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633eda711f0 0x5633edad6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633eda6fae0 0x5633eda7d8b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 --2- 172.21.15.80:0/3900977724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5633eda70430 0x5633eda7ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f745e7fc700 0 client.25117 ms_handle_reset on v2:172.21.15.154:6838/545932828 2022-09-07T19:43:40.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.436+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 >> 172.21.15.80:0/3900977724 conn(0x5633eda6bfa0 msgr2=0x5633eda77250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 shutdown_connections 2022-09-07T19:43:40.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f7498d1fb80 1 -- 172.21.15.80:0/3900977724 wait complete. 2022-09-07T19:43:40.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f7498d1fb80 20 client.25117 trim_cache size 0 max 16384 2022-09-07T19:43:40.483 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:43:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:43:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2022-09-07T19:43:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24575, 2022-09-07T19:43:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:43:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:43:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:43:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 93.516642950000005, 2022-09-07T19:43:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 24, 2022-09-07T19:43:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2022-09-07T19:43:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2022-09-07T19:43:40.488 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 101.11085419200001 2022-09-07T19:43:40.488 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:43:40.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f74680990d0 msgr2=0x7f746809b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f74680990d0 0x7f746809b580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f74740c0e50 tx=0x7f7474009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 msgr2=0x7f7480196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 0x7f7480196080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f747400f690 tx=0x7f747400f6c0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 shutdown_connections 2022-09-07T19:43:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74801038e0 0x7f748019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f74680990d0 0x7f746809b580 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7480066bf0 0x7f7480195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 --2- 172.21.15.80:0/1515301148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480100df0 0x7f7480196080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.437+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 >> 172.21.15.80:0/1515301148 conn(0x7f74800f82e0 msgr2=0x7f74800fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.438+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 shutdown_connections 2022-09-07T19:43:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:40.438+0000 7f74857ff700 1 -- 172.21.15.80:0/1515301148 wait complete. 2022-09-07T19:43:40.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:40 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4128345077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:43:40.496 INFO:tasks.cephadm:Setup complete, yielding 2022-09-07T19:43:40.497 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-09-07T19:43:40.512 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:43:40.513 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph orch status' 2022-09-07T19:43:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:40 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4128345077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:43:40.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:40 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4128345077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:43:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:41.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:41 smithi080 ceph-mon[90124]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:43:41.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:41 smithi154 ceph-mon[96967]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:43:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:41 smithi155 ceph-mon[97606]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:43:42.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:43:42.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:42 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:43:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:43:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:42 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:43:42.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:43:42.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:42 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:43:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 -- 172.21.15.80:0/2119965293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5334100f40 msgr2=0x7f53341033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 --2- 172.21.15.80:0/2119965293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5334100f40 0x7f53341033a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5328009810 tx=0x7f5328009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 -- 172.21.15.80:0/2119965293 shutdown_connections 2022-09-07T19:43:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 --2- 172.21.15.80:0/2119965293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5334103a30 0x7f5334105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 --2- 172.21.15.80:0/2119965293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53340673d0 0x7f5334100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 --2- 172.21.15.80:0/2119965293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5334100f40 0x7f53341033a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 -- 172.21.15.80:0/2119965293 >> 172.21.15.80:0/2119965293 conn(0x7f53340f8430 msgr2=0x7f53340fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 -- 172.21.15.80:0/2119965293 shutdown_connections 2022-09-07T19:43:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.010+0000 7f5339225700 1 -- 172.21.15.80:0/2119965293 wait complete. 2022-09-07T19:43:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.011+0000 7f5339225700 1 Processor -- start 2022-09-07T19:43:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.011+0000 7f5339225700 1 -- start start 2022-09-07T19:43:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5339225700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 0x7f5334195c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5339225700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5334100f40 0x7f53341961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5339225700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5334103a30 0x7f533419d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5339225700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533419d830 con 0x7f53340673d0 2022-09-07T19:43:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5339225700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533419d9a0 con 0x7f5334103a30 2022-09-07T19:43:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5339225700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533419db60 con 0x7f5334100f40 2022-09-07T19:43:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5332d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 0x7f5334195c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5332d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 0x7f5334195c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58676/0 (socket says 172.21.15.80:58676) 2022-09-07T19:43:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f5332d9d700 1 -- 172.21.15.80:0/1462604969 learned_addr learned my addr 172.21.15.80:0/1462604969 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f533259c700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5334100f40 0x7f53341961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.012+0000 7f533359e700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5334103a30 0x7f533419d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5332d9d700 1 -- 172.21.15.80:0/1462604969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5334100f40 msgr2=0x7f53341961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5332d9d700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5334100f40 0x7f53341961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5332d9d700 1 -- 172.21.15.80:0/1462604969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5334103a30 msgr2=0x7f533419d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5332d9d700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5334103a30 0x7f533419d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5332d9d700 1 -- 172.21.15.80:0/1462604969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5328009470 con 0x7f53340673d0 2022-09-07T19:43:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5332d9d700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 0x7f5334195c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f532400e6e0 tx=0x7f532400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324009500 con 0x7f53340673d0 2022-09-07T19:43:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f5324010da0 con 0x7f53340673d0 2022-09-07T19:43:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240173d0 con 0x7f53340673d0 2022-09-07T19:43:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533419de40 con 0x7f53340673d0 2022-09-07T19:43:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.013+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533419e210 con 0x7f53340673d0 2022-09-07T19:43:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.015+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334109640 con 0x7f53340673d0 2022-09-07T19:43:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.016+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f532400c040 con 0x7f53340673d0 2022-09-07T19:43:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.017+0000 7f5317fff700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f531c099090 0x7f531c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.017+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8995+0+0 (secure 0 0 0) 0x7f5324014070 con 0x7f53340673d0 2022-09-07T19:43:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.018+0000 7f533259c700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f531c099090 0x7f531c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.018+0000 7f533259c700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f531c099090 0x7f531c09b540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5334197180 tx=0x7f5328009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.022+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f532404fc80 con 0x7f53340673d0 2022-09-07T19:43:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.254+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f533405fbd0 con 0x7f531c099090 2022-09-07T19:43:43.255 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.255+0000 7f5317fff700 1 -- 172.21.15.80:0/1462604969 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f533405fbd0 con 0x7f531c099090 2022-09-07T19:43:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:Backend: cephadm 2022-09-07T19:43:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:Available: Yes 2022-09-07T19:43:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:Paused: No 2022-09-07T19:43:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f531c099090 msgr2=0x7f531c09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f531c099090 0x7f531c09b540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5334197180 tx=0x7f5328009e70 comp rx=0 tx=0).stop 2022-09-07T19:43:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 msgr2=0x7f5334195c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 0x7f5334195c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f532400e6e0 tx=0x7f532400e9f0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 shutdown_connections 2022-09-07T19:43:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53340673d0 0x7f5334195c80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f531c099090 0x7f531c09b540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5334103a30 0x7f533419d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.260 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 --2- 172.21.15.80:0/1462604969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5334100f40 0x7f53341961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:43.260 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 >> 172.21.15.80:0/1462604969 conn(0x7f53340f8430 msgr2=0x7f53340ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:43.260 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 shutdown_connections 2022-09-07T19:43:43.260 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:43.258+0000 7f5339225700 1 -- 172.21.15.80:0/1462604969 wait complete. 2022-09-07T19:43:43.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: pgmap v351: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: mgrmap e18: x(active, since 9m), standbys: z, y 2022-09-07T19:43:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2022-09-07T19:43:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2022-09-07T19:43:43.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2022-09-07T19:43:43.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2022-09-07T19:43:43.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:43 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2022-09-07T19:43:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: pgmap v351: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: mgrmap e18: x(active, since 9m), standbys: z, y 2022-09-07T19:43:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2022-09-07T19:43:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2022-09-07T19:43:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2022-09-07T19:43:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2022-09-07T19:43:43.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:43 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2022-09-07T19:43:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: pgmap v351: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:43:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: mgrmap e18: x(active, since 9m), standbys: z, y 2022-09-07T19:43:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2022-09-07T19:43:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2022-09-07T19:43:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2022-09-07T19:43:43.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2022-09-07T19:43:43.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:43 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2022-09-07T19:43:43.754 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph orch ps' 2022-09-07T19:43:44.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2022-09-07T19:43:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2022-09-07T19:43:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2022-09-07T19:43:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2022-09-07T19:43:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2022-09-07T19:43:44.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: osdmap e92: 12 total, 12 up, 12 in 2022-09-07T19:43:44.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:44 smithi080 ceph-mon[90124]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:44.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2022-09-07T19:43:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2022-09-07T19:43:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2022-09-07T19:43:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2022-09-07T19:43:44.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2022-09-07T19:43:44.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: osdmap e92: 12 total, 12 up, 12 in 2022-09-07T19:43:44.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:44 smithi154 ceph-mon[96967]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2022-09-07T19:43:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2022-09-07T19:43:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2022-09-07T19:43:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2022-09-07T19:43:44.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: from='mgr.14152 172.21.15.80:0/3786267337' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2022-09-07T19:43:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: osdmap e92: 12 total, 12 up, 12 in 2022-09-07T19:43:44.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:44 smithi155 ceph-mon[97606]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:45.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:45 smithi080 ceph-mon[90124]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:43:45.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:45 smithi080 ceph-mon[90124]: osdmap e93: 12 total, 12 up, 12 in 2022-09-07T19:43:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:45 smithi154 ceph-mon[96967]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:43:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:45 smithi154 ceph-mon[96967]: osdmap e93: 12 total, 12 up, 12 in 2022-09-07T19:43:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:45 smithi155 ceph-mon[97606]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:43:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:45 smithi155 ceph-mon[97606]: osdmap e93: 12 total, 12 up, 12 in 2022-09-07T19:43:46.187 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.187+0000 7fa908741700 1 -- 172.21.15.80:0/3423273418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 msgr2=0x7fa9000ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.187+0000 7fa908741700 1 --2- 172.21.15.80:0/3423273418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa9000ff4f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009840 tx=0x7fa8f0009b50 comp rx=0 tx=0).stop 2022-09-07T19:43:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 -- 172.21.15.80:0/3423273418 shutdown_connections 2022-09-07T19:43:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 --2- 172.21.15.80:0/3423273418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000ffa30 0x7fa900106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 --2- 172.21.15.80:0/3423273418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fde10 0x7fa9000fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 --2- 172.21.15.80:0/3423273418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa9000ff4f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 -- 172.21.15.80:0/3423273418 >> 172.21.15.80:0/3423273418 conn(0x7fa9000f9570 msgr2=0x7fa9000fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 -- 172.21.15.80:0/3423273418 shutdown_connections 2022-09-07T19:43:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.188+0000 7fa908741700 1 -- 172.21.15.80:0/3423273418 wait complete. 2022-09-07T19:43:46.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.189+0000 7fa908741700 1 Processor -- start 2022-09-07T19:43:46.195 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.189+0000 7fa908741700 1 -- start start 2022-09-07T19:43:46.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.189+0000 7fa908741700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000fde10 0x7fa900195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:46.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.189+0000 7fa908741700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa900196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:46.196 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.189+0000 7fa908741700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000ffa30 0x7fa90019d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:46.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa908741700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90019d8b0 con 0x7fa9000ff080 2022-09-07T19:43:46.197 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa908741700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90019da20 con 0x7fa9000fde10 2022-09-07T19:43:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa908741700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90019dbe0 con 0x7fa9000ffa30 2022-09-07T19:43:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa900196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa900196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58700/0 (socket says 172.21.15.80:58700) 2022-09-07T19:43:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 -- 172.21.15.80:0/3608514290 learned_addr learned my addr 172.21.15.80:0/3608514290 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa9064dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000fde10 0x7fa900195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa906cde700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000ffa30 0x7fa90019d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 -- 172.21.15.80:0/3608514290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000ffa30 msgr2=0x7fa90019d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:46.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000ffa30 0x7fa90019d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.201 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 -- 172.21.15.80:0/3608514290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000fde10 msgr2=0x7fa900195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:46.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000fde10 0x7fa900195cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.190+0000 7fa905cdc700 1 -- 172.21.15.80:0/3608514290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009730 con 0x7fa9000ff080 2022-09-07T19:43:46.202 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.191+0000 7fa905cdc700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa900196230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0006010 tx=0x7fa8f000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:46.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.191+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f001d070 con 0x7fa9000ff080 2022-09-07T19:43:46.203 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.191+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fa8f000f830 con 0x7fa9000ff080 2022-09-07T19:43:46.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.191+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00048a0 con 0x7fa9000ff080 2022-09-07T19:43:46.204 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.191+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f0009470 con 0x7fa9000ff080 2022-09-07T19:43:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.191+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90019e130 con 0x7fa9000ff080 2022-09-07T19:43:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.192+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa900109650 con 0x7fa9000ff080 2022-09-07T19:43:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.194+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fa8f0028030 con 0x7fa9000ff080 2022-09-07T19:43:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.195+0000 7fa8f77fe700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa8ec099010 0x7fa8ec09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.195+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fa8f00c3260 con 0x7fa9000ff080 2022-09-07T19:43:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.195+0000 7fa9064dd700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa8ec099010 0x7fa8ec09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.196+0000 7fa9064dd700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa8ec099010 0x7fa8ec09b4c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa9001971c0 tx=0x7fa8fc005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.199+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fa8f0059c80 con 0x7fa9000ff080 2022-09-07T19:43:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.418+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa90005fb30 con 0x7fa8ec099010 2022-09-07T19:43:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.431+0000 7fa8f77fe700 1 -- 172.21.15.80:0/3608514290 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4216 (secure 0 0 0) 0x7fa90005fb30 con 0x7fa8ec099010 2022-09-07T19:43:46.432 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-09-07T19:43:46.432 INFO:teuthology.orchestra.run.smithi080.stdout:mds.a smithi080 running (109s) 23s ago 109s 17.5M - 17.0.0-14857-g15219419 6405dbf5acb7 e78375c903ec 2022-09-07T19:43:46.432 INFO:teuthology.orchestra.run.smithi080.stdout:mds.b smithi154 running (107s) 33s ago 107s 29.8M - 17.0.0-14857-g15219419 6405dbf5acb7 8e0aabdbe339 2022-09-07T19:43:46.432 INFO:teuthology.orchestra.run.smithi080.stdout:mds.c smithi155 running (2m) 33s ago 2m 17.1M - 17.0.0-14857-g15219419 6405dbf5acb7 953077ae56b5 2022-09-07T19:43:46.433 INFO:teuthology.orchestra.run.smithi080.stdout:mds.d smithi080 running (2m) 23s ago 2m 13.9M - 17.0.0-14857-g15219419 6405dbf5acb7 d17ea1c6854d 2022-09-07T19:43:46.433 INFO:teuthology.orchestra.run.smithi080.stdout:mds.e smithi154 running (2m) 33s ago 2m 18.6M - 17.0.0-14857-g15219419 6405dbf5acb7 61e0a479db13 2022-09-07T19:43:46.433 INFO:teuthology.orchestra.run.smithi080.stdout:mds.f smithi155 running (2m) 33s ago 2m 15.1M - 17.0.0-14857-g15219419 6405dbf5acb7 65f9ef623a94 2022-09-07T19:43:46.433 INFO:teuthology.orchestra.run.smithi080.stdout:mds.g smithi080 running (113s) 23s ago 112s 13.8M - 17.0.0-14857-g15219419 6405dbf5acb7 f8c029d139e5 2022-09-07T19:43:46.434 INFO:teuthology.orchestra.run.smithi080.stdout:mds.h smithi154 running (118s) 33s ago 118s 18.7M - 17.0.0-14857-g15219419 6405dbf5acb7 07b04eac17ae 2022-09-07T19:43:46.434 INFO:teuthology.orchestra.run.smithi080.stdout:mds.i smithi155 running (116s) 33s ago 116s 18.4M - 17.0.0-14857-g15219419 6405dbf5acb7 de839a81617b 2022-09-07T19:43:46.434 INFO:teuthology.orchestra.run.smithi080.stdout:mds.j smithi080 running (2m) 23s ago 2m 13.9M - 17.0.0-14857-g15219419 6405dbf5acb7 7f3b1f53fd54 2022-09-07T19:43:46.434 INFO:teuthology.orchestra.run.smithi080.stdout:mds.k smithi154 running (2m) 33s ago 2m 17.4M - 17.0.0-14857-g15219419 6405dbf5acb7 ce65e3319fa9 2022-09-07T19:43:46.435 INFO:teuthology.orchestra.run.smithi080.stdout:mds.l smithi155 running (2m) 33s ago 2m 15.3M - 17.0.0-14857-g15219419 6405dbf5acb7 541684929c63 2022-09-07T19:43:46.435 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi080 *:9283,8765 running (9m) 23s ago 9m 501M - 17.0.0-14857-g15219419 6405dbf5acb7 a11bd664fcab 2022-09-07T19:43:46.435 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi154 *:8443 running (7m) 33s ago 7m 433M - 17.0.0-14857-g15219419 6405dbf5acb7 8a748da53927 2022-09-07T19:43:46.435 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.z smithi155 *:8443 running (7m) 33s ago 7m 429M - 17.0.0-14857-g15219419 6405dbf5acb7 d46e54f7efa4 2022-09-07T19:43:46.435 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (10m) 23s ago 10m 95.3M 2048M 17.0.0-14857-g15219419 6405dbf5acb7 5f6fe6e336d5 2022-09-07T19:43:46.436 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi154 running (8m) 33s ago 8m 65.5M 2048M 17.0.0-14857-g15219419 6405dbf5acb7 a65d4b6d39ea 2022-09-07T19:43:46.436 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi155 running (8m) 33s ago 8m 67.0M 2048M 17.0.0-14857-g15219419 6405dbf5acb7 1d5daf74a68d 2022-09-07T19:43:46.436 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (7m) 23s ago 7m 70.3M 4317M 17.0.0-14857-g15219419 6405dbf5acb7 ae1e11e10355 2022-09-07T19:43:46.436 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi154 running (7m) 33s ago 7m 75.4M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 1dd832fe055f 2022-09-07T19:43:46.437 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi155 running (6m) 33s ago 6m 75.7M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 bad3f475be4b 2022-09-07T19:43:46.437 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (6m) 23s ago 6m 65.4M 4317M 17.0.0-14857-g15219419 6405dbf5acb7 0e3eb52da6fa 2022-09-07T19:43:46.437 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi154 running (5m) 33s ago 5m 66.2M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 0722453f3f01 2022-09-07T19:43:46.437 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi155 running (5m) 33s ago 5m 69.5M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 ce37e9915607 2022-09-07T19:43:46.437 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi080 running (4m) 23s ago 4m 60.6M 4317M 17.0.0-14857-g15219419 6405dbf5acb7 edacd38c5dbb 2022-09-07T19:43:46.438 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi154 running (4m) 33s ago 4m 67.3M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 e3a3d838f8ac 2022-09-07T19:43:46.438 INFO:teuthology.orchestra.run.smithi080.stdout:osd.8 smithi155 running (3m) 33s ago 3m 60.9M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 0ce5d85e017a 2022-09-07T19:43:46.438 INFO:teuthology.orchestra.run.smithi080.stdout:osd.9 smithi080 running (3m) 23s ago 3m 61.6M 4317M 17.0.0-14857-g15219419 6405dbf5acb7 16ab62e7b63c 2022-09-07T19:43:46.438 INFO:teuthology.orchestra.run.smithi080.stdout:osd.10 smithi154 running (2m) 33s ago 2m 60.2M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 fa4a31af1846 2022-09-07T19:43:46.439 INFO:teuthology.orchestra.run.smithi080.stdout:osd.11 smithi155 running (2m) 33s ago 2m 60.0M 4292M 17.0.0-14857-g15219419 6405dbf5acb7 07d560f55045 2022-09-07T19:43:46.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.433+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa8ec099010 msgr2=0x7fa8ec09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:46.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.433+0000 7fa908741700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa8ec099010 0x7fa8ec09b4c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa9001971c0 tx=0x7fa8fc005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.433+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 msgr2=0x7fa900196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.433+0000 7fa908741700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa900196230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0006010 tx=0x7fa8f000f690 comp rx=0 tx=0).stop 2022-09-07T19:43:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 shutdown_connections 2022-09-07T19:43:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fa8ec099010 0x7fa8ec09b4c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000ffa30 0x7fa90019d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000fde10 0x7fa900195cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 --2- 172.21.15.80:0/3608514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9000ff080 0x7fa900196230 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:46.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 >> 172.21.15.80:0/3608514290 conn(0x7fa9000f9570 msgr2=0x7fa900104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:46.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 shutdown_connections 2022-09-07T19:43:46.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:46.434+0000 7fa908741700 1 -- 172.21.15.80:0/3608514290 wait complete. 2022-09-07T19:43:46.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph orch ls' 2022-09-07T19:43:47.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:47 smithi080 ceph-mon[90124]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 7 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:47.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:47 smithi080 ceph-mon[90124]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:47.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:47 smithi154 ceph-mon[96967]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 7 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:47.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:47 smithi154 ceph-mon[96967]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:47 smithi155 ceph-mon[97606]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 7 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:47.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:47 smithi155 ceph-mon[97606]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:47.796 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:49.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:49 smithi080 ceph-mon[90124]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 895 B/s wr, 5 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:49.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 -- 172.21.15.80:0/587371490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 msgr2=0x7f86a0101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:49.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 --2- 172.21.15.80:0/587371490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 0x7f86a0101740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8694009810 tx=0x7f8694009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:49.404 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 -- 172.21.15.80:0/587371490 shutdown_connections 2022-09-07T19:43:49.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 --2- 172.21.15.80:0/587371490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a0101c80 0x7f86a0108540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 --2- 172.21.15.80:0/587371490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 --2- 172.21.15.80:0/587371490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 0x7f86a0101740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.405 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 -- 172.21.15.80:0/587371490 >> 172.21.15.80:0/587371490 conn(0x7f86a00fb890 msgr2=0x7f86a00fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:49.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 -- 172.21.15.80:0/587371490 shutdown_connections 2022-09-07T19:43:49.406 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.404+0000 7f86a5a28700 1 -- 172.21.15.80:0/587371490 wait complete. 2022-09-07T19:43:49.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 Processor -- start 2022-09-07T19:43:49.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 -- start start 2022-09-07T19:43:49.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:49.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 0x7f86a0196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:49.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a0101c80 0x7f86a019d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:49.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a019d7e0 con 0x7f86a01012f0 2022-09-07T19:43:49.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a019d950 con 0x7f86a0100070 2022-09-07T19:43:49.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.406+0000 7f86a5a28700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a019db10 con 0x7f86a0101c80 2022-09-07T19:43:49.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:49.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:47060/0 (socket says 172.21.15.80:47060) 2022-09-07T19:43:49.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 0x7f86a0196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:49.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 -- 172.21.15.80:0/2515992122 learned_addr learned my addr 172.21.15.80:0/2515992122 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:49.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869f7fe700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a0101c80 0x7f86a019d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:49.411 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 -- 172.21.15.80:0/2515992122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a0101c80 msgr2=0x7f86a019d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:49.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a0101c80 0x7f86a019d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 -- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 msgr2=0x7f86a0196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:49.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 0x7f86a0196160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 -- 172.21.15.80:0/2515992122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694009470 con 0x7f86a0100070 2022-09-07T19:43:49.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.407+0000 7f869effd700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0195c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f869000e710 tx=0x7f869000ea20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:49.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.408+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690004220 con 0x7f86a0100070 2022-09-07T19:43:49.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.408+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a019ddf0 con 0x7f86a0100070 2022-09-07T19:43:49.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.408+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f8690004380 con 0x7f86a0100070 2022-09-07T19:43:49.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.408+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690003cf0 con 0x7f86a0100070 2022-09-07T19:43:49.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.408+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a019e270 con 0x7f86a0100070 2022-09-07T19:43:49.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.409+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a010b830 con 0x7f86a0100070 2022-09-07T19:43:49.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.411+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f869001e020 con 0x7f86a0100070 2022-09-07T19:43:49.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.412+0000 7f86a4a26700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8688099090 0x7f868809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:49.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.412+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f8690014070 con 0x7f86a0100070 2022-09-07T19:43:49.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.413+0000 7f869e7fc700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8688099090 0x7f868809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:49.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.413+0000 7f869e7fc700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8688099090 0x7f868809b540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f869400b4f0 tx=0x7f8694009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:49.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.417+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f869008ebd0 con 0x7f86a0100070 2022-09-07T19:43:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:49 smithi154 ceph-mon[96967]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 895 B/s wr, 5 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.638+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f86a005fbd0 con 0x7f8688099090 2022-09-07T19:43:49.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.644+0000 7f86a4a26700 1 -- 172.21.15.80:0/2515992122 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f86a005fbd0 con 0x7f8688099090 2022-09-07T19:43:49.643 INFO:teuthology.orchestra.run.smithi080.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2022-09-07T19:43:49.643 INFO:teuthology.orchestra.run.smithi080.stdout:mds.all 12/12 36s ago 2m smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi155=c;smithi155=f;smithi155=i;smithi155=l;count:12 2022-09-07T19:43:49.644 INFO:teuthology.orchestra.run.smithi080.stdout:mgr 3/3 36s ago 8m smithi080=x;smithi154=y;smithi155=z;count:3 2022-09-07T19:43:49.644 INFO:teuthology.orchestra.run.smithi080.stdout:mon 3/3 36s ago 8m smithi080:172.21.15.80=a;smithi154:172.21.15.154=b;smithi155:172.21.15.155=c;count:3 2022-09-07T19:43:49.644 INFO:teuthology.orchestra.run.smithi080.stdout:osd 12 36s ago - 2022-09-07T19:43:49.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8688099090 msgr2=0x7f868809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:49.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8688099090 0x7f868809b540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f869400b4f0 tx=0x7f8694009eb0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 msgr2=0x7f86a0195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:49.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0195c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f869000e710 tx=0x7f869000ea20 comp rx=0 tx=0).stop 2022-09-07T19:43:49.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 shutdown_connections 2022-09-07T19:43:49.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8688099090 0x7f868809b540 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a0101c80 0x7f86a019d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a0100070 0x7f86a0195c20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 --2- 172.21.15.80:0/2515992122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86a01012f0 0x7f86a0196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:49.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 >> 172.21.15.80:0/2515992122 conn(0x7f86a00fb890 msgr2=0x7f86a00fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:49.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 shutdown_connections 2022-09-07T19:43:49.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:49.646+0000 7f86a5a28700 1 -- 172.21.15.80:0/2515992122 wait complete. 2022-09-07T19:43:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:49 smithi155 ceph-mon[97606]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 895 B/s wr, 5 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:50.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph orch host ls' 2022-09-07T19:43:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:51.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:51 smithi080 ceph-mon[90124]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:51.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:51 smithi080 ceph-mon[90124]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 895 B/s wr, 7 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:51 smithi154 ceph-mon[96967]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:51 smithi154 ceph-mon[96967]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 895 B/s wr, 7 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:51 smithi155 ceph-mon[97606]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:51 smithi155 ceph-mon[97606]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 895 B/s wr, 7 op/s; 7.6 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:52.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 -- 172.21.15.80:0/1983099421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0fc540 msgr2=0x7fd10c0fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:52.488 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 --2- 172.21.15.80:0/1983099421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0fc540 0x7fd10c0fe960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009810 tx=0x7fd0fc009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:52.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 -- 172.21.15.80:0/1983099421 shutdown_connections 2022-09-07T19:43:52.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 --2- 172.21.15.80:0/1983099421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c101860 0x7fd10c101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 --2- 172.21.15.80:0/1983099421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0fc540 0x7fd10c0fe960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 --2- 172.21.15.80:0/1983099421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0feea0 0x7fd10c101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 -- 172.21.15.80:0/1983099421 >> 172.21.15.80:0/1983099421 conn(0x7fd10c0f81f0 msgr2=0x7fd10c0fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:52.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 -- 172.21.15.80:0/1983099421 shutdown_connections 2022-09-07T19:43:52.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.488+0000 7fd10bfff700 1 -- 172.21.15.80:0/1983099421 wait complete. 2022-09-07T19:43:52.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.489+0000 7fd10bfff700 1 Processor -- start 2022-09-07T19:43:52.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 -- start start 2022-09-07T19:43:52.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 0x7fd10c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:52.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c0feea0 0x7fd10c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:52.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c101860 0x7fd10c1a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:52.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c1a19a0 con 0x7fd10c0fc540 2022-09-07T19:43:52.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c1a1b10 con 0x7fd10c0feea0 2022-09-07T19:43:52.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10bfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c1a1cd0 con 0x7fd10c101860 2022-09-07T19:43:52.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 0x7fd10c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:52.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 0x7fd10c199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58754/0 (socket says 172.21.15.80:58754) 2022-09-07T19:43:52.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c101860 0x7fd10c1a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:52.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10affd700 1 -- 172.21.15.80:0/941195277 learned_addr learned my addr 172.21.15.80:0/941195277 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:52.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.490+0000 7fd10a7fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c0feea0 0x7fd10c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:52.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10affd700 1 -- 172.21.15.80:0/941195277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c101860 msgr2=0x7fd10c1a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:52.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10affd700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c101860 0x7fd10c1a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10affd700 1 -- 172.21.15.80:0/941195277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c0feea0 msgr2=0x7fd10c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:52.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10affd700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c0feea0 0x7fd10c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10affd700 1 -- 172.21.15.80:0/941195277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000093b0 con 0x7fd10c0fc540 2022-09-07T19:43:52.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10a7fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c0feea0 0x7fd10c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:52.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10affd700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 0x7fd10c199e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0059c0 tx=0x7fd0fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:52.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc01d070 con 0x7fd10c0fc540 2022-09-07T19:43:52.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd10bfff700 1 -- 172.21.15.80:0/941195277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc009470 con 0x7fd10c0fc540 2022-09-07T19:43:52.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd0fc00f880 con 0x7fd10c0fc540 2022-09-07T19:43:52.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.491+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0047d0 con 0x7fd10c0fc540 2022-09-07T19:43:52.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.492+0000 7fd10bfff700 1 -- 172.21.15.80:0/941195277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c1a2200 con 0x7fd10c0fc540 2022-09-07T19:43:52.506 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.493+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c10fa00 con 0x7fd10c0fc540 2022-09-07T19:43:52.506 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.494+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fd0fc028030 con 0x7fd10c0fc540 2022-09-07T19:43:52.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.496+0000 7fd1108e1700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd0f4099090 0x7fd0f409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:52.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.497+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fd0fc0c3390 con 0x7fd10c0fc540 2022-09-07T19:43:52.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.497+0000 7fd10a7fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd0f4099090 0x7fd0f409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:52.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.497+0000 7fd10a7fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd0f4099090 0x7fd0f409b540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd100005fd0 tx=0x7fd100005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:52.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.501+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fd0fc08f690 con 0x7fd10c0fc540 2022-09-07T19:43:52.725 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.726+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd10c05f120 con 0x7fd0f4099090 2022-09-07T19:43:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.727+0000 7fd1108e1700 1 -- 172.21.15.80:0/941195277 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fd10c05f120 con 0x7fd0f4099090 2022-09-07T19:43:52.727 INFO:teuthology.orchestra.run.smithi080.stdout:HOST ADDR LABELS STATUS 2022-09-07T19:43:52.727 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 172.21.15.80 2022-09-07T19:43:52.727 INFO:teuthology.orchestra.run.smithi080.stdout:smithi154 172.21.15.154 2022-09-07T19:43:52.728 INFO:teuthology.orchestra.run.smithi080.stdout:smithi155 172.21.15.155 2022-09-07T19:43:52.728 INFO:teuthology.orchestra.run.smithi080.stdout:3 hosts in cluster 2022-09-07T19:43:52.731 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd0f4099090 msgr2=0x7fd0f409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd0f4099090 0x7fd0f409b540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd100005fd0 tx=0x7fd100005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 msgr2=0x7fd10c199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 0x7fd10c199e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0059c0 tx=0x7fd0fc00f690 comp rx=0 tx=0).stop 2022-09-07T19:43:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 shutdown_connections 2022-09-07T19:43:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd10c0fc540 0x7fd10c199e20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd0f4099090 0x7fd0f409b540 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c101860 0x7fd10c1a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 --2- 172.21.15.80:0/941195277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10c0feea0 0x7fd10c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 >> 172.21.15.80:0/941195277 conn(0x7fd10c0f81f0 msgr2=0x7fd10c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 shutdown_connections 2022-09-07T19:43:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:52.730+0000 7fd0f27fc700 1 -- 172.21.15.80:0/941195277 wait complete. 2022-09-07T19:43:53.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph orch device ls' 2022-09-07T19:43:53.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:53 smithi080 ceph-mon[90124]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 822 B/s wr, 7 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:53.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:53 smithi154 ceph-mon[96967]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 822 B/s wr, 7 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:53 smithi155 ceph-mon[97606]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 822 B/s wr, 7 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:54.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:54 smithi080 ceph-mon[90124]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:54.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:54 smithi154 ceph-mon[96967]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:54.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:54 smithi155 ceph-mon[97606]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:55.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:55 smithi080 ceph-mon[90124]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 716 B/s wr, 6 op/s; 6.1 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:55 smithi154 ceph-mon[96967]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 716 B/s wr, 6 op/s; 6.1 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:55 smithi155 ceph-mon[97606]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 716 B/s wr, 6 op/s; 6.1 KiB/s, 0 keys/s, 1 objects/s recovering 2022-09-07T19:43:55.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 -- 172.21.15.80:0/3806066400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101c90 msgr2=0x7fcb18108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:55.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/3806066400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101c90 0x7fcb18108550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009bb0 tx=0x7fcb10009ec0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.738 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 -- 172.21.15.80:0/3806066400 shutdown_connections 2022-09-07T19:43:55.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/3806066400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101c90 0x7fcb18108550 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/3806066400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 0x7fcb18100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.739 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/3806066400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb18101300 0x7fcb18101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 -- 172.21.15.80:0/3806066400 >> 172.21.15.80:0/3806066400 conn(0x7fcb180fb890 msgr2=0x7fcb180fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:55.740 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 -- 172.21.15.80:0/3806066400 shutdown_connections 2022-09-07T19:43:55.741 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.738+0000 7fcb1fbae700 1 -- 172.21.15.80:0/3806066400 wait complete. 2022-09-07T19:43:55.743 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.739+0000 7fcb1fbae700 1 Processor -- start 2022-09-07T19:43:55.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.739+0000 7fcb1fbae700 1 -- start start 2022-09-07T19:43:55.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1fbae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 0x7fcb18195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:55.744 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1fbae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 0x7fcb18196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:55.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1fbae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb18101c90 0x7fcb1819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:55.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1fbae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1819d800 con 0x7fcb18101300 2022-09-07T19:43:55.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1fbae700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1819d970 con 0x7fcb18100080 2022-09-07T19:43:55.745 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1fbae700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1819db30 con 0x7fcb18101c90 2022-09-07T19:43:55.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1d149700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 0x7fcb18196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:55.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1d149700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 0x7fcb18196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38284/0 (socket says 172.21.15.80:38284) 2022-09-07T19:43:55.746 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1d149700 1 -- 172.21.15.80:0/908058383 learned_addr learned my addr 172.21.15.80:0/908058383 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:55.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1d94a700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 0x7fcb18195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:55.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.740+0000 7fcb1e14b700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb18101c90 0x7fcb1819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:55.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d149700 1 -- 172.21.15.80:0/908058383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb18101c90 msgr2=0x7fcb1819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:55.747 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d149700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb18101c90 0x7fcb1819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d149700 1 -- 172.21.15.80:0/908058383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 msgr2=0x7fcb18195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:55.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d149700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 0x7fcb18195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d149700 1 -- 172.21.15.80:0/908058383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb140093b0 con 0x7fcb18101300 2022-09-07T19:43:55.748 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d94a700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 0x7fcb18195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:43:55.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1d149700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 0x7fcb18196180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800d720 tx=0x7fcb0800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:55.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08004220 con 0x7fcb18101300 2022-09-07T19:43:55.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcb08004380 con 0x7fcb18101300 2022-09-07T19:43:55.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800f8f0 con 0x7fcb18101300 2022-09-07T19:43:55.749 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.741+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100097e0 con 0x7fcb18101300 2022-09-07T19:43:55.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.742+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1819e140 con 0x7fcb18101300 2022-09-07T19:43:55.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.743+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1810b850 con 0x7fcb18101300 2022-09-07T19:43:55.750 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.744+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fcb08021070 con 0x7fcb18101300 2022-09-07T19:43:55.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.746+0000 7fcb0effd700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb04099090 0x7fcb0409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:55.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.746+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fcb080c2390 con 0x7fcb18101300 2022-09-07T19:43:55.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.746+0000 7fcb1d94a700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb04099090 0x7fcb0409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:55.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.747+0000 7fcb1d94a700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb04099090 0x7fcb0409b540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb18197110 tx=0x7fcb14005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:55.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.750+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fcb0808e690 con 0x7fcb18101300 2022-09-07T19:43:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.971+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb1805f120 con 0x7fcb04099090 2022-09-07T19:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.973+0000 7fcb0effd700 1 -- 172.21.15.80:0/908058383 <== mgr.14152 v2:172.21.15.80:6800/202237256 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fcb1805f120 con 0x7fcb04099090 2022-09-07T19:43:55.973 INFO:teuthology.orchestra.run.smithi080.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2022-09-07T19:43:55.973 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204014T400BGN 400G 3m ago LVM detected, locked 2022-09-07T19:43:55.973 INFO:teuthology.orchestra.run.smithi080.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 400G 3m ago LVM detected, locked 2022-09-07T19:43:55.973 INFO:teuthology.orchestra.run.smithi080.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 400G 2m ago LVM detected, locked 2022-09-07T19:43:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb04099090 msgr2=0x7fcb0409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb04099090 0x7fcb0409b540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb18197110 tx=0x7fcb14005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 msgr2=0x7fcb18196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 0x7fcb18196180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800d720 tx=0x7fcb0800da30 comp rx=0 tx=0).stop 2022-09-07T19:43:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 shutdown_connections 2022-09-07T19:43:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcb04099090 0x7fcb0409b540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb18101c90 0x7fcb1819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb18100080 0x7fcb18195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 --2- 172.21.15.80:0/908058383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb18101300 0x7fcb18196180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:55.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 >> 172.21.15.80:0/908058383 conn(0x7fcb180fb890 msgr2=0x7fcb180feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:55.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 shutdown_connections 2022-09-07T19:43:55.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:55.976+0000 7fcb1fbae700 1 -- 172.21.15.80:0/908058383 wait complete. 2022-09-07T19:43:56.468 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-09-07T19:43:56.481 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:43:56.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph fs dump' 2022-09-07T19:43:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:43:57.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:57 smithi080 ceph-mon[90124]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 612 B/s wr, 7 op/s; 5.2 KiB/s, 0 keys/s, 0 objects/s recovering 2022-09-07T19:43:57.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:57 smithi080 ceph-mon[90124]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:57 smithi154 ceph-mon[96967]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 612 B/s wr, 7 op/s; 5.2 KiB/s, 0 keys/s, 0 objects/s recovering 2022-09-07T19:43:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:57 smithi154 ceph-mon[96967]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:57 smithi155 ceph-mon[97606]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 612 B/s wr, 7 op/s; 5.2 KiB/s, 0 keys/s, 0 objects/s recovering 2022-09-07T19:43:57.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:57 smithi155 ceph-mon[97606]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:43:58.990 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.990+0000 7f8f94884700 1 -- 172.21.15.80:0/2477634569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900fdc50 msgr2=0x7f8f900fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.990+0000 7f8f94884700 1 --2- 172.21.15.80:0/2477634569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900fdc50 0x7f8f900fe060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009810 tx=0x7f8f80009b20 comp rx=0 tx=0).stop 2022-09-07T19:43:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 -- 172.21.15.80:0/2477634569 shutdown_connections 2022-09-07T19:43:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 --2- 172.21.15.80:0/2477634569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f900ff860 0x7f8f90106120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 --2- 172.21.15.80:0/2477634569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900fdc50 0x7f8f900fe060 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 --2- 172.21.15.80:0/2477634569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900feed0 0x7f8f900ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 -- 172.21.15.80:0/2477634569 >> 172.21.15.80:0/2477634569 conn(0x7f8f900f9320 msgr2=0x7f8f900fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 -- 172.21.15.80:0/2477634569 shutdown_connections 2022-09-07T19:43:58.993 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.991+0000 7f8f94884700 1 -- 172.21.15.80:0/2477634569 wait complete. 2022-09-07T19:43:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 Processor -- start 2022-09-07T19:43:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 -- start start 2022-09-07T19:43:58.995 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 0x7f8f90195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900feed0 0x7f8f90195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f900ff860 0x7f8f9019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9019d620 con 0x7f8f900fdc50 2022-09-07T19:43:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9019d790 con 0x7f8f900ff860 2022-09-07T19:43:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.992+0000 7f8f94884700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9019d950 con 0x7f8f900feed0 2022-09-07T19:43:58.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 0x7f8f90195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:58.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 0x7f8f90195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38296/0 (socket says 172.21.15.80:38296) 2022-09-07T19:43:58.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 -- 172.21.15.80:0/600407742 learned_addr learned my addr 172.21.15.80:0/600407742 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:43:58.997 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8e59c700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900feed0 0x7f8f90195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:58.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8f59e700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f900ff860 0x7f8f9019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:58.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 -- 172.21.15.80:0/600407742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900feed0 msgr2=0x7f8f90195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:58.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900feed0 0x7f8f90195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:58.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 -- 172.21.15.80:0/600407742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f900ff860 msgr2=0x7f8f9019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:58.998 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f900ff860 0x7f8f9019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:58.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 -- 172.21.15.80:0/600407742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840093b0 con 0x7f8f900fdc50 2022-09-07T19:43:58.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.993+0000 7f8f8ed9d700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 0x7f8f90195aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006010 tx=0x7f8f8000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:58.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.994+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8001d070 con 0x7f8f900fdc50 2022-09-07T19:43:58.999 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.994+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f80009470 con 0x7f8f900fdc50 2022-09-07T19:43:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.994+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f8f8000f830 con 0x7f8f900fdc50 2022-09-07T19:43:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.994+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004740 con 0x7f8f900fdc50 2022-09-07T19:43:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.994+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9019df40 con 0x7f8f900fdc50 2022-09-07T19:43:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.995+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f901093b0 con 0x7f8f900fdc50 2022-09-07T19:43:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.997+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f8f80028030 con 0x7f8f900fdc50 2022-09-07T19:43:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.999+0000 7f8f77fff700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8f78099090 0x7f8f7809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:43:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.999+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f8f800c3430 con 0x7f8f900fdc50 2022-09-07T19:43:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:58.999+0000 7f8f8e59c700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8f78099090 0x7f8f7809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:43:59.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.000+0000 7f8f8e59c700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8f78099090 0x7f8f7809b540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005fd0 tx=0x7f8f84005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:43:59.003 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.003+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f8f8008f730 con 0x7f8f900fdc50 2022-09-07T19:43:59.261 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.261+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f9005fa30 con 0x7f8f900fdc50 2022-09-07T19:43:59.262 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.262+0000 7f8f77fff700 1 -- 172.21.15.80:0/600407742 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+2863 (secure 0 0 0) 0x7f8f80026b40 con 0x7f8f900fdc50 2022-09-07T19:43:59.262 INFO:teuthology.orchestra.run.smithi080.stdout:e24 2022-09-07T19:43:59.263 INFO:teuthology.orchestra.run.smithi080.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-09-07T19:43:59.263 INFO:teuthology.orchestra.run.smithi080.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-09-07T19:43:59.264 INFO:teuthology.orchestra.run.smithi080.stdout:legacy client fscid: 1 2022-09-07T19:43:59.264 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:59.265 INFO:teuthology.orchestra.run.smithi080.stdout:Filesystem 'cephfs' (1) 2022-09-07T19:43:59.265 INFO:teuthology.orchestra.run.smithi080.stdout:fs_name cephfs 2022-09-07T19:43:59.266 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 24 2022-09-07T19:43:59.266 INFO:teuthology.orchestra.run.smithi080.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-09-07T19:43:59.267 INFO:teuthology.orchestra.run.smithi080.stdout:created 2022-09-07T19:42:06.917499+0000 2022-09-07T19:43:59.267 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2022-09-07T19:42:38.506873+0000 2022-09-07T19:43:59.268 INFO:teuthology.orchestra.run.smithi080.stdout:tableserver 0 2022-09-07T19:43:59.268 INFO:teuthology.orchestra.run.smithi080.stdout:root 0 2022-09-07T19:43:59.268 INFO:teuthology.orchestra.run.smithi080.stdout:session_timeout 300 2022-09-07T19:43:59.269 INFO:teuthology.orchestra.run.smithi080.stdout:session_autoclose 300 2022-09-07T19:43:59.269 INFO:teuthology.orchestra.run.smithi080.stdout:max_file_size 1099511627776 2022-09-07T19:43:59.270 INFO:teuthology.orchestra.run.smithi080.stdout:required_client_features {} 2022-09-07T19:43:59.270 INFO:teuthology.orchestra.run.smithi080.stdout:last_failure 0 2022-09-07T19:43:59.271 INFO:teuthology.orchestra.run.smithi080.stdout:last_failure_osd_epoch 0 2022-09-07T19:43:59.271 INFO:teuthology.orchestra.run.smithi080.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-09-07T19:43:59.272 INFO:teuthology.orchestra.run.smithi080.stdout:max_mds 3 2022-09-07T19:43:59.272 INFO:teuthology.orchestra.run.smithi080.stdout:in 0,1,2 2022-09-07T19:43:59.273 INFO:teuthology.orchestra.run.smithi080.stdout:up {0=24575,1=24569,2=24533} 2022-09-07T19:43:59.273 INFO:teuthology.orchestra.run.smithi080.stdout:failed 2022-09-07T19:43:59.274 INFO:teuthology.orchestra.run.smithi080.stdout:damaged 2022-09-07T19:43:59.274 INFO:teuthology.orchestra.run.smithi080.stdout:stopped 2022-09-07T19:43:59.275 INFO:teuthology.orchestra.run.smithi080.stdout:data_pools [3,4] 2022-09-07T19:43:59.275 INFO:teuthology.orchestra.run.smithi080.stdout:metadata_pool 2 2022-09-07T19:43:59.276 INFO:teuthology.orchestra.run.smithi080.stdout:inline_data disabled 2022-09-07T19:43:59.276 INFO:teuthology.orchestra.run.smithi080.stdout:balancer 2022-09-07T19:43:59.277 INFO:teuthology.orchestra.run.smithi080.stdout:standby_count_wanted 0 2022-09-07T19:43:59.277 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b{0:24575} state up:active seq 3 addr [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.277 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.i{0:24523} state up:standby-replay seq 1 addr [v2:172.21.15.155:6838/560140413,v1:172.21.15.155:6839/560140413] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.278 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a{1:24569} state up:active seq 11 addr [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.278 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c{1:24508} state up:standby-replay seq 1 addr [v2:172.21.15.155:6836/415293574,v1:172.21.15.155:6837/415293574] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.279 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.h{2:24533} state up:active seq 14 addr [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.279 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.e{2:24500} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/1088711156,v1:172.21.15.154:6835/1088711156] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.279 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:59.280 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:59.280 INFO:teuthology.orchestra.run.smithi080.stdout:Standby daemons: 2022-09-07T19:43:59.281 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:43:59.281 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.g{-1:14463} state up:standby seq 1 addr [v2:172.21.15.80:6838/4122966657,v1:172.21.15.80:6839/4122966657] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.282 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.l{-1:24451} state up:standby seq 1 addr [v2:172.21.15.155:6832/4090687760,v1:172.21.15.155:6833/4090687760] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.282 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.j{-1:24466} state up:standby seq 1 addr [v2:172.21.15.80:6834/1459419816,v1:172.21.15.80:6835/1459419816] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.282 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.k{-1:24470} state up:standby seq 1 addr [v2:172.21.15.154:6832/788391399,v1:172.21.15.154:6833/788391399] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.283 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d{-1:24478} state up:standby seq 1 addr [v2:172.21.15.80:6836/1565389450,v1:172.21.15.80:6837/1565389450] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.283 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.f{-1:24496} state up:standby seq 1 addr [v2:172.21.15.155:6834/1281093891,v1:172.21.15.155:6835/1281093891] compat {c=[1],r=[1],i=[7ff]}] 2022-09-07T19:43:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8f78099090 msgr2=0x7f8f7809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8f78099090 0x7f8f7809b540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005fd0 tx=0x7f8f84005ea0 comp rx=0 tx=0).stop 2022-09-07T19:43:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 msgr2=0x7f8f90195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:43:59.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 0x7f8f90195aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006010 tx=0x7f8f8000f690 comp rx=0 tx=0).stop 2022-09-07T19:43:59.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 shutdown_connections 2022-09-07T19:43:59.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f900fdc50 0x7f8f90195aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:59.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f8f78099090 0x7f8f7809b540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:59.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f900ff860 0x7f8f9019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:59.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 --2- 172.21.15.80:0/600407742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f900feed0 0x7f8f90195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:43:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 >> 172.21.15.80:0/600407742 conn(0x7f8f900f9320 msgr2=0x7f8f90104920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:43:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 shutdown_connections 2022-09-07T19:43:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:43:59.264+0000 7f8f94884700 1 -- 172.21.15.80:0/600407742 wait complete. 2022-09-07T19:43:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2022-09-07T19:43:59.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:59 smithi080 ceph-mon[90124]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:43:59.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:43:59 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/600407742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-09-07T19:43:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:59 smithi154 ceph-mon[96967]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:43:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:43:59 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/600407742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-09-07T19:43:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:59 smithi155 ceph-mon[97606]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:43:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:43:59 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/600407742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-09-07T19:43:59.736 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- bash -c 'ceph osd dump' 2022-09-07T19:44:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:44:01.607 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:01 smithi080 ceph-mon[90124]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:44:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:01 smithi154 ceph-mon[96967]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:44:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:01 smithi155 ceph-mon[97606]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:44:02.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 -- 172.21.15.80:0/1511895972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb0101860 msgr2=0x7fdbb0101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:02.267 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/1511895972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb0101860 0x7fdbb0101cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009bb0 tx=0x7fdba8009ec0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 -- 172.21.15.80:0/1511895972 shutdown_connections 2022-09-07T19:44:02.268 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/1511895972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb0101860 0x7fdbb0101cd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/1511895972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb00fc540 0x7fdbb00fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/1511895972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb00feea0 0x7fdbb0101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.269 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 -- 172.21.15.80:0/1511895972 >> 172.21.15.80:0/1511895972 conn(0x7fdbb00f81f0 msgr2=0x7fdbb00fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:02.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 -- 172.21.15.80:0/1511895972 shutdown_connections 2022-09-07T19:44:02.270 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.267+0000 7fdbaf59e700 1 -- 172.21.15.80:0/1511895972 wait complete. 2022-09-07T19:44:02.274 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.268+0000 7fdbaf59e700 1 Processor -- start 2022-09-07T19:44:02.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.268+0000 7fdbaf59e700 1 -- start start 2022-09-07T19:44:02.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaf59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb00fc540 0x7fdbb0199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:02.275 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaf59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 0x7fdbb019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:02.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaf59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb0101860 0x7fdbb01a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:02.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaf59e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01a19a0 con 0x7fdbb00feea0 2022-09-07T19:44:02.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaf59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01a1b10 con 0x7fdbb00fc540 2022-09-07T19:44:02.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaf59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01a1cd0 con 0x7fdbb0101860 2022-09-07T19:44:02.276 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 0x7fdbb019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:02.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 0x7fdbb019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38316/0 (socket says 172.21.15.80:38316) 2022-09-07T19:44:02.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 -- 172.21.15.80:0/3156711692 learned_addr learned my addr 172.21.15.80:0/3156711692 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:02.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbae59c700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb00fc540 0x7fdbb0199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:02.277 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaed9d700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb0101860 0x7fdbb01a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 -- 172.21.15.80:0/3156711692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb0101860 msgr2=0x7fdbb01a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb0101860 0x7fdbb01a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 -- 172.21.15.80:0/3156711692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb00fc540 msgr2=0x7fdbb0199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb00fc540 0x7fdbb0199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbadd9b700 1 -- 172.21.15.80:0/3156711692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80097e0 con 0x7fdbb00feea0 2022-09-07T19:44:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.269+0000 7fdbaed9d700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb0101860 0x7fdbb01a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:44:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.270+0000 7fdbadd9b700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 0x7fdbb019a360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba400e740 tx=0x7fdba400ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.270+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4005220 con 0x7fdbb00feea0 2022-09-07T19:44:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.270+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fdba4005380 con 0x7fdbb00feea0 2022-09-07T19:44:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.270+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb01a1fb0 con 0x7fdbb00feea0 2022-09-07T19:44:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.270+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4004c10 con 0x7fdbb00feea0 2022-09-07T19:44:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.270+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb01a2480 con 0x7fdbb00feea0 2022-09-07T19:44:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.271+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb880051a0 con 0x7fdbb00feea0 2022-09-07T19:44:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.273+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fdba401e020 con 0x7fdbb00feea0 2022-09-07T19:44:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.274+0000 7fdb9f7fe700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb98099090 0x7fdb9809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.274+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fdba4014070 con 0x7fdbb00feea0 2022-09-07T19:44:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.275+0000 7fdbae59c700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb98099090 0x7fdb9809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.275+0000 7fdbae59c700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb98099090 0x7fdb9809b540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba0005fd0 tx=0x7fdba0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.278+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fdba408eca0 con 0x7fdbb00feea0 2022-09-07T19:44:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.495+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fdb88006080 con 0x7fdbb00feea0 2022-09-07T19:44:02.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.496+0000 7fdb9f7fe700 1 -- 172.21.15.80:0/3156711692 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) v1 ==== 56+0+5629 (secure 0 0 0) 0x7fdba40922c0 con 0x7fdbb00feea0 2022-09-07T19:44:02.496 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 93 2022-09-07T19:44:02.496 INFO:teuthology.orchestra.run.smithi080.stdout:fsid cc599a0c-2ee3-11ed-8431-001a4aab830c 2022-09-07T19:44:02.497 INFO:teuthology.orchestra.run.smithi080.stdout:created 2022-09-07T19:33:38.884591+0000 2022-09-07T19:44:02.497 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2022-09-07T19:43:44.244098+0000 2022-09-07T19:44:02.497 INFO:teuthology.orchestra.run.smithi080.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2022-09-07T19:44:02.497 INFO:teuthology.orchestra.run.smithi080.stdout:crush_version 27 2022-09-07T19:44:02.498 INFO:teuthology.orchestra.run.smithi080.stdout:full_ratio 0.95 2022-09-07T19:44:02.498 INFO:teuthology.orchestra.run.smithi080.stdout:backfillfull_ratio 0.9 2022-09-07T19:44:02.498 INFO:teuthology.orchestra.run.smithi080.stdout:nearfull_ratio 0.85 2022-09-07T19:44:02.498 INFO:teuthology.orchestra.run.smithi080.stdout:require_min_compat_client luminous 2022-09-07T19:44:02.499 INFO:teuthology.orchestra.run.smithi080.stdout:min_compat_client luminous 2022-09-07T19:44:02.499 INFO:teuthology.orchestra.run.smithi080.stdout:require_osd_release quincy 2022-09-07T19:44:02.499 INFO:teuthology.orchestra.run.smithi080.stdout:stretch_mode_enabled false 2022-09-07T19:44:02.499 INFO:teuthology.orchestra.run.smithi080.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2022-09-07T19:44:02.499 INFO:teuthology.orchestra.run.smithi080.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs 2022-09-07T19:44:02.500 INFO:teuthology.orchestra.run.smithi080.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs 2022-09-07T19:44:02.500 INFO:teuthology.orchestra.run.smithi080.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2022-09-07T19:44:02.500 INFO:teuthology.orchestra.run.smithi080.stdout:max_osd 12 2022-09-07T19:44:02.500 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6802/2369094167,v1:172.21.15.80:6803/2369094167] [v2:172.21.15.80:6804/2369094167,v1:172.21.15.80:6805/2369094167] exists,up 022d8b5d-40e6-41d4-88ad-58fdf010d250 2022-09-07T19:44:02.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/406062851,v1:172.21.15.154:6801/406062851] [v2:172.21.15.154:6802/406062851,v1:172.21.15.154:6803/406062851] exists,up c5f59885-06fb-4869-81ab-b0cab1580cba 2022-09-07T19:44:02.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 up in weight 1 up_from 18 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/612567913,v1:172.21.15.155:6801/612567913] [v2:172.21.15.155:6802/612567913,v1:172.21.15.155:6803/612567913] exists,up 9d02a02f-84eb-4310-8c4e-bea1be050f7f 2022-09-07T19:44:02.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6810/362298487,v1:172.21.15.80:6811/362298487] [v2:172.21.15.80:6812/362298487,v1:172.21.15.80:6813/362298487] exists,up 489c00ce-8e46-462f-85ee-9444ff4540ec 2022-09-07T19:44:02.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/4252118090,v1:172.21.15.154:6809/4252118090] [v2:172.21.15.154:6810/4252118090,v1:172.21.15.154:6811/4252118090] exists,up 25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6 2022-09-07T19:44:02.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 up in weight 1 up_from 38 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6808/181497455,v1:172.21.15.155:6809/181497455] [v2:172.21.15.155:6810/181497455,v1:172.21.15.155:6811/181497455] exists,up d3d50e79-fa11-4704-aed7-278b832cfc05 2022-09-07T19:44:02.502 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 up in weight 1 up_from 46 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6818/2212671377,v1:172.21.15.80:6819/2212671377] [v2:172.21.15.80:6820/2212671377,v1:172.21.15.80:6821/2212671377] exists,up f293a0d2-be68-4495-8419-9fb71666554c 2022-09-07T19:44:02.502 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/1270586283,v1:172.21.15.154:6817/1270586283] [v2:172.21.15.154:6818/1270586283,v1:172.21.15.154:6819/1270586283] exists,up 710d71e8-8f3a-432b-a7b4-c2962d0f6d32 2022-09-07T19:44:02.502 INFO:teuthology.orchestra.run.smithi080.stdout:osd.8 up in weight 1 up_from 59 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6816/2568819573,v1:172.21.15.155:6817/2568819573] [v2:172.21.15.155:6818/2568819573,v1:172.21.15.155:6819/2568819573] exists,up f17b0b5e-b37e-4026-927e-f5172cd5abbe 2022-09-07T19:44:02.502 INFO:teuthology.orchestra.run.smithi080.stdout:osd.9 up in weight 1 up_from 67 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6826/3406803388,v1:172.21.15.80:6827/3406803388] [v2:172.21.15.80:6828/3406803388,v1:172.21.15.80:6829/3406803388] exists,up f44e9821-dbca-493a-99c6-4d4439873b53 2022-09-07T19:44:02.503 INFO:teuthology.orchestra.run.smithi080.stdout:osd.10 up in weight 1 up_from 72 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/1234206337,v1:172.21.15.154:6825/1234206337] [v2:172.21.15.154:6826/1234206337,v1:172.21.15.154:6827/1234206337] exists,up dfa508c5-47de-4d2b-acf3-8f4a0776dd98 2022-09-07T19:44:02.503 INFO:teuthology.orchestra.run.smithi080.stdout:osd.11 up in weight 1 up_from 80 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6824/137888946,v1:172.21.15.155:6825/137888946] [v2:172.21.15.155:6826/137888946,v1:172.21.15.155:6827/137888946] exists,up 37b9e7ef-ee23-4345-98d1-1a07ab13dc0f 2022-09-07T19:44:02.503 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.6 [8,11] 2022-09-07T19:44:02.503 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.f [8,11] 2022-09-07T19:44:02.503 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.14 [2,4] 2022-09-07T19:44:02.504 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.1b [2,1] 2022-09-07T19:44:02.504 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.e [4,8,5,9] 2022-09-07T19:44:02.504 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.1a [5,6] 2022-09-07T19:44:02.504 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.1e [3,9] 2022-09-07T19:44:02.505 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.28 [3,6] 2022-09-07T19:44:02.505 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.31 [4,7] 2022-09-07T19:44:02.505 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.3c [4,9] 2022-09-07T19:44:02.506 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.2 [9,1] 2022-09-07T19:44:02.506 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.c [9,10] 2022-09-07T19:44:02.506 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.14 [9,8] 2022-09-07T19:44:02.507 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.1c [5,8] 2022-09-07T19:44:02.507 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/1499799081 expires 2022-09-08T19:34:41.782435+0000 2022-09-07T19:44:02.507 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/1499799081 expires 2022-09-08T19:34:41.782435+0000 2022-09-07T19:44:02.507 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/722803782 expires 2022-09-08T19:34:41.782435+0000 2022-09-07T19:44:02.507 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/2842896476 expires 2022-09-08T19:34:13.528508+0000 2022-09-07T19:44:02.508 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1903100695 expires 2022-09-08T19:34:13.528508+0000 2022-09-07T19:44:02.508 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/146266391 expires 2022-09-08T19:34:41.782435+0000 2022-09-07T19:44:02.508 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/2842896476 expires 2022-09-08T19:34:13.528508+0000 2022-09-07T19:44:02.508 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/4051851685 expires 2022-09-08T19:34:41.782435+0000 2022-09-07T19:44:02.509 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/3462161622 expires 2022-09-08T19:34:13.528508+0000 2022-09-07T19:44:02.509 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/3017372829 expires 2022-09-08T19:34:13.528508+0000 2022-09-07T19:44:02.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb98099090 msgr2=0x7fdb9809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:02.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb98099090 0x7fdb9809b540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba0005fd0 tx=0x7fdba0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 msgr2=0x7fdbb019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 0x7fdbb019a360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba400e740 tx=0x7fdba400ea50 comp rx=0 tx=0).stop 2022-09-07T19:44:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 shutdown_connections 2022-09-07T19:44:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb98099090 0x7fdb9809b540 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbb0101860 0x7fdbb01a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb00fc540 0x7fdbb0199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 --2- 172.21.15.80:0/3156711692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbb00feea0 0x7fdbb019a360 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 >> 172.21.15.80:0/3156711692 conn(0x7fdbb00f81f0 msgr2=0x7fdbb00fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 shutdown_connections 2022-09-07T19:44:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:02.498+0000 7fdbaf59e700 1 -- 172.21.15.80:0/3156711692 wait complete. 2022-09-07T19:44:02.984 INFO:teuthology.run_tasks:Running task fs.ready... 2022-09-07T19:44:02.998 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:44:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 -- 172.21.15.80:0/1332974084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40072c30 msgr2=0x7fdb40071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 --2- 172.21.15.80:0/1332974084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40072c30 0x7fdb40071110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009810 tx=0x7fdb30009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 -- 172.21.15.80:0/1332974084 shutdown_connections 2022-09-07T19:44:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 --2- 172.21.15.80:0/1332974084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40072c30 0x7fdb40071110 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 --2- 172.21.15.80:0/1332974084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40105c10 0x7fdb40108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.235 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 --2- 172.21.15.80:0/1332974084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40071650 0x7fdb40071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 -- 172.21.15.80:0/1332974084 >> 172.21.15.80:0/1332974084 conn(0x7fdb400f9430 msgr2=0x7fdb400fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:03.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 -- 172.21.15.80:0/1332974084 shutdown_connections 2022-09-07T19:44:03.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.231+0000 7fdb449ff700 1 -- 172.21.15.80:0/1332974084 wait complete. 2022-09-07T19:44:03.236 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.232+0000 7fdb449ff700 1 Processor -- start 2022-09-07T19:44:03.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 -- start start 2022-09-07T19:44:03.237 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40071650 0x7fdb40195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40072c30 0x7fdb40196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.238 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40105c10 0x7fdb4019d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4019d670 con 0x7fdb40105c10 2022-09-07T19:44:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4019d7e0 con 0x7fdb40071650 2022-09-07T19:44:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb449ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4019d9a0 con 0x7fdb40072c30 2022-09-07T19:44:03.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb3ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40105c10 0x7fdb4019d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40071650 0x7fdb40195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40072c30 0x7fdb40196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.241 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40071650 0x7fdb40195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45758/0 (socket says 172.21.15.80:45758) 2022-09-07T19:44:03.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.233+0000 7fdb3e59c700 1 -- 172.21.15.80:0/849501795 learned_addr learned my addr 172.21.15.80:0/849501795 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:03.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb3dd9b700 1 -- 172.21.15.80:0/849501795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40071650 msgr2=0x7fdb40195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb3dd9b700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40071650 0x7fdb40195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.242 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb3dd9b700 1 -- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40105c10 msgr2=0x7fdb4019d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb3dd9b700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40105c10 0x7fdb4019d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb3dd9b700 1 -- 172.21.15.80:0/849501795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb30009470 con 0x7fdb40072c30 2022-09-07T19:44:03.243 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb3dd9b700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40072c30 0x7fdb40196030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400e6c0 tx=0x7fdb3400e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:03.245 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34010900 con 0x7fdb40072c30 2022-09-07T19:44:03.245 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4019dc80 con 0x7fdb40072c30 2022-09-07T19:44:03.245 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fdb34018420 con 0x7fdb40072c30 2022-09-07T19:44:03.246 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.234+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34017610 con 0x7fdb40072c30 2022-09-07T19:44:03.246 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.235+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4019e190 con 0x7fdb40072c30 2022-09-07T19:44:03.246 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.235+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4010b710 con 0x7fdb40072c30 2022-09-07T19:44:03.247 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.238+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fdb3400c040 con 0x7fdb40072c30 2022-09-07T19:44:03.247 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.239+0000 7fdb2f7fe700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb28099010 0x7fdb2809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.247 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.239+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fdb34014070 con 0x7fdb40072c30 2022-09-07T19:44:03.247 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.239+0000 7fdb3e59c700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb28099010 0x7fdb2809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.248 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.240+0000 7fdb3e59c700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb28099010 0x7fdb2809b4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000b4f0 tx=0x7fdb30005910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:03.248 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.241+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fdb3408ed00 con 0x7fdb40072c30 2022-09-07T19:44:03.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.440+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb40104220 con 0x7fdb40072c30 2022-09-07T19:44:03.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.441+0000 7fdb2f7fe700 1 -- 172.21.15.80:0/849501795 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+23865 (secure 0 0 0) 0x7fdb34092320 con 0x7fdb40072c30 2022-09-07T19:44:03.441 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:44:03.442 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:43:44.244098+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:44:03.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb28099010 msgr2=0x7fdb2809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb28099010 0x7fdb2809b4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000b4f0 tx=0x7fdb30005910 comp rx=0 tx=0).stop 2022-09-07T19:44:03.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40072c30 msgr2=0x7fdb40196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40072c30 0x7fdb40196030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400e6c0 tx=0x7fdb3400e9d0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 shutdown_connections 2022-09-07T19:44:03.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb40105c10 0x7fdb4019d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fdb28099010 0x7fdb2809b4c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb40071650 0x7fdb40195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 --2- 172.21.15.80:0/849501795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb40072c30 0x7fdb40196030 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.448 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.444+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 >> 172.21.15.80:0/849501795 conn(0x7fdb400f9430 msgr2=0x7fdb400fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:03.448 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.445+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 shutdown_connections 2022-09-07T19:44:03.449 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.445+0000 7fdb449ff700 1 -- 172.21.15.80:0/849501795 wait complete. 2022-09-07T19:44:03.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-07T19:42:05.026979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-09-07T19:42:06.340517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-07T19:42:10.116527+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-07T19:44:03.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:44:03.550 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:03 smithi080 ceph-mon[90124]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:03.550 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:03 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3156711692' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2022-09-07T19:44:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:03 smithi154 ceph-mon[96967]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:03 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3156711692' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2022-09-07T19:44:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:03 smithi155 ceph-mon[97606]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:03.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:03 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3156711692' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2022-09-07T19:44:03.704 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.704+0000 7fcabffff700 1 -- 172.21.15.80:0/3421407833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac0100f60 msgr2=0x7fcac0103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.704+0000 7fcabffff700 1 --2- 172.21.15.80:0/3421407833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac0100f60 0x7fcac0103340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009750 tx=0x7fcab4009a60 comp rx=0 tx=0).stop 2022-09-07T19:44:03.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 -- 172.21.15.80:0/3421407833 shutdown_connections 2022-09-07T19:44:03.705 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 --2- 172.21.15.80:0/3421407833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0103880 0x7fcac0105c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 --2- 172.21.15.80:0/3421407833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcac00fe640 0x7fcac0100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 --2- 172.21.15.80:0/3421407833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac0100f60 0x7fcac0103340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 -- 172.21.15.80:0/3421407833 >> 172.21.15.80:0/3421407833 conn(0x7fcac00f8160 msgr2=0x7fcac00fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:03.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 -- 172.21.15.80:0/3421407833 shutdown_connections 2022-09-07T19:44:03.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.705+0000 7fcabffff700 1 -- 172.21.15.80:0/3421407833 wait complete. 2022-09-07T19:44:03.709 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 Processor -- start 2022-09-07T19:44:03.709 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 -- start start 2022-09-07T19:44:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00fe640 0x7fcac01912e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 0x7fcac0191820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcac0103880 0x7fcac01a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0192170 con 0x7fcac00fe640 2022-09-07T19:44:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac01a1a40 con 0x7fcac0100f60 2022-09-07T19:44:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.706+0000 7fcabffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac01a1c00 con 0x7fcac0103880 2022-09-07T19:44:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabeffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00fe640 0x7fcac01912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabe7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 0x7fcac0191820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabe7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 0x7fcac0191820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45776/0 (socket says 172.21.15.80:45776) 2022-09-07T19:44:03.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabe7fc700 1 -- 172.21.15.80:0/187710111 learned_addr learned my addr 172.21.15.80:0/187710111 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:03.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabf7fe700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcac0103880 0x7fcac01a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabeffd700 1 -- 172.21.15.80:0/187710111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcac0103880 msgr2=0x7fcac01a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabeffd700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcac0103880 0x7fcac01a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabeffd700 1 -- 172.21.15.80:0/187710111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 msgr2=0x7fcac0191820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabeffd700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 0x7fcac0191820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabeffd700 1 -- 172.21.15.80:0/187710111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0009470 con 0x7fcac00fe640 2022-09-07T19:44:03.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.707+0000 7fcabe7fc700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 0x7fcac0191820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:03.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.708+0000 7fcabeffd700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00fe640 0x7fcac01912e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005fd0 tx=0x7fcab000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:03.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.708+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0004220 con 0x7fcac00fe640 2022-09-07T19:44:03.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.708+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fcab0004380 con 0x7fcac00fe640 2022-09-07T19:44:03.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.708+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab40093b0 con 0x7fcac00fe640 2022-09-07T19:44:03.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.708+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0003c70 con 0x7fcac00fe640 2022-09-07T19:44:03.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.708+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac01a21f0 con 0x7fcac00fe640 2022-09-07T19:44:03.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.709+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac01092c0 con 0x7fcac00fe640 2022-09-07T19:44:03.716 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.711+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fcab001e020 con 0x7fcac00fe640 2022-09-07T19:44:03.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.712+0000 7fcaa7fff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcaa8099090 0x7fcaa809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:03.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.712+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fcab0014070 con 0x7fcac00fe640 2022-09-07T19:44:03.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.712+0000 7fcabe7fc700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcaa8099090 0x7fcaa809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:03.717 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.713+0000 7fcabe7fc700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcaa8099090 0x7fcaa809b540 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcac0192a10 tx=0x7fcab4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:03.718 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.716+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fcab008ec10 con 0x7fcac00fe640 2022-09-07T19:44:03.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.905+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcac01a2bd0 con 0x7fcac00fe640 2022-09-07T19:44:03.905 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.906+0000 7fcaa7fff700 1 -- 172.21.15.80:0/187710111 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcab0003dd0 con 0x7fcac00fe640 2022-09-07T19:44:03.906 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:44:03.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcaa8099090 msgr2=0x7fcaa809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcaa8099090 0x7fcaa809b540 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcac0192a10 tx=0x7fcab4005fd0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00fe640 msgr2=0x7fcac01912e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:03.908 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00fe640 0x7fcac01912e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005fd0 tx=0x7fcab000eca0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 shutdown_connections 2022-09-07T19:44:03.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00fe640 0x7fcac01912e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.909 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fcaa8099090 0x7fcaa809b540 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcac0103880 0x7fcac01a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 --2- 172.21.15.80:0/187710111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac0100f60 0x7fcac0191820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:03.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 >> 172.21.15.80:0/187710111 conn(0x7fcac00f8160 msgr2=0x7fcac00ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:03.910 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 shutdown_connections 2022-09-07T19:44:03.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:03.908+0000 7fcabffff700 1 -- 172.21.15.80:0/187710111 wait complete. 2022-09-07T19:44:03.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-07T19:44:04.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 -- 172.21.15.80:0/967616876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3410a360 msgr2=0x7f0f3410c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/967616876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3410a360 0x7f0f3410c740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009b00 tx=0x7f0f2c009e10 comp rx=0 tx=0).stop 2022-09-07T19:44:04.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 -- 172.21.15.80:0/967616876 shutdown_connections 2022-09-07T19:44:04.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/967616876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3410a360 0x7f0f3410c740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/967616876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f34072c90 0x7f0f34071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/967616876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.168 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 -- 172.21.15.80:0/967616876 >> 172.21.15.80:0/967616876 conn(0x7f0f340f93f0 msgr2=0x7f0f340fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:04.168 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 -- 172.21.15.80:0/967616876 shutdown_connections 2022-09-07T19:44:04.168 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.166+0000 7f0f3bbff700 1 -- 172.21.15.80:0/967616876 wait complete. 2022-09-07T19:44:04.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 Processor -- start 2022-09-07T19:44:04.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 -- start start 2022-09-07T19:44:04.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f34072c90 0x7f0f3419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3410a360 0x7f0f341a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a1b00 con 0x7f0f34071740 2022-09-07T19:44:04.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a1c70 con 0x7f0f34072c90 2022-09-07T19:44:04.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3bbff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a1e30 con 0x7f0f3410a360 2022-09-07T19:44:04.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3999b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3999b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57740/0 (socket says 172.21.15.80:57740) 2022-09-07T19:44:04.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.168+0000 7f0f3999b700 1 -- 172.21.15.80:0/2232680711 learned_addr learned my addr 172.21.15.80:0/2232680711 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:04.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3919a700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f34072c90 0x7f0f3419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3a19c700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3410a360 0x7f0f341a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3999b700 1 -- 172.21.15.80:0/2232680711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3410a360 msgr2=0x7f0f341a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3999b700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3410a360 0x7f0f341a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3999b700 1 -- 172.21.15.80:0/2232680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f34072c90 msgr2=0x7f0f3419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3999b700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f34072c90 0x7f0f3419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3999b700 1 -- 172.21.15.80:0/2232680711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300093b0 con 0x7f0f34071740 2022-09-07T19:44:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f3999b700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34199f80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000e9c0 tx=0x7f0f3000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.169+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300097b0 con 0x7f0f34071740 2022-09-07T19:44:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.170+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2c009730 con 0x7f0f34071740 2022-09-07T19:44:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.170+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f0f3000ce70 con 0x7f0f34071740 2022-09-07T19:44:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.170+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30003d20 con 0x7f0f34071740 2022-09-07T19:44:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.170+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f341a2490 con 0x7f0f34071740 2022-09-07T19:44:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.171+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3410fad0 con 0x7f0f34071740 2022-09-07T19:44:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.172+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f0f3001e020 con 0x7f0f34071740 2022-09-07T19:44:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.174+0000 7f0f2affd700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0f20099010 0x7f0f2009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.174+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f0f30014070 con 0x7f0f34071740 2022-09-07T19:44:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.174+0000 7f0f3919a700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0f20099010 0x7f0f2009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.175+0000 7f0f3919a700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0f20099010 0x7f0f2009b4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0f24005fd0 tx=0x7f0f24005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.178+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f0f3008ee30 con 0x7f0f34071740 2022-09-07T19:44:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.370+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f3405fa30 con 0x7f0f34071740 2022-09-07T19:44:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.370+0000 7f0f2affd700 1 -- 172.21.15.80:0/2232680711 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f30003e80 con 0x7f0f34071740 2022-09-07T19:44:04.371 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:44:04.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0f20099010 msgr2=0x7f0f2009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.373 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0f20099010 0x7f0f2009b4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0f24005fd0 tx=0x7f0f24005f60 comp rx=0 tx=0).stop 2022-09-07T19:44:04.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 msgr2=0x7f0f34199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.374 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34199f80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000e9c0 tx=0x7f0f3000ecd0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 shutdown_connections 2022-09-07T19:44:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f34071740 0x7f0f34199f80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0f20099010 0x7f0f2009b4c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3410a360 0x7f0f341a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 --2- 172.21.15.80:0/2232680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f34072c90 0x7f0f3419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.377 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 >> 172.21.15.80:0/2232680711 conn(0x7f0f340f93f0 msgr2=0x7f0f340fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:04.378 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 shutdown_connections 2022-09-07T19:44:04.378 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.373+0000 7f0f3bbff700 1 -- 172.21.15.80:0/2232680711 wait complete. 2022-09-07T19:44:04.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-07T19:44:04.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:04 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/849501795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:04.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:04 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/187710111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:44:04.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:04 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/849501795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:04.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:04 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/187710111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:44:04.633 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.633+0000 7f94f5dff700 1 -- 172.21.15.80:0/1910188251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0100df0 msgr2=0x7f94f0103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.633+0000 7f94f5dff700 1 --2- 172.21.15.80:0/1910188251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0100df0 0x7f94f0103250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009810 tx=0x7f94e4009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:04.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 -- 172.21.15.80:0/1910188251 shutdown_connections 2022-09-07T19:44:04.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 --2- 172.21.15.80:0/1910188251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f01038e0 0x7f94f0105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.634 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 --2- 172.21.15.80:0/1910188251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f0066bf0 0x7f94f01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 --2- 172.21.15.80:0/1910188251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0100df0 0x7f94f0103250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 -- 172.21.15.80:0/1910188251 >> 172.21.15.80:0/1910188251 conn(0x7f94f00f82e0 msgr2=0x7f94f00fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:04.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 -- 172.21.15.80:0/1910188251 shutdown_connections 2022-09-07T19:44:04.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.634+0000 7f94f5dff700 1 -- 172.21.15.80:0/1910188251 wait complete. 2022-09-07T19:44:04.637 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 Processor -- start 2022-09-07T19:44:04.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 -- start start 2022-09-07T19:44:04.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0066bf0 0x7f94f0195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 0x7f94f0196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.638 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f01038e0 0x7f94f019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f019d6c0 con 0x7f94f0100df0 2022-09-07T19:44:04.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f019d830 con 0x7f94f0066bf0 2022-09-07T19:44:04.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.635+0000 7f94f5dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f019d9f0 con 0x7f94f01038e0 2022-09-07T19:44:04.639 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 0x7f94f0196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94ef7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0066bf0 0x7f94f0195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94ef7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0066bf0 0x7f94f0195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45796/0 (socket says 172.21.15.80:45796) 2022-09-07T19:44:04.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 0x7f94f0196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57752/0 (socket says 172.21.15.80:57752) 2022-09-07T19:44:04.640 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94effff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f01038e0 0x7f94f019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 -- 172.21.15.80:0/2826926146 learned_addr learned my addr 172.21.15.80:0/2826926146 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:04.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 -- 172.21.15.80:0/2826926146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f01038e0 msgr2=0x7f94f019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.641 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f01038e0 0x7f94f019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.642 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 -- 172.21.15.80:0/2826926146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0066bf0 msgr2=0x7f94f0195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.642 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0066bf0 0x7f94f0195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.642 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 -- 172.21.15.80:0/2826926146 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8009730 con 0x7f94f0100df0 2022-09-07T19:44:04.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94effff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f01038e0 0x7f94f019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:04.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.636+0000 7f94eeffd700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 0x7f94f0196080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94e400f690 tx=0x7f94e400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:04.643 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.637+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e401d070 con 0x7f94f0100df0 2022-09-07T19:44:04.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.637+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4009470 con 0x7f94f0100df0 2022-09-07T19:44:04.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.637+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f94e40054f0 con 0x7f94f0100df0 2022-09-07T19:44:04.644 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.637+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e40047f0 con 0x7f94f0100df0 2022-09-07T19:44:04.645 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.637+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f019dfe0 con 0x7f94f0100df0 2022-09-07T19:44:04.645 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.638+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f01094f0 con 0x7f94f0100df0 2022-09-07T19:44:04.646 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.640+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f94e4028030 con 0x7f94f0100df0 2022-09-07T19:44:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.641+0000 7f94ecff9700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f94d8099090 0x7f94d809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.641+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f94e40c33b0 con 0x7f94f0100df0 2022-09-07T19:44:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.641+0000 7f94ef7fe700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f94d8099090 0x7f94d809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.642+0000 7f94ef7fe700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f94d8099090 0x7f94d809b540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94f0066fc0 tx=0x7f94e0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.645+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f94e408f6b0 con 0x7f94f0100df0 2022-09-07T19:44:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:04 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/849501795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:04 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/187710111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:44:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.834+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94f005fa30 con 0x7f94f0100df0 2022-09-07T19:44:04.834 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.834+0000 7f94ecff9700 1 -- 172.21.15.80:0/2826926146 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94e4092cd0 con 0x7f94f0100df0 2022-09-07T19:44:04.835 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2022-09-07T19:44:04.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f94d8099090 msgr2=0x7f94d809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f94d8099090 0x7f94d809b540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94f0066fc0 tx=0x7f94e0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 msgr2=0x7f94f0196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 0x7f94f0196080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94e400f690 tx=0x7f94e400f6c0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 shutdown_connections 2022-09-07T19:44:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f94d8099090 0x7f94d809b540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f01038e0 0x7f94f019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f0066bf0 0x7f94f0195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 --2- 172.21.15.80:0/2826926146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94f0100df0 0x7f94f0196080 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 >> 172.21.15.80:0/2826926146 conn(0x7f94f00f82e0 msgr2=0x7f94f00ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 shutdown_connections 2022-09-07T19:44:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:04.837+0000 7f94f5dff700 1 -- 172.21.15.80:0/2826926146 wait complete. 2022-09-07T19:44:04.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-07T19:44:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/1723541896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80fdd00 msgr2=0x7f3fb80fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/1723541896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80fdd00 0x7f3fb80fe110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009810 tx=0x7f3fa8009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:05.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/1723541896 shutdown_connections 2022-09-07T19:44:05.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/1723541896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80fdd00 0x7f3fb80fe110 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/1723541896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb80ff910 0x7f3fb81061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/1723541896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb80fef80 0x7f3fb80ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/1723541896 >> 172.21.15.80:0/1723541896 conn(0x7f3fb80f93f0 msgr2=0x7f3fb80fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/1723541896 shutdown_connections 2022-09-07T19:44:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.097+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/1723541896 wait complete. 2022-09-07T19:44:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.098+0000 7f3fbd1ff700 1 Processor -- start 2022-09-07T19:44:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.098+0000 7f3fbd1ff700 1 -- start start 2022-09-07T19:44:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.098+0000 7f3fbd1ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb80fdd00 0x7f3fb8193940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.098+0000 7f3fbd1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb80fef80 0x7f3fb8193e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.098+0000 7f3fbd1ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 0x7f3fb819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fbd1ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb819b4c0 con 0x7f3fb80ff910 2022-09-07T19:44:05.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fbd1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb819b630 con 0x7f3fb80fef80 2022-09-07T19:44:05.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fbd1ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb819b7f0 con 0x7f3fb80fdd00 2022-09-07T19:44:05.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 0x7f3fb819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 0x7f3fb819aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57774/0 (socket says 172.21.15.80:57774) 2022-09-07T19:44:05.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 -- 172.21.15.80:0/664943877 learned_addr learned my addr 172.21.15.80:0/664943877 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:05.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb659c700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb80fef80 0x7f3fb8193e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb6d9d700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb80fdd00 0x7f3fb8193940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 -- 172.21.15.80:0/664943877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb80fdd00 msgr2=0x7f3fb8193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb80fdd00 0x7f3fb8193940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 -- 172.21.15.80:0/664943877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb80fef80 msgr2=0x7f3fb8193e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb80fef80 0x7f3fb8193e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.099+0000 7f3fb759e700 1 -- 172.21.15.80:0/664943877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009470 con 0x7f3fb80ff910 2022-09-07T19:44:05.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.100+0000 7f3fb759e700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 0x7f3fb819aef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000eaf0 tx=0x7f3fb000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:05.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.100+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0009960 con 0x7f3fb80ff910 2022-09-07T19:44:05.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.100+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb819bad0 con 0x7f3fb80ff910 2022-09-07T19:44:05.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.100+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3fb000ce70 con 0x7f3fb80ff910 2022-09-07T19:44:05.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.100+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00058b0 con 0x7f3fb80ff910 2022-09-07T19:44:05.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.100+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb819bfe0 con 0x7f3fb80ff910 2022-09-07T19:44:05.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.101+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb81094b0 con 0x7f3fb80ff910 2022-09-07T19:44:05.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.103+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f3fb001e020 con 0x7f3fb80ff910 2022-09-07T19:44:05.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.105+0000 7f3f9ffff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3fa0099090 0x7f3fa009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.105+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f3fb0014070 con 0x7f3fb80ff910 2022-09-07T19:44:05.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.105+0000 7f3fb6d9d700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3fa0099090 0x7f3fa009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.106+0000 7f3fb6d9d700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3fa0099090 0x7f3fa009b540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b4f0 tx=0x7f3fa8009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:05.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.109+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f3fb008ef40 con 0x7f3fb80ff910 2022-09-07T19:44:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.305+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fb819c650 con 0x7f3fb80ff910 2022-09-07T19:44:05.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.305+0000 7f3f9ffff700 1 -- 172.21.15.80:0/664943877 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3fb0092560 con 0x7f3fb80ff910 2022-09-07T19:44:05.305 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:44:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3fa0099090 msgr2=0x7f3fa009b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3fa0099090 0x7f3fa009b540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b4f0 tx=0x7f3fa8009eb0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 msgr2=0x7f3fb819aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 0x7f3fb819aef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000eaf0 tx=0x7f3fb000ee00 comp rx=0 tx=0).stop 2022-09-07T19:44:05.309 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 shutdown_connections 2022-09-07T19:44:05.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb80ff910 0x7f3fb819aef0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3fa0099090 0x7f3fa009b540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb80fdd00 0x7f3fb8193940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 --2- 172.21.15.80:0/664943877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb80fef80 0x7f3fb8193e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 >> 172.21.15.80:0/664943877 conn(0x7f3fb80f93f0 msgr2=0x7f3fb80fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 shutdown_connections 2022-09-07T19:44:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.308+0000 7f3fbd1ff700 1 -- 172.21.15.80:0/664943877 wait complete. 2022-09-07T19:44:05.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:44:05.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 -- 172.21.15.80:0/3836760770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 msgr2=0x7f07dc0ff3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 --2- 172.21.15.80:0/3836760770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc0ff3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009810 tx=0x7f07d0009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:05.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 -- 172.21.15.80:0/3836760770 shutdown_connections 2022-09-07T19:44:05.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 --2- 172.21.15.80:0/3836760770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0ff900 0x7f07dc1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 --2- 172.21.15.80:0/3836760770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc0fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 --2- 172.21.15.80:0/3836760770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc0ff3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 -- 172.21.15.80:0/3836760770 >> 172.21.15.80:0/3836760770 conn(0x7f07dc0f93c0 msgr2=0x7f07dc0fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:05.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 -- 172.21.15.80:0/3836760770 shutdown_connections 2022-09-07T19:44:05.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.562+0000 7f07e0bff700 1 -- 172.21.15.80:0/3836760770 wait complete. 2022-09-07T19:44:05.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 Processor -- start 2022-09-07T19:44:05.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 -- start start 2022-09-07T19:44:05.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc0ff900 0x7f07dc19d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19d690 con 0x7f07dc0fdcf0 2022-09-07T19:44:05.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19d800 con 0x7f07dc0fef70 2022-09-07T19:44:05.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07e0bff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19d9c0 con 0x7f07dc0ff900 2022-09-07T19:44:05.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07da59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.564+0000 7f07d9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07da59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57788/0 (socket says 172.21.15.80:57788) 2022-09-07T19:44:05.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07da59c700 1 -- 172.21.15.80:0/2260824896 learned_addr learned my addr 172.21.15.80:0/2260824896 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:05.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07dad9d700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc0ff900 0x7f07dc19d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07d9d9b700 1 -- 172.21.15.80:0/2260824896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc0ff900 msgr2=0x7f07dc19d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07d9d9b700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc0ff900 0x7f07dc19d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07d9d9b700 1 -- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 msgr2=0x7f07dc195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07d9d9b700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07d9d9b700 1 -- 172.21.15.80:0/2260824896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009470 con 0x7f07dc0fef70 2022-09-07T19:44:05.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07da59c700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:05.578 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.565+0000 7f07d9d9b700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc196050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07d0000c00 tx=0x7f07d000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:05.579 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.566+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d001d070 con 0x7f07dc0fef70 2022-09-07T19:44:05.579 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.566+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f07d000f880 con 0x7f07dc0fef70 2022-09-07T19:44:05.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.566+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc19dc40 con 0x7f07dc0fef70 2022-09-07T19:44:05.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.566+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0004760 con 0x7f07dc0fef70 2022-09-07T19:44:05.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.566+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc19e140 con 0x7f07dc0fef70 2022-09-07T19:44:05.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.567+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc1094a0 con 0x7f07dc0fef70 2022-09-07T19:44:05.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.569+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f07d0028030 con 0x7f07dc0fef70 2022-09-07T19:44:05.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.570+0000 7f07cb7fe700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07c4099090 0x7f07c409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:05.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.570+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f07d00c32f0 con 0x7f07dc0fef70 2022-09-07T19:44:05.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.570+0000 7f07da59c700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07c4099090 0x7f07c409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:05.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.571+0000 7f07da59c700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07c4099090 0x7f07c409b540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009f60 tx=0x7f07cc005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:05.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.572+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f07d008f5f0 con 0x7f07dc0fef70 2022-09-07T19:44:05.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:05 smithi080 ceph-mon[90124]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:05.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:05 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2232680711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:44:05.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:05 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2826926146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:44:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:05 smithi154 ceph-mon[96967]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:05 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2232680711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:44:05.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:05 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2826926146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:44:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:05 smithi155 ceph-mon[97606]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:05 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2232680711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:44:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:05 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2826926146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:44:05.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.811+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07dc19e770 con 0x7f07dc0fef70 2022-09-07T19:44:05.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.813+0000 7f07cb7fe700 1 -- 172.21.15.80:0/2260824896 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10733 (secure 0 0 0) 0x7f07d0092c10 con 0x7f07dc0fef70 2022-09-07T19:44:05.812 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:44:05.813 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-07T19:42:06.917499+0000","modified":"2022-09-07T19:42:38.506873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24575,"mds_1":24569,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24500":{"gid":24500,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24569":{"gid":24569,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-07T19:44:05.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07c4099090 msgr2=0x7f07c409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07c4099090 0x7f07c409b540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009f60 tx=0x7f07cc005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 msgr2=0x7f07dc196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc196050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07d0000c00 tx=0x7f07d000f690 comp rx=0 tx=0).stop 2022-09-07T19:44:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 shutdown_connections 2022-09-07T19:44:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07dc0fdcf0 0x7f07dc195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f07c4099090 0x7f07c409b540 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc0ff900 0x7f07dc19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 --2- 172.21.15.80:0/2260824896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc0fef70 0x7f07dc196050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:05.836 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 >> 172.21.15.80:0/2260824896 conn(0x7f07dc0f93c0 msgr2=0x7f07dc0fb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:05.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 shutdown_connections 2022-09-07T19:44:05.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:05.815+0000 7f07e0bff700 1 -- 172.21.15.80:0/2260824896 wait complete. 2022-09-07T19:44:05.837 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2022-09-07T19:44:05.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:44:06.076 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 -- 172.21.15.80:0/77504197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 msgr2=0x7faee80ff3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 --2- 172.21.15.80:0/77504197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80ff3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faed8009810 tx=0x7faed8009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 -- 172.21.15.80:0/77504197 shutdown_connections 2022-09-07T19:44:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 --2- 172.21.15.80:0/77504197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faee80ff900 0x7faee81061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 --2- 172.21.15.80:0/77504197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80fdcf0 0x7faee80fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 --2- 172.21.15.80:0/77504197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80ff3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 -- 172.21.15.80:0/77504197 >> 172.21.15.80:0/77504197 conn(0x7faee80f93c0 msgr2=0x7faee80fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:06.078 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.076+0000 7faeeffff700 1 -- 172.21.15.80:0/77504197 shutdown_connections 2022-09-07T19:44:06.079 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.077+0000 7faeeffff700 1 -- 172.21.15.80:0/77504197 wait complete. 2022-09-07T19:44:06.081 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.078+0000 7faeeffff700 1 Processor -- start 2022-09-07T19:44:06.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.078+0000 7faeeffff700 1 -- start start 2022-09-07T19:44:06.082 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeeffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faee80fdcf0 0x7faee8072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeeffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeeffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80ff900 0x7faee8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.083 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeeffff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8071e10 con 0x7faee80fdcf0 2022-09-07T19:44:06.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeeffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8071f80 con 0x7faee80ff900 2022-09-07T19:44:06.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeeffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee819d990 con 0x7faee80fef70 2022-09-07T19:44:06.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeed59a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeedd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faee80fdcf0 0x7faee8072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.084 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeed59a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:56284/0 (socket says 172.21.15.80:56284) 2022-09-07T19:44:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeee59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80ff900 0x7faee8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.079+0000 7faeed59a700 1 -- 172.21.15.80:0/4177294711 learned_addr learned my addr 172.21.15.80:0/4177294711 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeed59a700 1 -- 172.21.15.80:0/4177294711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80ff900 msgr2=0x7faee8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeed59a700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80ff900 0x7faee8071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeed59a700 1 -- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faee80fdcf0 msgr2=0x7faee8072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeed59a700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faee80fdcf0 0x7faee8072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeed59a700 1 -- 172.21.15.80:0/4177294711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8009470 con 0x7faee80fef70 2022-09-07T19:44:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeee59c700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80ff900 0x7faee8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeed59a700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80710d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faed800f690 tx=0x7faed800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed801d070 con 0x7faee80fef70 2022-09-07T19:44:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee819dc10 con 0x7faee80fef70 2022-09-07T19:44:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7faed800f8e0 con 0x7faee80fef70 2022-09-07T19:44:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.080+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8004880 con 0x7faee80fef70 2022-09-07T19:44:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.081+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee819e0c0 con 0x7faee80fef70 2022-09-07T19:44:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.081+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee8109450 con 0x7faee80fef70 2022-09-07T19:44:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.083+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7faed8028030 con 0x7faee80fef70 2022-09-07T19:44:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.085+0000 7faedeffd700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faed4099010 0x7faed409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.085+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7faed80c33f0 con 0x7faee80fef70 2022-09-07T19:44:06.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.085+0000 7faeedd9b700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faed4099010 0x7faed409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.092 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.086+0000 7faeedd9b700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faed4099010 0x7faed409b4c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faee80fedd0 tx=0x7faee4005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:06.093 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.087+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7faed808f6f0 con 0x7faee80fef70 2022-09-07T19:44:06.279 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.280+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee8104bb0 con 0x7faee80fef70 2022-09-07T19:44:06.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.282+0000 7faedeffd700 1 -- 172.21.15.80:0/4177294711 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+23865 (secure 0 0 0) 0x7faed8092d10 con 0x7faee80fef70 2022-09-07T19:44:06.282 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:44:06.283 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:43:44.244098+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:44:06.286 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faed4099010 msgr2=0x7faed409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faed4099010 0x7faed409b4c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faee80fedd0 tx=0x7faee4005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.287 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 msgr2=0x7faee80710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80710d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faed800f690 tx=0x7faed800f6c0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 shutdown_connections 2022-09-07T19:44:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faee80fdcf0 0x7faee8072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7faed4099010 0x7faed409b4c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80ff900 0x7faee8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 --2- 172.21.15.80:0/4177294711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee80fef70 0x7faee80710d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 >> 172.21.15.80:0/4177294711 conn(0x7faee80f93c0 msgr2=0x7faee80fb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 shutdown_connections 2022-09-07T19:44:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.284+0000 7faeeffff700 1 -- 172.21.15.80:0/4177294711 wait complete. 2022-09-07T19:44:06.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-07T19:37:12.653905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-07T19:42:05.026979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-09-07T19:42:06.340517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-07T19:42:10.116527+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-07T19:44:06.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-07T19:44:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 -- 172.21.15.80:0/729582147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 msgr2=0x7f72f4105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/729582147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f4105d60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009bb0 tx=0x7f72ec009ec0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 -- 172.21.15.80:0/729582147 shutdown_connections 2022-09-07T19:44:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/729582147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f4105d60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/729582147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f4066bf0 0x7f72f41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/729582147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4100df0 0x7f72f4103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.548+0000 7f72fc7ff700 1 -- 172.21.15.80:0/729582147 >> 172.21.15.80:0/729582147 conn(0x7f72f40f82e0 msgr2=0x7f72f40fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.549+0000 7f72fc7ff700 1 -- 172.21.15.80:0/729582147 shutdown_connections 2022-09-07T19:44:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.549+0000 7f72fc7ff700 1 -- 172.21.15.80:0/729582147 wait complete. 2022-09-07T19:44:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 Processor -- start 2022-09-07T19:44:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 -- start start 2022-09-07T19:44:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 0x7f72f4195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f4100df0 0x7f72f4196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f419d6b0 con 0x7f72f41038e0 2022-09-07T19:44:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f419d820 con 0x7f72f4066bf0 2022-09-07T19:44:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.550+0000 7f72fc7ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f419d9e0 con 0x7f72f4100df0 2022-09-07T19:44:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fa59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 0x7f72f4195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72f9d9a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f4100df0 0x7f72f4196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fa59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 0x7f72f4195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45852/0 (socket says 172.21.15.80:45852) 2022-09-07T19:44:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fa59b700 1 -- 172.21.15.80:0/3143245661 learned_addr learned my addr 172.21.15.80:0/3143245661 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 -- 172.21.15.80:0/3143245661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f4100df0 msgr2=0x7f72f4196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f4100df0 0x7f72f4196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 -- 172.21.15.80:0/3143245661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 msgr2=0x7f72f4195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 0x7f72f4195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 -- 172.21.15.80:0/3143245661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40093b0 con 0x7f72f41038e0 2022-09-07T19:44:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fa59b700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 0x7f72f4195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.551+0000 7f72fad9c700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f419d0e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009fd0 tx=0x7f72ec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.552+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00f870 con 0x7f72f41038e0 2022-09-07T19:44:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.552+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f72ec00ba80 con 0x7f72f41038e0 2022-09-07T19:44:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.552+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec0097e0 con 0x7f72f41038e0 2022-09-07T19:44:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.552+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec017470 con 0x7f72f41038e0 2022-09-07T19:44:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.552+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f419df30 con 0x7f72f41038e0 2022-09-07T19:44:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.553+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f41094f0 con 0x7f72f41038e0 2022-09-07T19:44:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.554+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f72ec020070 con 0x7f72f41038e0 2022-09-07T19:44:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.556+0000 7f72eb7fe700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f72e0099010 0x7f72e009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.556+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f72ec0c3dd0 con 0x7f72f41038e0 2022-09-07T19:44:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.556+0000 7f72fa59b700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f72e0099010 0x7f72e009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.557+0000 7f72fa59b700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f72e0099010 0x7f72e009b4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72f0005ad0 tx=0x7f72f0005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.560+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f72ec0900d0 con 0x7f72f41038e0 2022-09-07T19:44:06.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:06 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/664943877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:44:06.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:06 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2260824896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:44:06.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:06 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/4177294711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:06 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/664943877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:44:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:06 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2260824896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:44:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:06 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/4177294711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:06 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/664943877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:44:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:06 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2260824896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:44:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:06 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/4177294711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.751+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72f405fb40 con 0x7f72f41038e0 2022-09-07T19:44:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.752+0000 7f72eb7fe700 1 -- 172.21.15.80:0/3143245661 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72ec0936f0 con 0x7f72f41038e0 2022-09-07T19:44:06.753 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2022-09-07T19:44:06.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f72e0099010 msgr2=0x7f72e009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f72e0099010 0x7f72e009b4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72f0005ad0 tx=0x7f72f0005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 msgr2=0x7f72f419d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f419d0e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009fd0 tx=0x7f72ec00b890 comp rx=0 tx=0).stop 2022-09-07T19:44:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 shutdown_connections 2022-09-07T19:44:06.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f41038e0 0x7f72f419d0e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.757 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f72e0099010 0x7f72e009b4c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f4066bf0 0x7f72f4195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 --2- 172.21.15.80:0/3143245661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f4100df0 0x7f72f4196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 >> 172.21.15.80:0/3143245661 conn(0x7f72f40f82e0 msgr2=0x7f72f41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 shutdown_connections 2022-09-07T19:44:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:06.755+0000 7f72fc7ff700 1 -- 172.21.15.80:0/3143245661 wait complete. 2022-09-07T19:44:06.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-07T19:44:07.018 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 -- 172.21.15.80:0/2787088638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00ff910 msgr2=0x7ff2e01061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/2787088638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00ff910 0x7ff2e01061d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009bb0 tx=0x7ff2d8009ec0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 -- 172.21.15.80:0/2787088638 shutdown_connections 2022-09-07T19:44:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/2787088638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00ff910 0x7ff2e01061d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/2787088638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2e00fdd00 0x7ff2e00fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/2787088638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e00fef80 0x7ff2e00ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.020 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 -- 172.21.15.80:0/2787088638 >> 172.21.15.80:0/2787088638 conn(0x7ff2e00f93f0 msgr2=0x7ff2e00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:07.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 -- 172.21.15.80:0/2787088638 shutdown_connections 2022-09-07T19:44:07.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.018+0000 7ff2e5bff700 1 -- 172.21.15.80:0/2787088638 wait complete. 2022-09-07T19:44:07.023 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.020+0000 7ff2e5bff700 1 Processor -- start 2022-09-07T19:44:07.023 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.020+0000 7ff2e5bff700 1 -- start start 2022-09-07T19:44:07.024 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2e5bff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 0x7ff2e0193950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.024 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2e5bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e00fef80 0x7ff2e0193e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.024 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2e5bff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2e00ff910 0x7ff2e019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2e5bff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e019b4d0 con 0x7ff2e00fdd00 2022-09-07T19:44:07.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2e5bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e019b640 con 0x7ff2e00fef80 2022-09-07T19:44:07.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2e5bff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e019b800 con 0x7ff2e00ff910 2022-09-07T19:44:07.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 0x7ff2e0193950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.026 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 0x7ff2e0193950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57844/0 (socket says 172.21.15.80:57844) 2022-09-07T19:44:07.026 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2df7fe700 1 -- 172.21.15.80:0/1698435557 learned_addr learned my addr 172.21.15.80:0/1698435557 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:07.026 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2deffd700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e00fef80 0x7ff2e0193e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.026 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.021+0000 7ff2dffff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2e00ff910 0x7ff2e019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.027 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2df7fe700 1 -- 172.21.15.80:0/1698435557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2e00ff910 msgr2=0x7ff2e019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.027 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2df7fe700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2e00ff910 0x7ff2e019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.027 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2df7fe700 1 -- 172.21.15.80:0/1698435557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e00fef80 msgr2=0x7ff2e0193e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.028 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2df7fe700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e00fef80 0x7ff2e0193e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.028 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2df7fe700 1 -- 172.21.15.80:0/1698435557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80097e0 con 0x7ff2e00fdd00 2022-09-07T19:44:07.028 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2df7fe700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 0x7ff2e0193950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e710 tx=0x7ff2d000ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:07.028 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0004220 con 0x7ff2e00fdd00 2022-09-07T19:44:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff2d0004380 con 0x7ff2e00fdd00 2022-09-07T19:44:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0003cf0 con 0x7ff2e00fdd00 2022-09-07T19:44:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e019bae0 con 0x7ff2e00fdd00 2022-09-07T19:44:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.022+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e019bff0 con 0x7ff2e00fdd00 2022-09-07T19:44:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.024+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e01094c0 con 0x7ff2e00fdd00 2022-09-07T19:44:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.025+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7ff2d001e020 con 0x7ff2e00fdd00 2022-09-07T19:44:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.026+0000 7ff2dcff9700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2c8099090 0x7ff2c809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.027+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7ff2d0014070 con 0x7ff2e00fdd00 2022-09-07T19:44:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.027+0000 7ff2deffd700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2c8099090 0x7ff2c809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.032 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.027+0000 7ff2deffd700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2c8099090 0x7ff2c809b540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4005fd0 tx=0x7ff2d4005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:07.032 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.030+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff2d008ec50 con 0x7ff2e00fdd00 2022-09-07T19:44:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.224+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2e005fb20 con 0x7ff2e00fdd00 2022-09-07T19:44:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.225+0000 7ff2dcff9700 1 -- 172.21.15.80:0/1698435557 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2d0092270 con 0x7ff2e00fdd00 2022-09-07T19:44:07.225 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:44:07.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2c8099090 msgr2=0x7ff2c809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.227 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2c8099090 0x7ff2c809b540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4005fd0 tx=0x7ff2d4005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 msgr2=0x7ff2e0193950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 0x7ff2e0193950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e710 tx=0x7ff2d000ea20 comp rx=0 tx=0).stop 2022-09-07T19:44:07.228 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 shutdown_connections 2022-09-07T19:44:07.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00fdd00 0x7ff2e0193950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7ff2c8099090 0x7ff2c809b540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2e00ff910 0x7ff2e019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 --2- 172.21.15.80:0/1698435557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e00fef80 0x7ff2e0193e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.229 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 >> 172.21.15.80:0/1698435557 conn(0x7ff2e00f93f0 msgr2=0x7ff2e0102560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:07.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 shutdown_connections 2022-09-07T19:44:07.230 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.228+0000 7ff2e5bff700 1 -- 172.21.15.80:0/1698435557 wait complete. 2022-09-07T19:44:07.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-07T19:44:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/2761803829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 msgr2=0x7f9dd40ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/2761803829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd40ff3d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009810 tx=0x7f9dc4009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:07.490 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/2761803829 shutdown_connections 2022-09-07T19:44:07.491 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/2761803829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40ff910 0x7f9dd41061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.491 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/2761803829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dd40fdd00 0x7f9dd40fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/2761803829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd40ff3d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.492 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/2761803829 >> 172.21.15.80:0/2761803829 conn(0x7f9dd40f93f0 msgr2=0x7f9dd40fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:07.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/2761803829 shutdown_connections 2022-09-07T19:44:07.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.486+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/2761803829 wait complete. 2022-09-07T19:44:07.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.487+0000 7f9ddc3ff700 1 Processor -- start 2022-09-07T19:44:07.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.487+0000 7f9ddc3ff700 1 -- start start 2022-09-07T19:44:07.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9ddc3ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dd40fdd00 0x7f9dd4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9ddc3ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd4196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9ddc3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40ff910 0x7f9dd419d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9ddc3ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419d690 con 0x7f9dd40fef80 2022-09-07T19:44:07.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9ddc3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419d800 con 0x7f9dd40ff910 2022-09-07T19:44:07.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9ddc3ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419d9c0 con 0x7f9dd40fdd00 2022-09-07T19:44:07.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd4196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dda99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40ff910 0x7f9dd419d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd4196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57860/0 (socket says 172.21.15.80:57860) 2022-09-07T19:44:07.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 -- 172.21.15.80:0/3210419837 learned_addr learned my addr 172.21.15.80:0/3210419837 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:07.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dda19b700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dd40fdd00 0x7f9dd4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 -- 172.21.15.80:0/3210419837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dd40fdd00 msgr2=0x7f9dd4195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dd40fdd00 0x7f9dd4195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 -- 172.21.15.80:0/3210419837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40ff910 msgr2=0x7f9dd419d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40ff910 0x7f9dd419d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.488+0000 7f9dd999a700 1 -- 172.21.15.80:0/3210419837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4009470 con 0x7f9dd40fef80 2022-09-07T19:44:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.489+0000 7f9dd999a700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd4196050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40059c0 tx=0x7f9dc400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.489+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc401d070 con 0x7f9dd40fef80 2022-09-07T19:44:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.489+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f9dc400f880 con 0x7f9dd40fef80 2022-09-07T19:44:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.489+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd419dc40 con 0x7f9dd40fef80 2022-09-07T19:44:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.489+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40048e0 con 0x7f9dd40fef80 2022-09-07T19:44:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.489+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd419e0f0 con 0x7f9dd40fef80 2022-09-07T19:44:07.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.490+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd41094b0 con 0x7f9dd40fef80 2022-09-07T19:44:07.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.492+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f9dc4028030 con 0x7f9dd40fef80 2022-09-07T19:44:07.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.493+0000 7f9dcb7fe700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9dc0099010 0x7f9dc009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.493+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f9dc40c34c0 con 0x7f9dd40fef80 2022-09-07T19:44:07.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.494+0000 7f9dda19b700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9dc0099010 0x7f9dc009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.494+0000 7f9dda19b700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9dc0099010 0x7f9dc009b4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40fede0 tx=0x7f9dd000b2e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.497+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f9dc408f7c0 con 0x7f9dd40fef80 2022-09-07T19:44:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:07 smithi080 ceph-mon[90124]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:44:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:07 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3143245661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:44:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:07 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/1698435557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:44:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:07 smithi154 ceph-mon[96967]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:44:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:07 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3143245661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:44:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:07 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/1698435557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:44:07.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.692+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9dd419ebf0 con 0x7f9dd40fef80 2022-09-07T19:44:07.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.693+0000 7f9dcb7fe700 1 -- 172.21.15.80:0/3210419837 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9dc4096e60 con 0x7f9dd40fef80 2022-09-07T19:44:07.693 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2022-09-07T19:44:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9dc0099010 msgr2=0x7f9dc009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9dc0099010 0x7f9dc009b4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40fede0 tx=0x7f9dd000b2e0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 msgr2=0x7f9dd4196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd4196050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40059c0 tx=0x7f9dc400f690 comp rx=0 tx=0).stop 2022-09-07T19:44:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 shutdown_connections 2022-09-07T19:44:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9dc0099010 0x7f9dc009b4c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40ff910 0x7f9dd419d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dd40fdd00 0x7f9dd4195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 --2- 172.21.15.80:0/3210419837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40fef80 0x7f9dd4196050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 >> 172.21.15.80:0/3210419837 conn(0x7f9dd40f93f0 msgr2=0x7f9dd40fb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.695+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 shutdown_connections 2022-09-07T19:44:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.696+0000 7f9ddc3ff700 1 -- 172.21.15.80:0/3210419837 wait complete. 2022-09-07T19:44:07.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:07 smithi155 ceph-mon[97606]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:44:07.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:07 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3143245661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2022-09-07T19:44:07.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:07 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/1698435557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2022-09-07T19:44:07.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-07T19:44:07.955 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.955+0000 7fbaeb39d700 1 -- 172.21.15.80:0/1390430088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fc430 msgr2=0x7fbae40fe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.955+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/1390430088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fc430 0x7fbae40fe850 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009810 tx=0x7fbae0009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 -- 172.21.15.80:0/1390430088 shutdown_connections 2022-09-07T19:44:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/1390430088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fc430 0x7fbae40fe850 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/1390430088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae4101750 0x7fbae4101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/1390430088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae40fed90 0x7fbae4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 -- 172.21.15.80:0/1390430088 >> 172.21.15.80:0/1390430088 conn(0x7fbae40f8160 msgr2=0x7fbae40fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 -- 172.21.15.80:0/1390430088 shutdown_connections 2022-09-07T19:44:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.956+0000 7fbaeb39d700 1 -- 172.21.15.80:0/1390430088 wait complete. 2022-09-07T19:44:07.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 Processor -- start 2022-09-07T19:44:07.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 -- start start 2022-09-07T19:44:07.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae40fc430 0x7fbae4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.960 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fed90 0x7fbae419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae4101750 0x7fbae41a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a18c0 con 0x7fbae40fed90 2022-09-07T19:44:07.961 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a1a30 con 0x7fbae40fc430 2022-09-07T19:44:07.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.957+0000 7fbaeb39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a1bf0 con 0x7fbae4101750 2022-09-07T19:44:07.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbaea39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae40fc430 0x7fbae4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.962 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fed90 0x7fbae419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbaea39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae40fc430 0x7fbae4199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45904/0 (socket says 172.21.15.80:45904) 2022-09-07T19:44:07.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbaea39b700 1 -- 172.21.15.80:0/641729478 learned_addr learned my addr 172.21.15.80:0/641729478 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:07.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbaeab9c700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae4101750 0x7fbae41a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.963 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 -- 172.21.15.80:0/641729478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae4101750 msgr2=0x7fbae41a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae4101750 0x7fbae41a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 -- 172.21.15.80:0/641729478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae40fc430 msgr2=0x7fbae4199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:07.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae40fc430 0x7fbae4199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:07.964 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 -- 172.21.15.80:0/641729478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009470 con 0x7fbae40fed90 2022-09-07T19:44:07.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.958+0000 7fbae9b9a700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fed90 0x7fbae419a280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbad400e6c0 tx=0x7fbad400e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:07.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.959+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4010900 con 0x7fbae40fed90 2022-09-07T19:44:07.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.959+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fbad4018420 con 0x7fbae40fed90 2022-09-07T19:44:07.965 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.959+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae41a1ed0 con 0x7fbae40fed90 2022-09-07T19:44:07.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.959+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4017610 con 0x7fbae40fed90 2022-09-07T19:44:07.966 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.959+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae41a2350 con 0x7fbae40fed90 2022-09-07T19:44:07.967 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.960+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae410f8d0 con 0x7fbae40fed90 2022-09-07T19:44:07.968 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.962+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fbad400c040 con 0x7fbae40fed90 2022-09-07T19:44:07.968 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.963+0000 7fbadb7fe700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbad0099010 0x7fbad009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:07.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.963+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fbad4014070 con 0x7fbae40fed90 2022-09-07T19:44:07.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.963+0000 7fbaea39b700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbad0099010 0x7fbad009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:07.969 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.964+0000 7fbaea39b700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbad0099010 0x7fbad009b4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b4f0 tx=0x7fbae0009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:07.970 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:07.967+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fbad404fc80 con 0x7fbae40fed90 2022-09-07T19:44:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.159+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbae405f120 con 0x7fbae40fed90 2022-09-07T19:44:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.160+0000 7fbadb7fe700 1 -- 172.21.15.80:0/641729478 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbad408eaf0 con 0x7fbae40fed90 2022-09-07T19:44:08.160 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2022-09-07T19:44:08.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbad0099010 msgr2=0x7fbad009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbad0099010 0x7fbad009b4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b4f0 tx=0x7fbae0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fed90 msgr2=0x7fbae419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fed90 0x7fbae419a280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbad400e6c0 tx=0x7fbad400e9d0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 shutdown_connections 2022-09-07T19:44:08.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fbad0099010 0x7fbad009b4c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae4101750 0x7fbae41a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbae40fc430 0x7fbae4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 --2- 172.21.15.80:0/641729478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbae40fed90 0x7fbae419a280 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 >> 172.21.15.80:0/641729478 conn(0x7fbae40f8160 msgr2=0x7fbae40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 shutdown_connections 2022-09-07T19:44:08.169 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.163+0000 7fbaeb39d700 1 -- 172.21.15.80:0/641729478 wait complete. 2022-09-07T19:44:08.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-07T19:44:08.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 -- 172.21.15.80:0/1398472386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c1011b0 msgr2=0x7fc34c101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 --2- 172.21.15.80:0/1398472386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c1011b0 0x7fc34c101600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc340009810 tx=0x7fc340009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:08.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 -- 172.21.15.80:0/1398472386 shutdown_connections 2022-09-07T19:44:08.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 --2- 172.21.15.80:0/1398472386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c101b40 0x7fc34c108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 --2- 172.21.15.80:0/1398472386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c0fff30 0x7fc34c100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 --2- 172.21.15.80:0/1398472386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c1011b0 0x7fc34c101600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 -- 172.21.15.80:0/1398472386 >> 172.21.15.80:0/1398472386 conn(0x7fc34c0fb6b0 msgr2=0x7fc34c0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:08.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 -- 172.21.15.80:0/1398472386 shutdown_connections 2022-09-07T19:44:08.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.460+0000 7fc350fff700 1 -- 172.21.15.80:0/1398472386 wait complete. 2022-09-07T19:44:08.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 Processor -- start 2022-09-07T19:44:08.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 -- start start 2022-09-07T19:44:08.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c0fff30 0x7fc34c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 0x7fc34c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c101b40 0x7fc34c19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c19d650 con 0x7fc34c101b40 2022-09-07T19:44:08.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c19d7c0 con 0x7fc34c1011b0 2022-09-07T19:44:08.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc350fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c19d980 con 0x7fc34c0fff30 2022-09-07T19:44:08.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc349d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 0x7fc34c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc34ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c101b40 0x7fc34c19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc349d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 0x7fc34c196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45920/0 (socket says 172.21.15.80:45920) 2022-09-07T19:44:08.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc34a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c0fff30 0x7fc34c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.462+0000 7fc349d9b700 1 -- 172.21.15.80:0/2728925462 learned_addr learned my addr 172.21.15.80:0/2728925462 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:08.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc349d9b700 1 -- 172.21.15.80:0/2728925462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c0fff30 msgr2=0x7fc34c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc349d9b700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c0fff30 0x7fc34c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc349d9b700 1 -- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c101b40 msgr2=0x7fc34c19d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc349d9b700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c101b40 0x7fc34c19d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc349d9b700 1 -- 172.21.15.80:0/2728925462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340009470 con 0x7fc34c1011b0 2022-09-07T19:44:08.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc34a59c700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c0fff30 0x7fc34c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:08.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.463+0000 7fc349d9b700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 0x7fc34c196010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc34000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.464+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34001d070 con 0x7fc34c1011b0 2022-09-07T19:44:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.464+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c19dc00 con 0x7fc34c1011b0 2022-09-07T19:44:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.464+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fc34000f8b0 con 0x7fc34c1011b0 2022-09-07T19:44:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.464+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400047f0 con 0x7fc34c1011b0 2022-09-07T19:44:08.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.464+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c19e100 con 0x7fc34c1011b0 2022-09-07T19:44:08.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.465+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c10b6e0 con 0x7fc34c1011b0 2022-09-07T19:44:08.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.467+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fc340028030 con 0x7fc34c1011b0 2022-09-07T19:44:08.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.468+0000 7fc33b7fe700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc334099010 0x7fc33409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.468+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fc3400c37e0 con 0x7fc34c1011b0 2022-09-07T19:44:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.469+0000 7fc34a59c700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc334099010 0x7fc33409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.469+0000 7fc34a59c700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc334099010 0x7fc33409b4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc34c101010 tx=0x7fc33c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:08.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.470+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fc34008fae0 con 0x7fc34c1011b0 2022-09-07T19:44:08.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:08 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/3210419837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:44:08.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:08 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/641729478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:44:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:08 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/3210419837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:44:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:08 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/641729478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:44:08.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:08 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/3210419837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2022-09-07T19:44:08.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:08 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/641729478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2022-09-07T19:44:08.706 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.707+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc34c1073c0 con 0x7fc34c1011b0 2022-09-07T19:44:08.707 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.708+0000 7fc33b7fe700 1 -- 172.21.15.80:0/2728925462 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10733 (secure 0 0 0) 0x7fc340026020 con 0x7fc34c1011b0 2022-09-07T19:44:08.708 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:44:08.709 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4122966657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4122966657},{"type":"v1","addr":"172.21.15.80:6839","nonce":4122966657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4090687760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4090687760},{"type":"v1","addr":"172.21.15.155:6833","nonce":4090687760}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1459419816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1459419816},{"type":"v1","addr":"172.21.15.80:6835","nonce":1459419816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/788391399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":788391399},{"type":"v1","addr":"172.21.15.154:6833","nonce":788391399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1565389450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":1565389450},{"type":"v1","addr":"172.21.15.80:6837","nonce":1565389450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1281093891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1281093891},{"type":"v1","addr":"172.21.15.155:6835","nonce":1281093891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-07T19:42:06.917499+0000","modified":"2022-09-07T19:42:38.506873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24575,"mds_1":24569,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24500":{"gid":24500,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1088711156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1088711156},{"type":"v1","addr":"172.21.15.154:6835","nonce":1088711156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6837/415293574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":415293574},{"type":"v1","addr":"172.21.15.155:6837","nonce":415293574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/560140413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":560140413},{"type":"v1","addr":"172.21.15.155:6839","nonce":560140413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6837/2976291086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2976291086},{"type":"v1","addr":"172.21.15.154:6837","nonce":2976291086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24569":{"gid":24569,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.80:6841/1430605646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1430605646},{"type":"v1","addr":"172.21.15.80:6841","nonce":1430605646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6839/545932828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":545932828},{"type":"v1","addr":"172.21.15.154:6839","nonce":545932828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-07T19:44:08.711 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc334099010 msgr2=0x7fc33409b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc334099010 0x7fc33409b4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc34c101010 tx=0x7fc33c005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 msgr2=0x7fc34c196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 0x7fc34c196010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc34000f690 comp rx=0 tx=0).stop 2022-09-07T19:44:08.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 shutdown_connections 2022-09-07T19:44:08.713 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc34c101b40 0x7fc34c19d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fc334099010 0x7fc33409b4c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.714 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc34c0fff30 0x7fc34c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 --2- 172.21.15.80:0/2728925462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc34c1011b0 0x7fc34c196010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 >> 172.21.15.80:0/2728925462 conn(0x7fc34c0fb6b0 msgr2=0x7fc34c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:08.715 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 shutdown_connections 2022-09-07T19:44:08.716 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.711+0000 7fc350fff700 1 -- 172.21.15.80:0/2728925462 wait complete. 2022-09-07T19:44:08.716 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2022-09-07T19:44:08.737 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-07T19:44:08.970 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.965+0000 7f3d22b9d700 1 -- 172.21.15.80:0/515321559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 msgr2=0x7f3d1c1060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.971 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.965+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/515321559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c1060b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009b00 tx=0x7f3d14009e10 comp rx=0 tx=0).stop 2022-09-07T19:44:08.972 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 -- 172.21.15.80:0/515321559 shutdown_connections 2022-09-07T19:44:08.972 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/515321559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c1060b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.972 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/515321559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 0x7f3d1c0fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.973 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/515321559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.973 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 -- 172.21.15.80:0/515321559 >> 172.21.15.80:0/515321559 conn(0x7f3d1c0f9230 msgr2=0x7f3d1c0fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:08.974 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 -- 172.21.15.80:0/515321559 shutdown_connections 2022-09-07T19:44:08.974 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.966+0000 7f3d22b9d700 1 -- 172.21.15.80:0/515321559 wait complete. 2022-09-07T19:44:08.974 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 Processor -- start 2022-09-07T19:44:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 -- start start 2022-09-07T19:44:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 0x7f3d1c1958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c19d440 con 0x7f3d1c0fe490 2022-09-07T19:44:08.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c19d5b0 con 0x7f3d1c0ff510 2022-09-07T19:44:08.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.967+0000 7f3d22b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c19d770 con 0x7f3d1c0fdb40 2022-09-07T19:44:08.977 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d21b9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 0x7f3d1c1958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.978 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57910/0 (socket says 172.21.15.80:57910) 2022-09-07T19:44:08.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d21b9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 0x7f3d1c1958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:56368/0 (socket says 172.21.15.80:56368) 2022-09-07T19:44:08.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 -- 172.21.15.80:0/142138955 learned_addr learned my addr 172.21.15.80:0/142138955 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:08.979 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2239c700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.980 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 -- 172.21.15.80:0/142138955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 msgr2=0x7f3d1c1958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.980 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 0x7f3d1c1958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 -- 172.21.15.80:0/142138955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 msgr2=0x7f3d1c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2139a700 1 -- 172.21.15.80:0/142138955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18009470 con 0x7f3d1c0fe490 2022-09-07T19:44:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.968+0000 7f3d2239c700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.969+0000 7f3d2139a700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c195e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00e710 tx=0x7f3d0c00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.969+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c009500 con 0x7f3d1c0fe490 2022-09-07T19:44:08.983 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.969+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d14009730 con 0x7f3d1c0fe490 2022-09-07T19:44:08.983 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.969+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f3d0c010da0 con 0x7f3d1c0fe490 2022-09-07T19:44:08.983 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.969+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0173d0 con 0x7f3d1c0fe490 2022-09-07T19:44:08.983 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.969+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c19de20 con 0x7f3d1c0fe490 2022-09-07T19:44:08.984 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.970+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c109330 con 0x7f3d1c0fe490 2022-09-07T19:44:08.985 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.972+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f3d0c00c040 con 0x7f3d1c0fe490 2022-09-07T19:44:08.985 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.973+0000 7f3d12ffd700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3d08099090 0x7f3d0809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:08.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.973+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f3d0c014070 con 0x7f3d1c0fe490 2022-09-07T19:44:08.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.973+0000 7f3d21b9b700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3d08099090 0x7f3d0809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:08.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.974+0000 7f3d21b9b700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3d08099090 0x7f3d0809b540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009440 tx=0x7f3d18005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:08.986 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:08.977+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f3d0c04fc80 con 0x7f3d1c0fe490 2022-09-07T19:44:09.170 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.170+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d1c18ff40 con 0x7f3d1c0fe490 2022-09-07T19:44:09.171 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.172+0000 7f3d12ffd700 1 -- 172.21.15.80:0/142138955 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+23865 (secure 0 0 0) 0x7f3d0c08eb80 con 0x7f3d1c0fe490 2022-09-07T19:44:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: 2022-09-07T19:44:09.172 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"fsid":"cc599a0c-2ee3-11ed-8431-001a4aab830c","created":"2022-09-07T19:33:38.884591+0000","modified":"2022-09-07T19:43:44.244098+0000","last_up_change":"2022-09-07T19:41:18.268138+0000","last_in_change":"2022-09-07T19:40:59.894882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-07T19:37:12.653905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-09-07T19:42:05.026979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-09-07T19:42:06.340517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2022-09-07T19:42:10.116527+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"022d8b5d-40e6-41d4-88ad-58fdf010d250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6803","nonce":2369094167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6805","nonce":2369094167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6809","nonce":2369094167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2369094167},{"type":"v1","addr":"172.21.15.80:6807","nonce":2369094167}]},"public_addr":"172.21.15.80:6803/2369094167","cluster_addr":"172.21.15.80:6805/2369094167","heartbeat_back_addr":"172.21.15.80:6809/2369094167","heartbeat_front_addr":"172.21.15.80:6807/2369094167","state":["exists","up"]},{"osd":1,"uuid":"c5f59885-06fb-4869-81ab-b0cab1580cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6801","nonce":406062851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6803","nonce":406062851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6807","nonce":406062851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":406062851},{"type":"v1","addr":"172.21.15.154:6805","nonce":406062851}]},"public_addr":"172.21.15.154:6801/406062851","cluster_addr":"172.21.15.154:6803/406062851","heartbeat_back_addr":"172.21.15.154:6807/406062851","heartbeat_front_addr":"172.21.15.154:6805/406062851","state":["exists","up"]},{"osd":2,"uuid":"9d02a02f-84eb-4310-8c4e-bea1be050f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6801","nonce":612567913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6803","nonce":612567913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6807","nonce":612567913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":612567913},{"type":"v1","addr":"172.21.15.155:6805","nonce":612567913}]},"public_addr":"172.21.15.155:6801/612567913","cluster_addr":"172.21.15.155:6803/612567913","heartbeat_back_addr":"172.21.15.155:6807/612567913","heartbeat_front_addr":"172.21.15.155:6805/612567913","state":["exists","up"]},{"osd":3,"uuid":"489c00ce-8e46-462f-85ee-9444ff4540ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6811","nonce":362298487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6813","nonce":362298487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6817","nonce":362298487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":362298487},{"type":"v1","addr":"172.21.15.80:6815","nonce":362298487}]},"public_addr":"172.21.15.80:6811/362298487","cluster_addr":"172.21.15.80:6813/362298487","heartbeat_back_addr":"172.21.15.80:6817/362298487","heartbeat_front_addr":"172.21.15.80:6815/362298487","state":["exists","up"]},{"osd":4,"uuid":"25e7edb2-1c29-4fc4-b0fe-cb8f36f1cfc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6809","nonce":4252118090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6811","nonce":4252118090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6815","nonce":4252118090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4252118090},{"type":"v1","addr":"172.21.15.154:6813","nonce":4252118090}]},"public_addr":"172.21.15.154:6809/4252118090","cluster_addr":"172.21.15.154:6811/4252118090","heartbeat_back_addr":"172.21.15.154:6815/4252118090","heartbeat_front_addr":"172.21.15.154:6813/4252118090","state":["exists","up"]},{"osd":5,"uuid":"d3d50e79-fa11-4704-aed7-278b832cfc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6809","nonce":181497455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6811","nonce":181497455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6815","nonce":181497455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":181497455},{"type":"v1","addr":"172.21.15.155:6813","nonce":181497455}]},"public_addr":"172.21.15.155:6809/181497455","cluster_addr":"172.21.15.155:6811/181497455","heartbeat_back_addr":"172.21.15.155:6815/181497455","heartbeat_front_addr":"172.21.15.155:6813/181497455","state":["exists","up"]},{"osd":6,"uuid":"f293a0d2-be68-4495-8419-9fb71666554c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6819","nonce":2212671377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6821","nonce":2212671377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6825","nonce":2212671377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2212671377},{"type":"v1","addr":"172.21.15.80:6823","nonce":2212671377}]},"public_addr":"172.21.15.80:6819/2212671377","cluster_addr":"172.21.15.80:6821/2212671377","heartbeat_back_addr":"172.21.15.80:6825/2212671377","heartbeat_front_addr":"172.21.15.80:6823/2212671377","state":["exists","up"]},{"osd":7,"uuid":"710d71e8-8f3a-432b-a7b4-c2962d0f6d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6817","nonce":1270586283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6819","nonce":1270586283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6823","nonce":1270586283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270586283},{"type":"v1","addr":"172.21.15.154:6821","nonce":1270586283}]},"public_addr":"172.21.15.154:6817/1270586283","cluster_addr":"172.21.15.154:6819/1270586283","heartbeat_back_addr":"172.21.15.154:6823/1270586283","heartbeat_front_addr":"172.21.15.154:6821/1270586283","state":["exists","up"]},{"osd":8,"uuid":"f17b0b5e-b37e-4026-927e-f5172cd5abbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6817","nonce":2568819573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6819","nonce":2568819573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6823","nonce":2568819573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2568819573},{"type":"v1","addr":"172.21.15.155:6821","nonce":2568819573}]},"public_addr":"172.21.15.155:6817/2568819573","cluster_addr":"172.21.15.155:6819/2568819573","heartbeat_back_addr":"172.21.15.155:6823/2568819573","heartbeat_front_addr":"172.21.15.155:6821/2568819573","state":["exists","up"]},{"osd":9,"uuid":"f44e9821-dbca-493a-99c6-4d4439873b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6827","nonce":3406803388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6829","nonce":3406803388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6833","nonce":3406803388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3406803388},{"type":"v1","addr":"172.21.15.80:6831","nonce":3406803388}]},"public_addr":"172.21.15.80:6827/3406803388","cluster_addr":"172.21.15.80:6829/3406803388","heartbeat_back_addr":"172.21.15.80:6833/3406803388","heartbeat_front_addr":"172.21.15.80:6831/3406803388","state":["exists","up"]},{"osd":10,"uuid":"dfa508c5-47de-4d2b-acf3-8f4a0776dd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6825","nonce":1234206337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6827","nonce":1234206337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6831","nonce":1234206337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1234206337},{"type":"v1","addr":"172.21.15.154:6829","nonce":1234206337}]},"public_addr":"172.21.15.154:6825/1234206337","cluster_addr":"172.21.15.154:6827/1234206337","heartbeat_back_addr":"172.21.15.154:6831/1234206337","heartbeat_front_addr":"172.21.15.154:6829/1234206337","state":["exists","up"]},{"osd":11,"uuid":"37b9e7ef-ee23-4345-98d1-1a07ab13dc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6825","nonce":137888946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6827","nonce":137888946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6831","nonce":137888946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":137888946},{"type":"v1","addr":"172.21.15.155:6829","nonce":137888946}]},"public_addr":"172.21.15.155:6825/137888946","cluster_addr":"172.21.15.155:6827/137888946","heartbeat_back_addr":"172.21.15.155:6831/137888946","heartbeat_front_addr":"172.21.15.155:6829/137888946","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:19.891034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:36:46.377276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:09.347067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:37:42.324274+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:08.300051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:38:31.477741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:04.464526+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:31.058495+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:39:54.063311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:26.677007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:40:53.455833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-07T19:41:16.554766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/1499799081":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/722803782":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6800/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/1903100695":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/146266391":"2022-09-08T19:34:41.782435+0000","172.21.15.80:6801/2842896476":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/4051851685":"2022-09-08T19:34:41.782435+0000","172.21.15.80:0/3462161622":"2022-09-08T19:34:13.528508+0000","172.21.15.80:0/3017372829":"2022-09-08T19:34:13.528508+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-07T19:44:09.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.174+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3d08099090 msgr2=0x7f3d0809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3d08099090 0x7f3d0809b540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009440 tx=0x7f3d18005f60 comp rx=0 tx=0).stop 2022-09-07T19:44:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 msgr2=0x7f3d1c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c195e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00e710 tx=0x7f3d0c00ea20 comp rx=0 tx=0).stop 2022-09-07T19:44:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 shutdown_connections 2022-09-07T19:44:09.175 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f3d08099090 0x7f3d0809b540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d1c0ff510 0x7f3d1c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1c0fdb40 0x7f3d1c1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 --2- 172.21.15.80:0/142138955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d1c0fe490 0x7f3d1c195e00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 >> 172.21.15.80:0/142138955 conn(0x7f3d1c0f9230 msgr2=0x7f3d1c104740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.176 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 shutdown_connections 2022-09-07T19:44:09.177 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.175+0000 7f3d22b9d700 1 -- 172.21.15.80:0/142138955 wait complete. 2022-09-07T19:44:09.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2022-09-07T19:42:06.917499+0000', 'modified': '2022-09-07T19:42:38.506873+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24575, 'mds_1': 24569, 'mds_2': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24500': {'gid': 24500, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/1088711156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1088711156}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1088711156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6837/415293574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 415293574}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 415293574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6839/560140413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 560140413}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 560140413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.154:6837/2976291086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 2976291086}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 2976291086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24569': {'gid': 24569, 'name': 'a', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.80:6841/1430605646', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6840', 'nonce': 1430605646}, {'type': 'v1', 'addr': '172.21.15.80:6841', 'nonce': 1430605646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6839/545932828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 545932828}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 545932828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-09-07T19:44:09.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2022-09-07T19:44:09.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2022-09-07T19:44:09.433 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 -- 172.21.15.80:0/1657105971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 msgr2=0x7f04981008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 --2- 172.21.15.80:0/1657105971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f04981008b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0488009810 tx=0x7f0488009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 -- 172.21.15.80:0/1657105971 shutdown_connections 2022-09-07T19:44:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 --2- 172.21.15.80:0/1657105971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f04981008b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 --2- 172.21.15.80:0/1657105971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04981038e0 0x7f0498105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 --2- 172.21.15.80:0/1657105971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0498100df0 0x7f0498103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 -- 172.21.15.80:0/1657105971 >> 172.21.15.80:0/1657105971 conn(0x7f04980f82e0 msgr2=0x7f04980fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 -- 172.21.15.80:0/1657105971 shutdown_connections 2022-09-07T19:44:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.434+0000 7f049d5ff700 1 -- 172.21.15.80:0/1657105971 wait complete. 2022-09-07T19:44:09.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.435+0000 7f049d5ff700 1 Processor -- start 2022-09-07T19:44:09.438 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.435+0000 7f049d5ff700 1 -- start start 2022-09-07T19:44:09.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f049d5ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f0498195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f049d5ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0498100df0 0x7f04981960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f049d5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04981038e0 0x7f049819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.439 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f049d5ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049819d6e0 con 0x7f0498066bf0 2022-09-07T19:44:09.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f049d5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049819d850 con 0x7f04981038e0 2022-09-07T19:44:09.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f049d5ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049819da10 con 0x7f0498100df0 2022-09-07T19:44:09.440 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f0498195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f0498195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57940/0 (socket says 172.21.15.80:57940) 2022-09-07T19:44:09.441 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 -- 172.21.15.80:0/2302696855 learned_addr learned my addr 172.21.15.80:0/2302696855 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f04977fe700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04981038e0 0x7f049819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f04967fc700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0498100df0 0x7f04981960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 -- 172.21.15.80:0/2302696855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0498100df0 msgr2=0x7f04981960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0498100df0 0x7f04981960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 -- 172.21.15.80:0/2302696855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04981038e0 msgr2=0x7f049819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04981038e0 0x7f049819d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.444 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.436+0000 7f0496ffd700 1 -- 172.21.15.80:0/2302696855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488009470 con 0x7f0498066bf0 2022-09-07T19:44:09.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.437+0000 7f0496ffd700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f0498195b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0488000c00 tx=0x7f048800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.437+0000 7f047bfff700 1 -- 172.21.15.80:0/2302696855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048801d070 con 0x7f0498066bf0 2022-09-07T19:44:09.445 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.437+0000 7f047bfff700 1 -- 172.21.15.80:0/2302696855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f048800f880 con 0x7f0498066bf0 2022-09-07T19:44:09.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.437+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049819dc90 con 0x7f0498066bf0 2022-09-07T19:44:09.446 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.437+0000 7f047bfff700 1 -- 172.21.15.80:0/2302696855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880047f0 con 0x7f0498066bf0 2022-09-07T19:44:09.447 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.437+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049819e190 con 0x7f0498066bf0 2022-09-07T19:44:09.455 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.440+0000 7f047bfff700 1 -- 172.21.15.80:0/2302696855 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f0488028030 con 0x7f0498066bf0 2022-09-07T19:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.441+0000 7f04b0a5db80 1 Processor -- start 2022-09-07T19:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.441+0000 7f047bfff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0480099090 0x7f048009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 -- start start 2022-09-07T19:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f047bfff700 1 -- 172.21.15.80:0/2302696855 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f04880c3340 con 0x7f0498066bf0 2022-09-07T19:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04977fe700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0480099090 0x7f048009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 0x5613a35c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35c3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a34ac080 con 0x5613a35c1ae0 2022-09-07T19:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a35169e0 con 0x5613a35c2430 2022-09-07T19:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a3510180 con 0x5613a35c31f0 2022-09-07T19:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 0x5613a35c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.442+0000 7f04967fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 0x5613a35c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57956/0 (socket says 172.21.15.80:57956) 2022-09-07T19:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45964/0 (socket says 172.21.15.80:45964) 2022-09-07T19:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f0496ffd700 1 -- 172.21.15.80:0/726495495 learned_addr learned my addr 172.21.15.80:0/726495495 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04977fe700 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 -- 172.21.15.80:0/726495495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 msgr2=0x5613a35c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.460 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 -- 172.21.15.80:0/726495495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 msgr2=0x5613a35c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 0x5613a35c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 -- 172.21.15.80:0/726495495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613a33985e0 con 0x5613a35c2430 2022-09-07T19:44:09.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f0496ffd700 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 0x5613a35c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:09.461 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04977fe700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0480099090 0x7f048009b540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0490009ec0 tx=0x7f0490011720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04967fc700 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c2c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f048c009b30 tx=0x7f048c009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d42b28af6a4efb5a server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.443+0000 7f04797fa700 1 -- 172.21.15.80:0/726495495 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c0042f0 con 0x5613a35c2430 2022-09-07T19:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04797fa700 1 -- 172.21.15.80:0/726495495 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f048c011dd0 con 0x5613a35c2430 2022-09-07T19:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04797fa700 1 -- 172.21.15.80:0/726495495 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c0193e0 con 0x5613a35c2430 2022-09-07T19:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 -- 172.21.15.80:0/726495495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 msgr2=0x5613a35c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c2c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f048c009b30 tx=0x7f048c009e40 comp rx=0 tx=0).stop 2022-09-07T19:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 -- 172.21.15.80:0/726495495 shutdown_connections 2022-09-07T19:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c1ae0 0x5613a35c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/726495495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c2c60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 -- 172.21.15.80:0/726495495 >> 172.21.15.80:0/726495495 conn(0x5613a35bdfa0 msgr2=0x5613a35bc370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 -- 172.21.15.80:0/726495495 shutdown_connections 2022-09-07T19:44:09.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.444+0000 7f04b0a5db80 1 -- 172.21.15.80:0/726495495 wait complete. 2022-09-07T19:44:09.465 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.445+0000 7f04b0a5db80 1 -- start start 2022-09-07T19:44:09.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.445+0000 7f04b0a5db80 1 Processor -- start 2022-09-07T19:44:09.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.466 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a33fe0c0 con 0x5613a35c2430 2022-09-07T19:44:09.467 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a35d2f70 con 0x5613a35c1ae0 2022-09-07T19:44:09.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a35d3100 con 0x5613a35c31f0 2022-09-07T19:44:09.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04b0a5db80 10 client.0 _ll_register_callbacks cb 0x5613a34bb370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:44:09.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04967fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.468 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04967fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57964/0 (socket says 172.21.15.80:57964) 2022-09-07T19:44:09.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04967fc700 1 -- 172.21.15.80:0/83930573 learned_addr learned my addr 172.21.15.80:0/83930573 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f0496ffd700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.446+0000 7f04977fe700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.469 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04967fc700 1 -- 172.21.15.80:0/83930573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 msgr2=0x5613a35d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04967fc700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04967fc700 1 -- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 msgr2=0x5613a35cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.470 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04967fc700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04967fc700 1 -- 172.21.15.80:0/83930573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049819e190 con 0x5613a35c2430 2022-09-07T19:44:09.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04967fc700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cb9f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f048c006010 tx=0x7f048c005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23114f957ebb28fc server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f0476ff5700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:44:09.471 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f0476ff5700 1 -- 172.21.15.80:0/83930573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c0040f0 con 0x5613a35c2430 2022-09-07T19:44:09.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f0476ff5700 1 -- 172.21.15.80:0/83930573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f048c004250 con 0x5613a35c2430 2022-09-07T19:44:09.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.447+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613a35b4aa0 con 0x5613a35c2430 2022-09-07T19:44:09.472 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f0476ff5700 1 -- 172.21.15.80:0/83930573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f048c011930 con 0x5613a35c2430 2022-09-07T19:44:09.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 10 client.15177 fetch_fsmap learned FSMap version 24 2022-09-07T19:44:09.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f048c009790 con 0x5613a35c2430 2022-09-07T19:44:09.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f0476ff5700 1 -- 172.21.15.80:0/83930573 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x5613a35b4aa0 con 0x5613a35c2430 2022-09-07T19:44:09.473 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f0476ff5700 1 -- 172.21.15.80:0/83930573 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f048c01acf0 con 0x5613a35c2430 2022-09-07T19:44:09.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 10 client.15177 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:44:09.474 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 10 client.15177 resolve_mds: resolved name 'h' to daemon mds.h 2022-09-07T19:44:09.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 20 client.15177 populate_metadata read hostname 'smithi080' 2022-09-07T19:44:09.475 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a35d6720 0x5613a35dba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 4 client.15177 mds_command: new command op to 24533 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:44:09.476 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.448+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 --> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613a35914c0 con 0x5613a35d6720 2022-09-07T19:44:09.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.449+0000 7f0496ffd700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a35d6720 0x5613a35dba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.477 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.449+0000 7f0476ff5700 10 client.15177 ms_handle_connect on v2:172.21.15.154:6836/2976291086 2022-09-07T19:44:09.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.449+0000 7f0496ffd700 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a35d6720 0x5613a35dba20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e340fabff123e69 server_cookie=fd75ed8c9cac7a1 in_seq=0 out_seq=0 2022-09-07T19:44:09.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f0476ff5700 1 -- 172.21.15.80:0/83930573 <== mds.2 v2:172.21.15.154:6836/2976291086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x5613a35914c0 con 0x5613a35d6720 2022-09-07T19:44:09.478 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f0476ff5700 10 client.15177 handle_command_reply: tid=0 2022-09-07T19:44:09.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 client.15177 shutdown 2022-09-07T19:44:09.479 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 msgr2=0x5613a35cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cb9f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f048c006010 tx=0x7f048c005cd0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.480 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 shutdown_connections 2022-09-07T19:44:09.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a35d6720 0x5613a35dba20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.481 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/83930573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cb9f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f0476ff5700 0 client.15177 ms_handle_reset on v2:172.21.15.154:6836/2976291086 2022-09-07T19:44:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.450+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 >> 172.21.15.80:0/83930573 conn(0x5613a35bdfa0 msgr2=0x5613a35bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.484 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.451+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 shutdown_connections 2022-09-07T19:44:09.484 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.451+0000 7f04b0a5db80 1 -- 172.21.15.80:0/83930573 wait complete. 2022-09-07T19:44:09.484 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.451+0000 7f04b0a5db80 20 client.15177 trim_cache size 0 max 16384 2022-09-07T19:44:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.468+0000 7f04b0a5db80 1 Processor -- start 2022-09-07T19:44:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.468+0000 7f04b0a5db80 1 -- start start 2022-09-07T19:44:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c1ae0 0x5613a35dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 0x5613a35c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a35914c0 con 0x5613a35c31f0 2022-09-07T19:44:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a35cc6a0 con 0x5613a35c2430 2022-09-07T19:44:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a34b24f0 con 0x5613a35c1ae0 2022-09-07T19:44:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 0x5613a35c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c1ae0 0x5613a35dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 0x5613a35c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57968/0 (socket says 172.21.15.80:57968) 2022-09-07T19:44:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04977fe700 1 -- 172.21.15.80:0/1076657424 learned_addr learned my addr 172.21.15.80:0/1076657424 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f04967fc700 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f0496ffd700 1 -- 172.21.15.80:0/1076657424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 msgr2=0x5613a35c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f0496ffd700 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f0496ffd700 1 -- 172.21.15.80:0/1076657424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 msgr2=0x5613a35c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.469+0000 7f0496ffd700 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 0x5613a35c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.470+0000 7f0496ffd700 1 -- 172.21.15.80:0/1076657424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613a3344d90 con 0x5613a35c1ae0 2022-09-07T19:44:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.470+0000 7f04977fe700 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 0x5613a35c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.470+0000 7f0496ffd700 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c1ae0 0x5613a35dfa40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0488093000 tx=0x7f04880c2040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16eb05dce3f0220b server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.470+0000 7f0479ffb700 1 -- 172.21.15.80:0/1076657424 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488093300 con 0x5613a35c1ae0 2022-09-07T19:44:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.470+0000 7f0479ffb700 1 -- 172.21.15.80:0/1076657424 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f048809a5a0 con 0x5613a35c1ae0 2022-09-07T19:44:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.470+0000 7f0479ffb700 1 -- 172.21.15.80:0/1076657424 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880aa180 con 0x5613a35c1ae0 2022-09-07T19:44:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 -- 172.21.15.80:0/1076657424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c1ae0 msgr2=0x5613a35dfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c1ae0 0x5613a35dfa40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0488093000 tx=0x7f04880c2040 comp rx=0 tx=0).stop 2022-09-07T19:44:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 -- 172.21.15.80:0/1076657424 shutdown_connections 2022-09-07T19:44:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c31f0 0x5613a35c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c1ae0 0x5613a35dfa40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/1076657424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c2430 0x5613a35c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 -- 172.21.15.80:0/1076657424 >> 172.21.15.80:0/1076657424 conn(0x5613a35bdfa0 msgr2=0x5613a35bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 -- 172.21.15.80:0/1076657424 shutdown_connections 2022-09-07T19:44:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 -- 172.21.15.80:0/1076657424 wait complete. 2022-09-07T19:44:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 -- start start 2022-09-07T19:44:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.471+0000 7f04b0a5db80 1 Processor -- start 2022-09-07T19:44:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a36289c0 con 0x5613a35c2430 2022-09-07T19:44:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a3628b00 con 0x5613a35c1ae0 2022-09-07T19:44:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613a3628c40 con 0x5613a35c31f0 2022-09-07T19:44:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04b0a5db80 10 client.0 _ll_register_callbacks cb 0x5613a34bb370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:44:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04967fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04967fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57982/0 (socket says 172.21.15.80:57982) 2022-09-07T19:44:09.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:45992/0 (socket says 172.21.15.80:45992) 2022-09-07T19:44:09.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04967fc700 1 -- 172.21.15.80:0/3148119218 learned_addr learned my addr 172.21.15.80:0/3148119218 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.503 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.472+0000 7f04977fe700 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04967fc700 1 -- 172.21.15.80:0/3148119218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 msgr2=0x5613a35cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04967fc700 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04967fc700 1 -- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 msgr2=0x5613a35cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.504 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04967fc700 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04967fc700 1 -- 172.21.15.80:0/3148119218 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0490003ba0 con 0x5613a35c2430 2022-09-07T19:44:09.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04967fc700 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cf630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f048c009a80 tx=0x7f048c003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6a6e970d5d9839 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f0476ff5700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:44:09.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f0476ff5700 1 -- 172.21.15.80:0/3148119218 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c023640 con 0x5613a35c2430 2022-09-07T19:44:09.505 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f0476ff5700 1 -- 172.21.15.80:0/3148119218 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f048c000e40 con 0x5613a35c2430 2022-09-07T19:44:09.506 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f048c011dd0 con 0x5613a35c2430 2022-09-07T19:44:09.506 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f0476ff5700 1 -- 172.21.15.80:0/3148119218 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f048c011ae0 con 0x5613a35c2430 2022-09-07T19:44:09.506 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04b0a5db80 10 client.15183 fetch_fsmap learned FSMap version 24 2022-09-07T19:44:09.506 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.473+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f049819dc90 con 0x5613a35c2430 2022-09-07T19:44:09.507 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f0476ff5700 1 -- 172.21.15.80:0/3148119218 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f048c011dd0 con 0x5613a35c2430 2022-09-07T19:44:09.507 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f0476ff5700 1 -- 172.21.15.80:0/3148119218 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f048c00e4a0 con 0x5613a35c2430 2022-09-07T19:44:09.507 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f04b0a5db80 10 client.15183 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:44:09.507 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f04b0a5db80 10 client.15183 resolve_mds: resolved name 'h' to daemon mds.h 2022-09-07T19:44:09.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f04b0a5db80 20 client.15183 populate_metadata read hostname 'smithi080' 2022-09-07T19:44:09.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a362d510 0x5613a3629ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f04b0a5db80 4 client.15183 mds_command: new command op to 24533 tid=0[{"prefix": "status"}] 2022-09-07T19:44:09.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 --> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5613a35096f0 con 0x5613a362d510 2022-09-07T19:44:09.508 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.474+0000 7f0496ffd700 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a362d510 0x5613a3629ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f0496ffd700 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a362d510 0x5613a3629ef0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acd0d77f52a747d0 server_cookie=4abc4acbf4b5563a in_seq=0 out_seq=0 2022-09-07T19:44:09.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f0476ff5700 10 client.15183 ms_handle_connect on v2:172.21.15.154:6836/2976291086 2022-09-07T19:44:09.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f0476ff5700 1 -- 172.21.15.80:0/3148119218 <== mds.2 v2:172.21.15.154:6836/2976291086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5613a35096f0 con 0x5613a362d510 2022-09-07T19:44:09.509 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f0476ff5700 10 client.15183 handle_command_reply: tid=0 2022-09-07T19:44:09.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 client.15183 shutdown 2022-09-07T19:44:09.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 msgr2=0x5613a35cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cf630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f048c009a80 tx=0x7f048c003a00 comp rx=0 tx=0).stop 2022-09-07T19:44:09.510 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 shutdown_connections 2022-09-07T19:44:09.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:6836/2976291086,v1:172.21.15.154:6837/2976291086] conn(0x5613a362d510 0x5613a3629ef0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613a35c31f0 0x5613a35cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613a35c1ae0 0x5613a35cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 --2- 172.21.15.80:0/3148119218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613a35c2430 0x5613a35cf630 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.511 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 >> 172.21.15.80:0/3148119218 conn(0x5613a35bdfa0 msgr2=0x5613a35dfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.475+0000 7f0476ff5700 0 client.15183 ms_handle_reset on v2:172.21.15.154:6836/2976291086 2022-09-07T19:44:09.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 shutdown_connections 2022-09-07T19:44:09.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f04b0a5db80 1 -- 172.21.15.80:0/3148119218 wait complete. 2022-09-07T19:44:09.512 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f04b0a5db80 20 client.15183 trim_cache size 0 max 16384 2022-09-07T19:44:09.513 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:44:09.513 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:44:09.513 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2022-09-07T19:44:09.514 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24533, 2022-09-07T19:44:09.514 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:44:09.514 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:44:09.514 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:44:09.515 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 91.976002645999998, 2022-09-07T19:44:09.515 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 24, 2022-09-07T19:44:09.515 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 93, 2022-09-07T19:44:09.515 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2022-09-07T19:44:09.516 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 141.64824074200001 2022-09-07T19:44:09.516 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:44:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0480099090 msgr2=0x7f048009b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.517 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f049d5ff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0480099090 0x7f048009b540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0490009ec0 tx=0x7f0490011720 comp rx=0 tx=0).stop 2022-09-07T19:44:09.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 msgr2=0x7f0498195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.476+0000 7f049d5ff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f0498195b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0488000c00 tx=0x7f048800f690 comp rx=0 tx=0).stop 2022-09-07T19:44:09.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 shutdown_connections 2022-09-07T19:44:09.518 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0498066bf0 0x7f0498195b60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0480099090 0x7f048009b540 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04981038e0 0x7f049819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 --2- 172.21.15.80:0/2302696855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0498100df0 0x7f04981960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.519 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 >> 172.21.15.80:0/2302696855 conn(0x7f04980f82e0 msgr2=0x7f04980ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 shutdown_connections 2022-09-07T19:44:09.520 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.477+0000 7f049d5ff700 1 -- 172.21.15.80:0/2302696855 wait complete. 2022-09-07T19:44:09.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:09 smithi080 ceph-mon[90124]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:09.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:09 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/2728925462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:44:09.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:09 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/142138955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:09.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2022-09-07T19:44:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:09 smithi154 ceph-mon[96967]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:09 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/2728925462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:44:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:09 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/142138955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:09 smithi155 ceph-mon[97606]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:09.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:09 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/2728925462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-09-07T19:44:09.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:09 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/142138955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-09-07T19:44:09.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 -- 172.21.15.80:0/3414328633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 msgr2=0x7fd1e00ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.753 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/3414328633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e00ff3d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009810 tx=0x7fd1d4009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:09.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 -- 172.21.15.80:0/3414328633 shutdown_connections 2022-09-07T19:44:09.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/3414328633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 0x7fd1e01061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.754 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/3414328633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e00fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/3414328633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e00ff3d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.755 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 -- 172.21.15.80:0/3414328633 >> 172.21.15.80:0/3414328633 conn(0x7fd1e00f93f0 msgr2=0x7fd1e00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 -- 172.21.15.80:0/3414328633 shutdown_connections 2022-09-07T19:44:09.756 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.752+0000 7fd1e51ff700 1 -- 172.21.15.80:0/3414328633 wait complete. 2022-09-07T19:44:09.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 Processor -- start 2022-09-07T19:44:09.758 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 -- start start 2022-09-07T19:44:09.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e0195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e0196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 0x7fd1e019d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.785 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e019d750 con 0x7fd1e00fef80 2022-09-07T19:44:09.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e019d8c0 con 0x7fd1e00ff910 2022-09-07T19:44:09.786 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1e51ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e019da80 con 0x7fd1e00fdd00 2022-09-07T19:44:09.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e0196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e0195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e0195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:56436/0 (socket says 172.21.15.80:56436) 2022-09-07T19:44:09.787 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2805648122 learned_addr learned my addr 172.21.15.80:0/2805648122 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1df59e700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 0x7fd1e019d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.754+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e0196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57990/0 (socket says 172.21.15.80:57990) 2022-09-07T19:44:09.788 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2805648122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 msgr2=0x7fd1e019d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 0x7fd1e019d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 msgr2=0x7fd1e0196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e0196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.789 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2805648122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009470 con 0x7fd1e00fdd00 2022-09-07T19:44:09.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1df59e700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 0x7fd1e019d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:09.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.755+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e0195bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000e710 tx=0x7fd1d000ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.756+0000 7fd1c7fff700 1 -- 172.21.15.80:0/2805648122 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0004220 con 0x7fd1e00fdd00 2022-09-07T19:44:09.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.756+0000 7fd1c7fff700 1 -- 172.21.15.80:0/2805648122 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd1d0004380 con 0x7fd1e00fdd00 2022-09-07T19:44:09.792 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.756+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e019dd60 con 0x7fd1e00fdd00 2022-09-07T19:44:09.792 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.756+0000 7fd1c7fff700 1 -- 172.21.15.80:0/2805648122 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0003cf0 con 0x7fd1e00fdd00 2022-09-07T19:44:09.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.756+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e019e1c0 con 0x7fd1e00fdd00 2022-09-07T19:44:09.793 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.759+0000 7fd1c7fff700 1 -- 172.21.15.80:0/2805648122 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fd1d001e020 con 0x7fd1e00fdd00 2022-09-07T19:44:09.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.760+0000 7fd1f8699b80 1 Processor -- start 2022-09-07T19:44:09.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.760+0000 7fd1f8699b80 1 -- start start 2022-09-07T19:44:09.794 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f876ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f877430 0x556c7f877c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f878640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.795 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f761080 con 0x556c7f877430 2022-09-07T19:44:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f7cb9e0 con 0x556c7f876ae0 2022-09-07T19:44:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f7c5180 con 0x556c7f8781f0 2022-09-07T19:44:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1c7fff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd1c8099010 0x7fd1c809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1c7fff700 1 -- 172.21.15.80:0/2805648122 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fd1d0014070 con 0x7fd1e00fdd00 2022-09-07T19:44:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f878640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1df59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f876ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f877430 0x556c7f877c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f878640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:56446/0 (socket says 172.21.15.80:56446) 2022-09-07T19:44:09.798 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1de59c700 1 -- 172.21.15.80:0/3794066913 learned_addr learned my addr 172.21.15.80:0/3794066913 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.761+0000 7fd1df59e700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd1c8099010 0x7fd1c809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1de59c700 1 -- 172.21.15.80:0/3794066913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 msgr2=0x556c7f876ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1de59c700 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f876ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.799 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1de59c700 1 -- 172.21.15.80:0/3794066913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f877430 msgr2=0x556c7f877c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.800 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1de59c700 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f877430 0x556c7f877c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.800 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1de59c700 1 -- 172.21.15.80:0/3794066913 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c7f64d5e0 con 0x556c7f8781f0 2022-09-07T19:44:09.800 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1de59c700 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f878640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4015000 tx=0x7fd1d4005d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d1cecc1578d616 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.800 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1df59e700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd1c8099010 0x7fd1c809b4c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80099b0 tx=0x7fd1d8009410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1c57fa700 1 -- 172.21.15.80:0/3794066913 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d401d070 con 0x556c7f8781f0 2022-09-07T19:44:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1c57fa700 1 -- 172.21.15.80:0/3794066913 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd1d401e040 con 0x556c7f8781f0 2022-09-07T19:44:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.762+0000 7fd1c57fa700 1 -- 172.21.15.80:0/3794066913 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4004760 con 0x556c7f8781f0 2022-09-07T19:44:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 -- 172.21.15.80:0/3794066913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 msgr2=0x556c7f878640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f878640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4015000 tx=0x7fd1d4005d00 comp rx=0 tx=0).stop 2022-09-07T19:44:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 -- 172.21.15.80:0/3794066913 shutdown_connections 2022-09-07T19:44:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f878640 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f876ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/3794066913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f877430 0x556c7f877c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 -- 172.21.15.80:0/3794066913 >> 172.21.15.80:0/3794066913 conn(0x556c7f872fa0 msgr2=0x556c7f871370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 -- 172.21.15.80:0/3794066913 shutdown_connections 2022-09-07T19:44:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.763+0000 7fd1f8699b80 1 -- 172.21.15.80:0/3794066913 wait complete. 2022-09-07T19:44:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.764+0000 7fd1f8699b80 1 -- start start 2022-09-07T19:44:09.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.764+0000 7fd1f8699b80 1 Processor -- start 2022-09-07T19:44:09.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.764+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f880450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f880990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.804 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 0x556c7f8879d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.805 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f6b30c0 con 0x556c7f8781f0 2022-09-07T19:44:09.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f887f10 con 0x556c7f876ae0 2022-09-07T19:44:09.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f8880a0 con 0x556c7f877430 2022-09-07T19:44:09.806 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1f8699b80 10 client.0 _ll_register_callbacks cb 0x556c7f770370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:44:09.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 0x556c7f8879d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.807 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f880450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 0x556c7f8879d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58004/0 (socket says 172.21.15.80:58004) 2022-09-07T19:44:09.808 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 -- 172.21.15.80:0/390922613 learned_addr learned my addr 172.21.15.80:0/390922613 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1de59c700 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f880990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.809 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 -- 172.21.15.80:0/390922613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 msgr2=0x556c7f880990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f880990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 -- 172.21.15.80:0/390922613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 msgr2=0x556c7f880450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f880450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.811 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.765+0000 7fd1df59e700 1 -- 172.21.15.80:0/390922613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e0106a40 con 0x556c7f8781f0 2022-09-07T19:44:09.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1df59e700 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 0x556c7f8879d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8004640 tx=0x7fd1d80049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551011b7cfb7a50a server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.812 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1be7fc700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:44:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1be7fc700 1 -- 172.21.15.80:0/390922613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8004670 con 0x556c7f8781f0 2022-09-07T19:44:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1be7fc700 1 -- 172.21.15.80:0/390922613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fd1d8021ba0 con 0x556c7f8781f0 2022-09-07T19:44:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c7f869aa0 con 0x556c7f8781f0 2022-09-07T19:44:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1be7fc700 1 -- 172.21.15.80:0/390922613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1d8021d60 con 0x556c7f8781f0 2022-09-07T19:44:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1f8699b80 10 client.15195 fetch_fsmap learned FSMap version 24 2022-09-07T19:44:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.766+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556c7f5f9d90 con 0x556c7f8781f0 2022-09-07T19:44:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1be7fc700 1 -- 172.21.15.80:0/390922613 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x556c7f869aa0 con 0x556c7f8781f0 2022-09-07T19:44:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1be7fc700 1 -- 172.21.15.80:0/390922613 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fd1d801e480 con 0x556c7f8781f0 2022-09-07T19:44:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1f8699b80 10 client.15195 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:44:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1f8699b80 10 client.15195 resolve_mds: resolved name 'a' to daemon mds.a 2022-09-07T19:44:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1f8699b80 20 client.15195 populate_metadata read hostname 'smithi080' 2022-09-07T19:44:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f88b260 0x556c7f890b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1f8699b80 4 client.15195 mds_command: new command op to 24569 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:44:09.818 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 --> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c7f8464c0 con 0x556c7f88b260 2022-09-07T19:44:09.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.767+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f88b260 0x556c7f890b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.819 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.768+0000 7fd1be7fc700 10 client.15195 ms_handle_connect on v2:172.21.15.80:6840/1430605646 2022-09-07T19:44:09.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.768+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f88b260 0x556c7f890b50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d05a40f6697130e server_cookie=7f98c0fd8ceb8e8d in_seq=0 out_seq=0 2022-09-07T19:44:09.820 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1be7fc700 1 -- 172.21.15.80:0/390922613 <== mds.1 v2:172.21.15.80:6840/1430605646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x556c7f8464c0 con 0x556c7f88b260 2022-09-07T19:44:09.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1be7fc700 10 client.15195 handle_command_reply: tid=0 2022-09-07T19:44:09.821 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 client.15195 shutdown 2022-09-07T19:44:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 msgr2=0x556c7f8879d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 0x556c7f8879d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8004640 tx=0x7fd1d80049c0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 shutdown_connections 2022-09-07T19:44:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f8781f0 0x556c7f8879d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f88b260 0x556c7f890b50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f876ae0 0x556c7f880450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/390922613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f880990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 >> 172.21.15.80:0/390922613 conn(0x556c7f872fa0 msgr2=0x556c7f870a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1be7fc700 0 client.15195 ms_handle_reset on v2:172.21.15.80:6840/1430605646 2022-09-07T19:44:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 shutdown_connections 2022-09-07T19:44:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.769+0000 7fd1f8699b80 1 -- 172.21.15.80:0/390922613 wait complete. 2022-09-07T19:44:09.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.770+0000 7fd1f8699b80 20 client.15195 trim_cache size 0 max 16384 2022-09-07T19:44:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.787+0000 7fd1f8699b80 1 Processor -- start 2022-09-07T19:44:09.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.787+0000 7fd1f8699b80 1 -- start start 2022-09-07T19:44:09.841 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f894b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f888420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.842 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f8781f0 0x556c7f87ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f791690 con 0x556c7f876ae0 2022-09-07T19:44:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f6d7ed0 con 0x556c7f8781f0 2022-09-07T19:44:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f87f900 con 0x556c7f877430 2022-09-07T19:44:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f894b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f894b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58020/0 (socket says 172.21.15.80:58020) 2022-09-07T19:44:09.845 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f888420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.845 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2991736919 learned_addr learned my addr 172.21.15.80:0/2991736919 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1df59e700 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f8781f0 0x556c7f87ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.846 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2991736919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 msgr2=0x556c7f888420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f888420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.847 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2991736919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f8781f0 msgr2=0x556c7f87ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.788+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f8781f0 0x556c7f87ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.789+0000 7fd1ded9d700 1 -- 172.21.15.80:0/2991736919 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c7f5f8260 con 0x556c7f876ae0 2022-09-07T19:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.789+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f894b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd1d008edf0 tx=0x7fd1d0092350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387a4ab16793290a server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.789+0000 7fd1c5ffb700 1 -- 172.21.15.80:0/2991736919 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00a9040 con 0x556c7f876ae0 2022-09-07T19:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.789+0000 7fd1c5ffb700 1 -- 172.21.15.80:0/2991736919 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd1d00c0230 con 0x556c7f876ae0 2022-09-07T19:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.789+0000 7fd1c5ffb700 1 -- 172.21.15.80:0/2991736919 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00a4ea0 con 0x556c7f876ae0 2022-09-07T19:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 -- 172.21.15.80:0/2991736919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 msgr2=0x556c7f894b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f894b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd1d008edf0 tx=0x7fd1d0092350 comp rx=0 tx=0).stop 2022-09-07T19:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 -- 172.21.15.80:0/2991736919 shutdown_connections 2022-09-07T19:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f894b70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f8781f0 0x556c7f87ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/2991736919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f877430 0x556c7f888420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 -- 172.21.15.80:0/2991736919 >> 172.21.15.80:0/2991736919 conn(0x556c7f872fa0 msgr2=0x556c7f871340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 -- 172.21.15.80:0/2991736919 shutdown_connections 2022-09-07T19:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 -- 172.21.15.80:0/2991736919 wait complete. 2022-09-07T19:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.790+0000 7fd1f8699b80 1 -- start start 2022-09-07T19:44:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 Processor -- start 2022-09-07T19:44:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f884260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f877430 0x556c7f8847a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f8e6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f884f30 con 0x556c7f876ae0 2022-09-07T19:44:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f8850a0 con 0x556c7f877430 2022-09-07T19:44:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7f8e6840 con 0x556c7f8781f0 2022-09-07T19:44:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1f8699b80 10 client.0 _ll_register_callbacks cb 0x556c7f770370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:44:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f884260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f877430 0x556c7f8847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1ded9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f884260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58028/0 (socket says 172.21.15.80:58028) 2022-09-07T19:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1df59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f8e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.791+0000 7fd1ded9d700 1 -- 172.21.15.80:0/150622565 learned_addr learned my addr 172.21.15.80:0/150622565 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1ded9d700 1 -- 172.21.15.80:0/150622565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 msgr2=0x556c7f8e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f8e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1ded9d700 1 -- 172.21.15.80:0/150622565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f877430 msgr2=0x556c7f8847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f877430 0x556c7f8847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1ded9d700 1 -- 172.21.15.80:0/150622565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e019e1c0 con 0x556c7f876ae0 2022-09-07T19:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1ded9d700 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f884260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1d008f3b0 tx=0x7fd1d0090e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b3230870b8e5a6 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1be7fc700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1be7fc700 1 -- 172.21.15.80:0/150622565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00a9040 con 0x556c7f876ae0 2022-09-07T19:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1be7fc700 1 -- 172.21.15.80:0/150622565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fd1d0003e50 con 0x556c7f876ae0 2022-09-07T19:44:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.792+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1d401e040 con 0x556c7f876ae0 2022-09-07T19:44:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1be7fc700 1 -- 172.21.15.80:0/150622565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1d00a4ea0 con 0x556c7f876ae0 2022-09-07T19:44:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 10 client.15201 fetch_fsmap learned FSMap version 24 2022-09-07T19:44:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556c7f6c6a30 con 0x556c7f876ae0 2022-09-07T19:44:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1be7fc700 1 -- 172.21.15.80:0/150622565 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fd1d401e040 con 0x556c7f876ae0 2022-09-07T19:44:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1be7fc700 1 -- 172.21.15.80:0/150622565 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fd1d0092ba0 con 0x556c7f876ae0 2022-09-07T19:44:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 10 client.15201 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:44:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 10 client.15201 resolve_mds: resolved name 'a' to daemon mds.a 2022-09-07T19:44:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 20 client.15201 populate_metadata read hostname 'smithi080' 2022-09-07T19:44:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f8eb3c0 0x556c7f8e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 4 client.15201 mds_command: new command op to 24569 tid=0[{"prefix": "status"}] 2022-09-07T19:44:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 --> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c7f7be6f0 con 0x556c7f8eb3c0 2022-09-07T19:44:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.793+0000 7fd1de59c700 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f8eb3c0 0x556c7f8e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1de59c700 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f8eb3c0 0x556c7f8e7d30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e997923815a6adee server_cookie=d1ed18d882435fe7 in_seq=0 out_seq=0 2022-09-07T19:44:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1be7fc700 10 client.15201 ms_handle_connect on v2:172.21.15.80:6840/1430605646 2022-09-07T19:44:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1be7fc700 1 -- 172.21.15.80:0/150622565 <== mds.1 v2:172.21.15.80:6840/1430605646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x556c7f7be6f0 con 0x556c7f8eb3c0 2022-09-07T19:44:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1be7fc700 10 client.15201 handle_command_reply: tid=0 2022-09-07T19:44:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 client.15201 shutdown 2022-09-07T19:44:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 msgr2=0x556c7f884260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f884260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1d008f3b0 tx=0x7fd1d0090e40 comp rx=0 tx=0).stop 2022-09-07T19:44:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 shutdown_connections 2022-09-07T19:44:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c7f876ae0 0x556c7f884260 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646] conn(0x556c7f8eb3c0 0x556c7f8e7d30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7f8781f0 0x556c7f8e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.794+0000 7fd1f8699b80 1 --2- 172.21.15.80:0/150622565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7f877430 0x556c7f8847a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 >> 172.21.15.80:0/150622565 conn(0x556c7f872fa0 msgr2=0x556c7f894b70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1be7fc700 0 client.15201 ms_handle_reset on v2:172.21.15.80:6840/1430605646 2022-09-07T19:44:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 shutdown_connections 2022-09-07T19:44:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1f8699b80 1 -- 172.21.15.80:0/150622565 wait complete. 2022-09-07T19:44:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1f8699b80 20 client.15201 trim_cache size 0 max 16384 2022-09-07T19:44:09.864 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:44:09.864 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:44:09.865 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2022-09-07T19:44:09.865 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24569, 2022-09-07T19:44:09.865 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:44:09.865 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:44:09.866 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:44:09.866 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 93.299532747000001, 2022-09-07T19:44:09.866 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 24, 2022-09-07T19:44:09.866 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 93, 2022-09-07T19:44:09.867 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2022-09-07T19:44:09.867 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 132.69777564399999 2022-09-07T19:44:09.867 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:44:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd1c8099010 msgr2=0x7fd1c809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd1c8099010 0x7fd1c809b4c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80099b0 tx=0x7fd1d8009410 comp rx=0 tx=0).stop 2022-09-07T19:44:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 msgr2=0x7fd1e0195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.795+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e0195bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000e710 tx=0x7fd1d000ea20 comp rx=0 tx=0).stop 2022-09-07T19:44:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 shutdown_connections 2022-09-07T19:44:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fd1c8099010 0x7fd1c809b4c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e00ff910 0x7fd1e019d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1e00fdd00 0x7fd1e0195bd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 --2- 172.21.15.80:0/2805648122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1e00fef80 0x7fd1e0196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 >> 172.21.15.80:0/2805648122 conn(0x7fd1e00f93f0 msgr2=0x7fd1e0104960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 shutdown_connections 2022-09-07T19:44:09.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:09.796+0000 7fd1e51ff700 1 -- 172.21.15.80:0/2805648122 wait complete. 2022-09-07T19:44:09.872 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-09-07T19:44:10.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 -- 172.21.15.80:0/775047801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 msgr2=0x7f03b00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 --2- 172.21.15.80:0/775047801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b00fee80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009750 tx=0x7f03a4009a60 comp rx=0 tx=0).stop 2022-09-07T19:44:10.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 -- 172.21.15.80:0/775047801 shutdown_connections 2022-09-07T19:44:10.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 --2- 172.21.15.80:0/775047801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 0x7f03b01060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 --2- 172.21.15.80:0/775047801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03b00fdb40 0x7f03b00fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 --2- 172.21.15.80:0/775047801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b00fee80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 -- 172.21.15.80:0/775047801 >> 172.21.15.80:0/775047801 conn(0x7f03b00f9230 msgr2=0x7f03b00fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:10.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 -- 172.21.15.80:0/775047801 shutdown_connections 2022-09-07T19:44:10.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.102+0000 7f03b49fe700 1 -- 172.21.15.80:0/775047801 wait complete. 2022-09-07T19:44:10.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.103+0000 7f03b49fe700 1 Processor -- start 2022-09-07T19:44:10.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 -- start start 2022-09-07T19:44:10.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03b00fdb40 0x7f03b01959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.108 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b0195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 0x7f03b019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b019d560 con 0x7f03b00fe490 2022-09-07T19:44:10.109 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b019d6d0 con 0x7f03b00ff510 2022-09-07T19:44:10.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03b49fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b019d890 con 0x7f03b00fdb40 2022-09-07T19:44:10.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03ae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b0195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03ae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b0195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58042/0 (socket says 172.21.15.80:58042) 2022-09-07T19:44:10.110 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03ae59c700 1 -- 172.21.15.80:0/136706060 learned_addr learned my addr 172.21.15.80:0/136706060 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:10.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03aed9d700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03b00fdb40 0x7f03b01959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.104+0000 7f03af59e700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 0x7f03b019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03ae59c700 1 -- 172.21.15.80:0/136706060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03b00fdb40 msgr2=0x7f03b01959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.111 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03ae59c700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03b00fdb40 0x7f03b01959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03ae59c700 1 -- 172.21.15.80:0/136706060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 msgr2=0x7f03b019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03ae59c700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 0x7f03b019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03ae59c700 1 -- 172.21.15.80:0/136706060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0009470 con 0x7f03b00fe490 2022-09-07T19:44:10.112 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03af59e700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 0x7f03b019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:44:10.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03ae59c700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b0195f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f03a4004230 tx=0x7f03a4004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:10.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f0393fff700 1 -- 172.21.15.80:0/136706060 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a401d070 con 0x7f03b00fe490 2022-09-07T19:44:10.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f0393fff700 1 -- 172.21.15.80:0/136706060 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f03a4003bb0 con 0x7f03b00fe490 2022-09-07T19:44:10.113 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f0393fff700 1 -- 172.21.15.80:0/136706060 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4017c70 con 0x7f03b00fe490 2022-09-07T19:44:10.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a40093b0 con 0x7f03b00fe490 2022-09-07T19:44:10.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.105+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b019dde0 con 0x7f03b00fe490 2022-09-07T19:44:10.114 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.108+0000 7f0393fff700 1 -- 172.21.15.80:0/136706060 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f03a4027020 con 0x7f03b00fe490 2022-09-07T19:44:10.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.110+0000 7f0393fff700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0398099090 0x7f039809b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.110+0000 7f03c864cb80 1 Processor -- start 2022-09-07T19:44:10.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.110+0000 7f0393fff700 1 -- 172.21.15.80:0/136706060 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f03a40c35c0 con 0x7f03b00fe490 2022-09-07T19:44:10.121 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.110+0000 7f03aed9d700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0398099090 0x7f039809b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.110+0000 7f03c864cb80 1 -- start start 2022-09-07T19:44:10.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33030410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c3302ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3302f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.122 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03c864cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32f19080 con 0x555c33030000 2022-09-07T19:44:10.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03c864cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32f839e0 con 0x555c3302f1c0 2022-09-07T19:44:10.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03c864cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32f7d180 con 0x555c33030950 2022-09-07T19:44:10.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03aed9d700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0398099090 0x7f039809b540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009440 tx=0x7f03a0005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:10.123 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03aed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33030410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.124 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03af59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3302f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.124 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03aed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33030410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58048/0 (socket says 172.21.15.80:58048) 2022-09-07T19:44:10.124 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03aed9d700 1 -- 172.21.15.80:0/1461354660 learned_addr learned my addr 172.21.15.80:0/1461354660 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:10.124 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.111+0000 7f03ae59c700 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c3302ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.124 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03af59e700 1 -- 172.21.15.80:0/1461354660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 msgr2=0x555c3302ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03af59e700 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c3302ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03af59e700 1 -- 172.21.15.80:0/1461354660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 msgr2=0x555c33030410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03af59e700 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33030410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.125 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03af59e700 1 -- 172.21.15.80:0/1461354660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c32e055e0 con 0x555c3302f1c0 2022-09-07T19:44:10.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03ae59c700 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c3302ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:10.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03af59e700 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3302f630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009e10 tx=0x7f03a800f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c3f88d1ad95f35 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:10.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03917fa700 1 -- 172.21.15.80:0/1461354660 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800fda0 con 0x555c3302f1c0 2022-09-07T19:44:10.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03917fa700 1 -- 172.21.15.80:0/1461354660 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f03a80118e0 con 0x555c3302f1c0 2022-09-07T19:44:10.126 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.112+0000 7f03917fa700 1 -- 172.21.15.80:0/1461354660 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8010770 con 0x555c3302f1c0 2022-09-07T19:44:10.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 -- 172.21.15.80:0/1461354660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 msgr2=0x555c3302f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3302f630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009e10 tx=0x7f03a800f640 comp rx=0 tx=0).stop 2022-09-07T19:44:10.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 -- 172.21.15.80:0/1461354660 shutdown_connections 2022-09-07T19:44:10.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33030410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3302f630 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1461354660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c3302ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 -- 172.21.15.80:0/1461354660 >> 172.21.15.80:0/1461354660 conn(0x555c3302b170 msgr2=0x555c330295a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:10.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 -- 172.21.15.80:0/1461354660 shutdown_connections 2022-09-07T19:44:10.128 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.113+0000 7f03c864cb80 1 -- 172.21.15.80:0/1461354660 wait complete. 2022-09-07T19:44:10.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.114+0000 7f03c864cb80 1 -- start start 2022-09-07T19:44:10.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.114+0000 7f03c864cb80 1 Processor -- start 2022-09-07T19:44:10.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c33038650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.129 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c33038b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c3303fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32e6b0c0 con 0x555c33030950 2022-09-07T19:44:10.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c33040110 con 0x555c33030000 2022-09-07T19:44:10.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c330402a0 con 0x555c3302f1c0 2022-09-07T19:44:10.130 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03c864cb80 10 client.0 _ll_register_callbacks cb 0x555c32f28370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:44:10.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c3303fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c3303fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58050/0 (socket says 172.21.15.80:58050) 2022-09-07T19:44:10.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03aed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c33038650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.131 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 -- 172.21.15.80:0/379849706 learned_addr learned my addr 172.21.15.80:0/379849706 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:10.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03ae59c700 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c33038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 -- 172.21.15.80:0/379849706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 msgr2=0x555c33038650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c33038650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 -- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 msgr2=0x555c33038b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.132 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c33038b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.115+0000 7f03af59e700 1 -- 172.21.15.80:0/379849706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b019dde0 con 0x555c33030950 2022-09-07T19:44:10.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f03af59e700 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c3303fbd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03a8000f80 tx=0x7f03a800fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a60327919a48965 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:10.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f038eff5700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2022-09-07T19:44:10.133 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f038eff5700 1 -- 172.21.15.80:0/379849706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8021070 con 0x555c33030950 2022-09-07T19:44:10.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f038eff5700 1 -- 172.21.15.80:0/379849706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f03a8015070 con 0x555c33030950 2022-09-07T19:44:10.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c33021cf0 con 0x555c33030950 2022-09-07T19:44:10.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f038eff5700 1 -- 172.21.15.80:0/379849706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a8011440 con 0x555c33030950 2022-09-07T19:44:10.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f03c864cb80 10 client.15213 fetch_fsmap learned FSMap version 24 2022-09-07T19:44:10.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.116+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f03a8009a40 con 0x555c33030950 2022-09-07T19:44:10.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f038eff5700 1 -- 172.21.15.80:0/379849706 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x555c33021cf0 con 0x555c33030950 2022-09-07T19:44:10.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f038eff5700 1 -- 172.21.15.80:0/379849706 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f03a800c070 con 0x555c33030950 2022-09-07T19:44:10.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f03c864cb80 10 client.15213 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:44:10.135 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f03c864cb80 10 client.15213 resolve_mds: resolved name 'b' to daemon mds.b 2022-09-07T19:44:10.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f03c864cb80 20 client.15213 populate_metadata read hostname 'smithi080' 2022-09-07T19:44:10.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f03c864cb80 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c330438a0 0x555c33048b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.136 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f03c864cb80 4 client.15213 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-07T19:44:10.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.117+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 --> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c32ffe4c0 con 0x555c330438a0 2022-09-07T19:44:10.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.118+0000 7f03aed9d700 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c330438a0 0x555c33048b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.118+0000 7f03aed9d700 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c330438a0 0x555c33048b80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed67a2e0a87395b server_cookie=9eca9d0e14f2401e in_seq=0 out_seq=0 2022-09-07T19:44:10.137 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.118+0000 7f038eff5700 10 client.15213 ms_handle_connect on v2:172.21.15.154:6838/545932828 2022-09-07T19:44:10.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f038eff5700 1 -- 172.21.15.80:0/379849706 <== mds.0 v2:172.21.15.154:6838/545932828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17402 (crc 0 0 0) 0x555c32ffe4c0 con 0x555c330438a0 2022-09-07T19:44:10.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f038eff5700 10 client.15213 handle_command_reply: tid=0 2022-09-07T19:44:10.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 client.15213 shutdown 2022-09-07T19:44:10.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 msgr2=0x555c3303fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c3303fbd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03a8000f80 tx=0x7f03a800fe40 comp rx=0 tx=0).stop 2022-09-07T19:44:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 shutdown_connections 2022-09-07T19:44:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c330438a0 0x555c33048b80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c3303fbd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c33038650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 --2- 172.21.15.80:0/379849706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c33038b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f038eff5700 0 client.15213 ms_handle_reset on v2:172.21.15.154:6838/545932828 2022-09-07T19:44:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.119+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 >> 172.21.15.80:0/379849706 conn(0x555c3302b170 msgr2=0x555c33028c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.120+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 shutdown_connections 2022-09-07T19:44:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.120+0000 7f03c864cb80 1 -- 172.21.15.80:0/379849706 wait complete. 2022-09-07T19:44:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.120+0000 7f03c864cb80 20 client.15213 trim_cache size 0 max 16384 2022-09-07T19:44:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.137+0000 7f03c864cb80 1 Processor -- start 2022-09-07T19:44:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.137+0000 7f03c864cb80 1 -- start start 2022-09-07T19:44:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3304cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33033040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c33038400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03c864cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32f41080 con 0x555c33030000 2022-09-07T19:44:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03c864cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32f1f520 con 0x555c3302f1c0 2022-09-07T19:44:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03c864cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c32f49690 con 0x555c33030950 2022-09-07T19:44:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33033040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33033040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58064/0 (socket says 172.21.15.80:58064) 2022-09-07T19:44:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 -- 172.21.15.80:0/1167943677 learned_addr learned my addr 172.21.15.80:0/1167943677 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03aed9d700 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3304cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03af59e700 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c33038400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 -- 172.21.15.80:0/1167943677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 msgr2=0x555c33038400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c33038400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 -- 172.21.15.80:0/1167943677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 msgr2=0x555c3304cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3304cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.138+0000 7f03ae59c700 1 -- 172.21.15.80:0/1167943677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c32db1d90 con 0x555c33030000 2022-09-07T19:44:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.139+0000 7f03aed9d700 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3304cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.139+0000 7f03ae59c700 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33033040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03a4005ee0 tx=0x7f03a408f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4361ec7716508b1d server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.139+0000 7f0391ffb700 1 -- 172.21.15.80:0/1167943677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4093580 con 0x555c33030000 2022-09-07T19:44:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.139+0000 7f0391ffb700 1 -- 172.21.15.80:0/1167943677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f03a409a820 con 0x555c33030000 2022-09-07T19:44:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.139+0000 7f0391ffb700 1 -- 172.21.15.80:0/1167943677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40c3210 con 0x555c33030000 2022-09-07T19:44:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 -- 172.21.15.80:0/1167943677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 msgr2=0x555c33033040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33033040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03a4005ee0 tx=0x7f03a408f2c0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 -- 172.21.15.80:0/1167943677 shutdown_connections 2022-09-07T19:44:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c33030950 0x555c33038400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c3302f1c0 0x555c3304cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 --2- 172.21.15.80:0/1167943677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030000 0x555c33033040 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 -- 172.21.15.80:0/1167943677 >> 172.21.15.80:0/1167943677 conn(0x555c3302b170 msgr2=0x555c33040680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 -- 172.21.15.80:0/1167943677 shutdown_connections 2022-09-07T19:44:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 -- 172.21.15.80:0/1167943677 wait complete. 2022-09-07T19:44:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 -- start start 2022-09-07T19:44:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.140+0000 7f03c864cb80 1 Processor -- start 2022-09-07T19:44:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c3303c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c3303ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c33095b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3303d2a0 con 0x555c33030950 2022-09-07T19:44:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3303d410 con 0x555c33030000 2022-09-07T19:44:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c330960e0 con 0x555c3302f1c0 2022-09-07T19:44:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03c864cb80 10 client.0 _ll_register_callbacks cb 0x555c32f28370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-07T19:44:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03ae59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c3303ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03aed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c3303c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03ae59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c3303ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:46078/0 (socket says 172.21.15.80:46078) 2022-09-07T19:44:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.141+0000 7f03ae59c700 1 -- 172.21.15.80:0/3981490894 learned_addr learned my addr 172.21.15.80:0/3981490894 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03af59e700 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c33095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03ae59c700 1 -- 172.21.15.80:0/3981490894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 msgr2=0x555c3303c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03ae59c700 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c3303c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03ae59c700 1 -- 172.21.15.80:0/3981490894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 msgr2=0x555c33095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-07T19:44:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03ae59c700 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c33095b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03ae59c700 1 -- 172.21.15.80:0/3981490894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a0017070 con 0x555c33030000 2022-09-07T19:44:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03ae59c700 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c3303ca80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03a408fa80 tx=0x7f03a4093d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d76d004d0cb1052 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f038eff5700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2022-09-07T19:44:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f038eff5700 1 -- 172.21.15.80:0/3981490894 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40c3210 con 0x555c33030000 2022-09-07T19:44:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03a80118e0 con 0x555c33030000 2022-09-07T19:44:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f038eff5700 1 -- 172.21.15.80:0/3981490894 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f03a40c2040 con 0x555c33030000 2022-09-07T19:44:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f038eff5700 1 -- 172.21.15.80:0/3981490894 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a40c3370 con 0x555c33030000 2022-09-07T19:44:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03c864cb80 10 client.25307 fetch_fsmap learned FSMap version 24 2022-09-07T19:44:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.142+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f03a40093b0 con 0x555c33030000 2022-09-07T19:44:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f038eff5700 1 -- 172.21.15.80:0/3981490894 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f03a80118e0 con 0x555c33030000 2022-09-07T19:44:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f038eff5700 1 -- 172.21.15.80:0/3981490894 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 24) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f03a4092a70 con 0x555c33030000 2022-09-07T19:44:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03c864cb80 10 client.25307 fetch_fsmap finished waiting for FSMap version 24 2022-09-07T19:44:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03c864cb80 10 client.25307 resolve_mds: resolved name 'b' to daemon mds.b 2022-09-07T19:44:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03c864cb80 20 client.25307 populate_metadata read hostname 'smithi080' 2022-09-07T19:44:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03c864cb80 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c3309aad0 0x555c33097460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:10.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03c864cb80 4 client.25307 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2022-09-07T19:44:10.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 --> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555c32f766f0 con 0x555c3309aad0 2022-09-07T19:44:10.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.143+0000 7f03aed9d700 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c3309aad0 0x555c33097460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:10.163 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.144+0000 7f03aed9d700 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c3309aad0 0x555c33097460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41950b75b9f3ba55 server_cookie=bb210e2501cdd2d5 in_seq=0 out_seq=0 2022-09-07T19:44:10.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.144+0000 7f038eff5700 10 client.25307 ms_handle_connect on v2:172.21.15.154:6838/545932828 2022-09-07T19:44:10.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.144+0000 7f038eff5700 1 -- 172.21.15.80:0/3981490894 <== mds.0 v2:172.21.15.154:6838/545932828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555c32f766f0 con 0x555c3309aad0 2022-09-07T19:44:10.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.144+0000 7f038eff5700 10 client.25307 handle_command_reply: tid=0 2022-09-07T19:44:10.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.144+0000 7f03c864cb80 1 client.25307 shutdown 2022-09-07T19:44:10.164 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 msgr2=0x555c3303ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c3303ca80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03a408fa80 tx=0x7f03a4093d40 comp rx=0 tx=0).stop 2022-09-07T19:44:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 shutdown_connections 2022-09-07T19:44:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:6838/545932828,v1:172.21.15.154:6839/545932828] conn(0x555c3309aad0 0x555c33097460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c33030950 0x555c33095b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555c3302f1c0 0x555c3303c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 --2- 172.21.15.80:0/3981490894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c33030000 0x555c3303ca80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f038eff5700 0 client.25307 ms_handle_reset on v2:172.21.15.154:6838/545932828 2022-09-07T19:44:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 >> 172.21.15.80:0/3981490894 conn(0x555c3302b170 msgr2=0x555c33040680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 shutdown_connections 2022-09-07T19:44:10.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 1 -- 172.21.15.80:0/3981490894 wait complete. 2022-09-07T19:44:10.167 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.145+0000 7f03c864cb80 20 client.25307 trim_cache size 0 max 16384 2022-09-07T19:44:10.167 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2022-09-07T19:44:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "cc599a0c-2ee3-11ed-8431-001a4aab830c", 2022-09-07T19:44:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2022-09-07T19:44:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24575, 2022-09-07T19:44:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2022-09-07T19:44:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2022-09-07T19:44:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2022-09-07T19:44:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 123.224628301, 2022-09-07T19:44:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 24, 2022-09-07T19:44:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 93, 2022-09-07T19:44:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2022-09-07T19:44:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 130.81884087899999 2022-09-07T19:44:10.170 INFO:teuthology.orchestra.run.smithi080.stdout:} 2022-09-07T19:44:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0398099090 msgr2=0x7f039809b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0398099090 0x7f039809b540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009440 tx=0x7f03a0005f60 comp rx=0 tx=0).stop 2022-09-07T19:44:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 msgr2=0x7f03b0195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b0195f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f03a4004230 tx=0x7f03a4004260 comp rx=0 tx=0).stop 2022-09-07T19:44:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 shutdown_connections 2022-09-07T19:44:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f0398099090 0x7f039809b540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b00ff510 0x7f03b019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03b00fdb40 0x7f03b01959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 --2- 172.21.15.80:0/136706060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b00fe490 0x7f03b0195f20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 >> 172.21.15.80:0/136706060 conn(0x7f03b00f9230 msgr2=0x7f03b0104870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 shutdown_connections 2022-09-07T19:44:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:10.146+0000 7f03b49fe700 1 -- 172.21.15.80:0/136706060 wait complete. 2022-09-07T19:44:10.175 INFO:teuthology.run_tasks:Running task kclient... 2022-09-07T19:44:10.197 INFO:tasks.kclient:Mounting kernel clients... 2022-09-07T19:44:10.199 INFO:tasks.kclient:config is {'client.0': {}} 2022-09-07T19:44:10.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:10.200 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2022-09-07T19:44:10.259 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2022-09-07T19:44:10.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:10.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-09-07T19:44:10.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:10.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2022-09-07T19:44:10.482 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2022-09-07T19:44:10.483 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2022-09-07T19:44:10.484 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:10.484 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:152194198413033811b31149de909a7ec5852a7f shell --fsid cc599a0c-2ee3-11ed-8431-001a4aab830c -- ceph fs ls 2022-09-07T19:44:11.367 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/mon.a/config 2022-09-07T19:44:11.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:11 smithi080 ceph-mon[90124]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:44:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:11 smithi154 ceph-mon[96967]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:44:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:11 smithi155 ceph-mon[97606]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2022-09-07T19:44:12.886 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 -- 172.21.15.80:0/3989347207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c10a740 msgr2=0x7f5e5c10cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:12.886 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 --2- 172.21.15.80:0/3989347207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c10a740 0x7f5e5c10cb20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009bb0 tx=0x7f5e54009ec0 comp rx=0 tx=0).stop 2022-09-07T19:44:12.887 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 -- 172.21.15.80:0/3989347207 shutdown_connections 2022-09-07T19:44:12.887 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 --2- 172.21.15.80:0/3989347207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c071080 0x7f5e5c071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:12.887 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 --2- 172.21.15.80:0/3989347207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c10a740 0x7f5e5c10cb20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:12.887 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 --2- 172.21.15.80:0/3989347207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071990 0x7f5e5c10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:12.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 -- 172.21.15.80:0/3989347207 >> 172.21.15.80:0/3989347207 conn(0x7f5e5c0f9a20 msgr2=0x7f5e5c0fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:12.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 -- 172.21.15.80:0/3989347207 shutdown_connections 2022-09-07T19:44:12.888 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.886+0000 7f5e62139700 1 -- 172.21.15.80:0/3989347207 wait complete. 2022-09-07T19:44:12.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.887+0000 7f5e62139700 1 Processor -- start 2022-09-07T19:44:12.890 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.887+0000 7f5e62139700 1 -- start start 2022-09-07T19:44:12.891 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e62139700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 0x7f5e5c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:12.891 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e62139700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c071990 0x7f5e5c196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:12.891 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e62139700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c10a740 0x7f5e5c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:12.891 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e62139700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c19ae70 con 0x7f5e5c10a740 2022-09-07T19:44:12.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e62139700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c19afe0 con 0x7f5e5c071080 2022-09-07T19:44:12.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e62139700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c19b1a0 con 0x7f5e5c071990 2022-09-07T19:44:12.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e5b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 0x7f5e5c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:12.892 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e5b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 0x7f5e5c195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:33060/0 (socket says 172.21.15.80:33060) 2022-09-07T19:44:12.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e5b7fe700 1 -- 172.21.15.80:0/770970439 learned_addr learned my addr 172.21.15.80:0/770970439 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:12.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e5bfff700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c10a740 0x7f5e5c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:12.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.888+0000 7f5e5affd700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c071990 0x7f5e5c196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:12.893 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5b7fe700 1 -- 172.21.15.80:0/770970439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c071990 msgr2=0x7f5e5c196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5b7fe700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c071990 0x7f5e5c196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5b7fe700 1 -- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c10a740 msgr2=0x7f5e5c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5b7fe700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c10a740 0x7f5e5c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5b7fe700 1 -- 172.21.15.80:0/770970439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e500093b0 con 0x7f5e5c071080 2022-09-07T19:44:12.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5bfff700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c10a740 0x7f5e5c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:12.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e5b7fe700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 0x7f5e5c195e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00e740 tx=0x7f5e4c00ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:12.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.889+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c005220 con 0x7f5e5c071080 2022-09-07T19:44:12.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.890+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f5e4c005380 con 0x7f5e5c071080 2022-09-07T19:44:12.895 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.890+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c004b70 con 0x7f5e5c071080 2022-09-07T19:44:12.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.890+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e540097e0 con 0x7f5e5c071080 2022-09-07T19:44:12.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.890+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c1a2a90 con 0x7f5e5c071080 2022-09-07T19:44:12.896 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.891+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c064ea0 con 0x7f5e5c071080 2022-09-07T19:44:12.897 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.893+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7f5e4c01e020 con 0x7f5e5c071080 2022-09-07T19:44:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.894+0000 7f5e58ff9700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5e44099090 0x7f5e4409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.894+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f5e4c014070 con 0x7f5e5c071080 2022-09-07T19:44:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.894+0000 7f5e5affd700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5e44099090 0x7f5e4409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.895+0000 7f5e5affd700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5e44099090 0x7f5e4409b540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c197450 tx=0x7f5e50005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:12.896+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f5e4c08eeb0 con 0x7f5e5c071080 2022-09-07T19:44:13.151 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.152+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e5c10fe70 con 0x7f5e5c071080 2022-09-07T19:44:13.152 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.152+0000 7f5e58ff9700 1 -- 172.21.15.80:0/770970439 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5e4c0924d0 con 0x7f5e5c071080 2022-09-07T19:44:13.152 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2022-09-07T19:44:13.155 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5e44099090 msgr2=0x7f5e4409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:13.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5e44099090 0x7f5e4409b540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c197450 tx=0x7f5e50005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:13.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 msgr2=0x7f5e5c195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:13.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 0x7f5e5c195e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00e740 tx=0x7f5e4c00ea50 comp rx=0 tx=0).stop 2022-09-07T19:44:13.156 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 shutdown_connections 2022-09-07T19:44:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e5c10a740 0x7f5e5c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f5e44099090 0x7f5e4409b540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e5c071080 0x7f5e5c195e40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 --2- 172.21.15.80:0/770970439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e5c071990 0x7f5e5c196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.155+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 >> 172.21.15.80:0/770970439 conn(0x7f5e5c0f9a20 msgr2=0x7f5e5c10c950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.156+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 shutdown_connections 2022-09-07T19:44:13.158 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:13.156+0000 7f5e62139700 1 -- 172.21.15.80:0/770970439 wait complete. 2022-09-07T19:44:13.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:13 smithi080 ceph-mon[90124]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:13.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:13 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/770970439' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-09-07T19:44:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:13 smithi154 ceph-mon[96967]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:13 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/770970439' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-09-07T19:44:13.643 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-09-07T19:44:13.644 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-09-07T19:44:13.644 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2022-09-07T19:44:13.645 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-09-07T19:44:13.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:13.645 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-09-07T19:44:13.647 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-09-07T19:44:13.647 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-09-07T19:44:13.648 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-09-07T19:44:13.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:13.649 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2022-09-07T19:44:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:13 smithi155 ceph-mon[97606]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2022-09-07T19:44:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:13 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/770970439' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-09-07T19:44:13.710 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-09-07T19:44:13.710 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-09-07T19:44:13.710 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2022-09-07T19:44:13.711 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2022-09-07T19:44:13.711 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2022-09-07T19:44:13.711 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2022-09-07T19:44:13.711 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-07T19:44:13.711 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:44:13.712 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2022-09-07T19:44:13.712 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-07T19:44:13.712 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:44:13.713 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2022-09-07T19:44:13.713 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-07T19:44:13.713 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:44:13.714 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-09-07T19:44:13.714 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2022-09-07T19:44:13.714 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-09-07T19:44:13.714 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 41548sec preferred_lft 41548sec 2022-09-07T19:44:13.715 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2022-09-07T19:44:13.715 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2022-09-07T19:44:13.716 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-09-07T19:44:13.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:13.717 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:44:13.718 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:44:13.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2022-09-07T19:44:13.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2022-09-07T19:44:13.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2022-09-07T19:44:13.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-09-07T19:44:13.719 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:44:13.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:13.981 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-09-07T19:44:14.070 INFO:teuthology.orchestra.run.smithi080.stdout:1 2022-09-07T19:44:14.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.076 DEBUG:teuthology.orchestra.run.smithi080:> route 2022-09-07T19:44:14.139 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2022-09-07T19:44:14.139 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-09-07T19:44:14.139 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-09-07T19:44:14.140 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-09-07T19:44:14.140 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-09-07T19:44:14.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.142 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:44:14.142 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:44:14.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-09-07T19:44:14.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-09-07T19:44:14.144 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-09-07T19:44:14.144 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:44:14.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.363 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2022-09-07T19:44:14.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.425 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2022-09-07T19:44:14.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.486 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:44:14.486 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:44:14.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-09-07T19:44:14.488 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-09-07T19:44:14.488 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:44:14.671 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-09-07T19:44:14.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.672 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:44:14.673 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:44:14.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-09-07T19:44:14.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-09-07T19:44:14.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-09-07T19:44:14.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-09-07T19:44:14.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-09-07T19:44:14.675 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:44:14.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:14.988 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2022-09-07T19:44:14.989 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2022-09-07T19:44:14.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2022-09-07T19:44:14.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2022-09-07T19:44:14.990 DEBUG:teuthology.orchestra.run.smithi080:> ') 2022-09-07T19:44:15.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-09-07T19:44:15.208 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:15.267 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-09-07T19:44:15.268 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-09-07T19:44:15.268 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:15.327 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/e1cc8319-35ea-431f-9b58-9e68f9f6d67a 2022-09-07T19:44:15.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:15.328 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/e1cc8319-35ea-431f-9b58-9e68f9f6d67a /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2022-09-07T19:44:15.457 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2022-09-07T19:44:15.458 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2022-09-07T19:44:15.458 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2022-09-07T19:44:15.552 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:15 smithi080 ceph-mon[90124]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:15 smithi154 ceph-mon[96967]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:15 smithi155 ceph-mon[97606]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:15.974 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2022-09-07T19:44:15.975 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2022-09-07T19:44:15.975 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2022-09-07T19:44:15.975 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.154:3300,172.21.15.155:3300" 2022-09-07T19:44:15.976 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.80:3300,172.21.15.154:3300,172.21.15.155:3300:/volumes/_nogroup/sv_1/e1cc8319-35ea-431f-9b58-9e68f9f6d67a 2022-09-07T19:44:15.976 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=cc599a0c-2ee3-11ed-8431-001a4aab830c" will pass to kernel 2022-09-07T19:44:15.977 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-09-07T19:44:15.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:15.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:16.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:16.071 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2022-09-07T19:44:16.187 INFO:teuthology.orchestra.run.smithi080.stdout:client25300 2022-09-07T19:44:16.188 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:44:16.188 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2022-09-07T19:44:16.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:16.250 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2022-09-07T19:44:16.366 INFO:teuthology.orchestra.run.smithi080.stdout:client25300 2022-09-07T19:44:16.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:16.367 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2022-09-07T19:44:16.483 INFO:teuthology.orchestra.run.smithi080.stdout:client25300 2022-09-07T19:44:16.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-07T19:44:16.484 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c.client25300/status') 2022-09-07T19:44:16.623 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.25300 (3)172.21.15.80:0/71549459 2022-09-07T19:44:16.624 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2022-09-07T19:44:16.624 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2022-09-07T19:44:16.624 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2022-09-07T19:44:16.625 INFO:teuthology.orchestra.run.smithi080.stderr:69 bytes copied, 8.8022e-05 s, 784 kB/s 2022-09-07T19:44:16.628 INFO:teuthology.run_tasks:Running task check-counter... 2022-09-07T19:44:16.641 INFO:teuthology.run_tasks:Running task exec... 2022-09-07T19:44:16.692 INFO:teuthology.task.exec:Executing custom commands... 2022-09-07T19:44:16.693 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:44:16.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2022-09-07T19:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 -- 172.21.15.80:0/1757944901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb210066e80 msgr2=0x7fb210100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 --2- 172.21.15.80:0/1757944901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb210066e80 0x7fb210100790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb200009810 tx=0x7fb200009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 -- 172.21.15.80:0/1757944901 shutdown_connections 2022-09-07T19:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 --2- 172.21.15.80:0/1757944901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2101037c0 0x7fb210105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 --2- 172.21.15.80:0/1757944901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb210066e80 0x7fb210100790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 --2- 172.21.15.80:0/1757944901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:16.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 -- 172.21.15.80:0/1757944901 >> 172.21.15.80:0/1757944901 conn(0x7fb2100f8180 msgr2=0x7fb2100fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:16.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 -- 172.21.15.80:0/1757944901 shutdown_connections 2022-09-07T19:44:16.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.915+0000 7fb2149fe700 1 -- 172.21.15.80:0/1757944901 wait complete. 2022-09-07T19:44:16.921 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 Processor -- start 2022-09-07T19:44:16.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 -- start start 2022-09-07T19:44:16.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 0x7fb210195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:16.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:16.922 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2101037c0 0x7fb21019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:16.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21019d490 con 0x7fb210066e80 2022-09-07T19:44:16.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21019d600 con 0x7fb2101037c0 2022-09-07T19:44:16.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.917+0000 7fb2149fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21019d7c0 con 0x7fb210100cd0 2022-09-07T19:44:16.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 0x7fb210195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:16.923 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:16.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 0x7fb210195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36348/0 (socket says 172.21.15.80:36348) 2022-09-07T19:44:16.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20ed9d700 1 -- 172.21.15.80:0/779632874 learned_addr learned my addr 172.21.15.80:0/779632874 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:16.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:50260/0 (socket says 172.21.15.80:50260) 2022-09-07T19:44:16.924 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20f59e700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2101037c0 0x7fb21019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:16.925 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 -- 172.21.15.80:0/779632874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2101037c0 msgr2=0x7fb21019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:16.925 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2101037c0 0x7fb21019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:16.925 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 -- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 msgr2=0x7fb210195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:16.925 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 0x7fb210195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:16.926 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 -- 172.21.15.80:0/779632874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200009470 con 0x7fb210100cd0 2022-09-07T19:44:16.926 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20ed9d700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 0x7fb210195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:16.926 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.918+0000 7fb20e59c700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210195e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb20400e6c0 tx=0x7fb20400e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:16.927 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.919+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204010900 con 0x7fb210100cd0 2022-09-07T19:44:16.927 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.919+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21019daa0 con 0x7fb210100cd0 2022-09-07T19:44:16.927 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.919+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fb204018420 con 0x7fb210100cd0 2022-09-07T19:44:16.928 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.919+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204017610 con 0x7fb210100cd0 2022-09-07T19:44:16.928 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.919+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21019e000 con 0x7fb210100cd0 2022-09-07T19:44:16.928 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.920+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb210109340 con 0x7fb210100cd0 2022-09-07T19:44:16.929 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.922+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 127678+0+0 (secure 0 0 0) 0x7fb20400c040 con 0x7fb210100cd0 2022-09-07T19:44:16.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.923+0000 7fb1f7fff700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb1f80990c0 0x7fb1f809b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:16.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.923+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fb204014070 con 0x7fb210100cd0 2022-09-07T19:44:16.930 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.924+0000 7fb20ed9d700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb1f80990c0 0x7fb1f809b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:16.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.924+0000 7fb20ed9d700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb1f80990c0 0x7fb1f809b570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb20000b4f0 tx=0x7fb200009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:16.931 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:16.925+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fb20408ead0 con 0x7fb210100cd0 2022-09-07T19:44:17.166 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.167+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb21019ea50 con 0x7fb210100cd0 2022-09-07T19:44:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.341+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 19) v1 ==== 127695+0+0 (secure 0 0 0) 0x7fb2040188e0 con 0x7fb210100cd0 2022-09-07T19:44:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.342+0000 7fb1f7fff700 1 -- 172.21.15.80:0/779632874 <== mon.1 v2:172.21.15.155:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb204092560 con 0x7fb210100cd0 2022-09-07T19:44:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb1f80990c0 msgr2=0x7fb1f809b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb1f80990c0 0x7fb1f809b570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb20000b4f0 tx=0x7fb200009e70 comp rx=0 tx=0).stop 2022-09-07T19:44:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 msgr2=0x7fb210195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210195e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb20400e6c0 tx=0x7fb20400e9d0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 shutdown_connections 2022-09-07T19:44:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb210066e80 0x7fb210195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fb1f80990c0 0x7fb1f809b570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2101037c0 0x7fb21019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 --2- 172.21.15.80:0/779632874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb210100cd0 0x7fb210195e50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 >> 172.21.15.80:0/779632874 conn(0x7fb2100f8180 msgr2=0x7fb2100fa560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 shutdown_connections 2022-09-07T19:44:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.345+0000 7fb2149fe700 1 -- 172.21.15.80:0/779632874 wait complete. 2022-09-07T19:44:17.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2022-09-07T19:44:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 -- 172.21.15.80:0/618428938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 msgr2=0x7f229c071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 --2- 172.21.15.80:0/618428938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c071bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f228c009750 tx=0x7f228c009a60 comp rx=0 tx=0).stop 2022-09-07T19:44:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 -- 172.21.15.80:0/618428938 shutdown_connections 2022-09-07T19:44:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 --2- 172.21.15.80:0/618428938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c10c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 --2- 172.21.15.80:0/618428938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 0x7f229c071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 --2- 172.21.15.80:0/618428938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c071bb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 -- 172.21.15.80:0/618428938 >> 172.21.15.80:0/618428938 conn(0x7f229c0f9480 msgr2=0x7f229c0fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 -- 172.21.15.80:0/618428938 shutdown_connections 2022-09-07T19:44:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.616+0000 7f22a3dff700 1 -- 172.21.15.80:0/618428938 wait complete. 2022-09-07T19:44:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.618+0000 7f22a3dff700 1 Processor -- start 2022-09-07T19:44:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.618+0000 7f22a3dff700 1 -- start start 2022-09-07T19:44:17.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-mon[90124]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:44:17.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-mon[90124]: from='client.? 172.21.15.80:0/779632874' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2022-09-07T19:44:17.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2022-09-07T19:44:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.618+0000 7f22a3dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a3dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 0x7f229c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a3dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a3dff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1a1b40 con 0x7f229c071740 2022-09-07T19:44:17.623 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: ignoring --setuser ceph since I am not root 2022-09-07T19:44:17.623 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: ignoring --setgroup ceph since I am not root 2022-09-07T19:44:17.623 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-mgr[90392]: -- 172.21.15.80:0/1773701999 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559954754820 con 0x559954728800 2022-09-07T19:44:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a3dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1a1cb0 con 0x7f229c072c90 2022-09-07T19:44:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a3dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1a1e70 con 0x7f229c10a430 2022-09-07T19:44:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a139a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 0x7f229c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a239c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a139a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 0x7f229c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:33116/0 (socket says 172.21.15.80:33116) 2022-09-07T19:44:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a139a700 1 -- 172.21.15.80:0/2521565895 learned_addr learned my addr 172.21.15.80:0/2521565895 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a239c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c1a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:50294/0 (socket says 172.21.15.80:50294) 2022-09-07T19:44:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.619+0000 7f22a1b9b700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:17.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a239c700 1 -- 172.21.15.80:0/2521565895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 msgr2=0x7f229c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:17.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a239c700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 0x7f229c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a239c700 1 -- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 msgr2=0x7f229c199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:17.628 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a239c700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a239c700 1 -- 172.21.15.80:0/2521565895 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298009470 con 0x7f229c10a430 2022-09-07T19:44:17.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a1b9b700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-07T19:44:17.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a239c700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c1a1570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f229c072a40 tx=0x7f229400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:17.629 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294004c30 con 0x7f229c10a430 2022-09-07T19:44:17.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f229400ce10 con 0x7f229c10a430 2022-09-07T19:44:17.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c0093b0 con 0x7f229c10a430 2022-09-07T19:44:17.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294004280 con 0x7f229c10a430 2022-09-07T19:44:17.630 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.620+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c1a2480 con 0x7f229c10a430 2022-09-07T19:44:17.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.622+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c10fb90 con 0x7f229c10a430 2022-09-07T19:44:17.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.623+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 127695+0+0 (secure 0 0 0) 0x7f229400c040 con 0x7f229c10a430 2022-09-07T19:44:17.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.625+0000 7f2292ffd700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 0x7f228809b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:17.631 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.625+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f2294014070 con 0x7f229c10a430 2022-09-07T19:44:17.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.625+0000 7f22a1b9b700 1 -- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 msgr2=0x7f228809b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:17.632 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.625+0000 7f22a1b9b700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 0x7f228809b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:44:17.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-mon[96967]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:44:17.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-mon[96967]: from='client.? 172.21.15.80:0/779632874' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2022-09-07T19:44:17.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2022-09-07T19:44:17.634 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: ignoring --setuser ceph since I am not root 2022-09-07T19:44:17.634 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: ignoring --setgroup ceph since I am not root 2022-09-07T19:44:17.635 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-mgr[98337]: -- 172.21.15.154:0/1898993572 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56158889c820 con 0x561588871000 2022-09-07T19:44:17.635 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:17.492+0000 7ff0602c4080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:44:17.635 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:17.582+0000 7ff0602c4080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:44:17.635 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.629+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f229408ed70 con 0x7f229c10a430 2022-09-07T19:44:17.678 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-mon[97606]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2022-09-07T19:44:17.678 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-mon[97606]: from='client.? 172.21.15.80:0/779632874' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2022-09-07T19:44:17.678 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2022-09-07T19:44:17.679 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: ignoring --setuser ceph since I am not root 2022-09-07T19:44:17.679 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: ignoring --setgroup ceph since I am not root 2022-09-07T19:44:17.679 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-mgr[99616]: -- 172.21.15.155:0/3069350577 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5635f9c68820 con 0x5635f9c3cc00 2022-09-07T19:44:17.680 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:17.496+0000 7f863e6e7080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:44:17.680 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:17.590+0000 7f863e6e7080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:44:17.680 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:17.677+0000 7f863e6e7080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:44:17.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.826+0000 7f22a1b9b700 1 -- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 msgr2=0x7f228809b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:17.825 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.826+0000 7f22a1b9b700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 0x7f228809b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:44:17.828 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.829+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f229c05f990 con 0x7f229c10a430 2022-09-07T19:44:17.833 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.834+0000 7f2292ffd700 1 -- 172.21.15.80:0/2521565895 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f229401c0d0 con 0x7f229c10a430 2022-09-07T19:44:17.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 msgr2=0x7f228809b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:44:17.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 0x7f228809b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 msgr2=0x7f229c1a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:17.837 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c1a1570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f229c072a40 tx=0x7f229400ed60 comp rx=0 tx=0).stop 2022-09-07T19:44:17.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 shutdown_connections 2022-09-07T19:44:17.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f229c071740 0x7f229c199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.838 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f2288099060 0x7f228809b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f229c10a430 0x7f229c1a1570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 --2- 172.21.15.80:0/2521565895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f229c072c90 0x7f229c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:17.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.837+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 >> 172.21.15.80:0/2521565895 conn(0x7f229c0f9480 msgr2=0x7f229c0fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:17.839 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.838+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 shutdown_connections 2022-09-07T19:44:17.840 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:17.838+0000 7f22a3dff700 1 -- 172.21.15.80:0/2521565895 wait complete. 2022-09-07T19:44:17.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2022-09-07T19:44:17.929 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:17.671+0000 7ff0602c4080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:44:17.929 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:17.764+0000 7ff0602c4080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:44:17.933 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:17.770+0000 7f863e6e7080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:44:17.991 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:17.739+0000 7f3fbf943080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-07T19:44:17.992 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:17.853+0000 7f3fbf943080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-07T19:44:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.094+0000 7f928e59d700 1 -- 172.21.15.80:0/1634425317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 msgr2=0x7f92880fe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.094+0000 7f928e59d700 1 --2- 172.21.15.80:0/1634425317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 0x7f92880fe580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9284009750 tx=0x7f9284009a60 comp rx=0 tx=0).stop 2022-09-07T19:44:18.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 -- 172.21.15.80:0/1634425317 shutdown_connections 2022-09-07T19:44:18.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 --2- 172.21.15.80:0/1634425317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 0x7f92880fe580 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 --2- 172.21.15.80:0/1634425317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92881015b0 0x7f9288101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.095 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 --2- 172.21.15.80:0/1634425317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f9288100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 -- 172.21.15.80:0/1634425317 >> 172.21.15.80:0/1634425317 conn(0x7f92880f8180 msgr2=0x7f92880fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:18.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 -- 172.21.15.80:0/1634425317 shutdown_connections 2022-09-07T19:44:18.096 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.095+0000 7f928e59d700 1 -- 172.21.15.80:0/1634425317 wait complete. 2022-09-07T19:44:18.098 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.096+0000 7f928e59d700 1 Processor -- start 2022-09-07T19:44:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.096+0000 7f928e59d700 1 -- start start 2022-09-07T19:44:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.096+0000 7f928e59d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 0x7f9288199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.099 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928e59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f928819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928e59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92881015b0 0x7f92881a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928e59d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92881a1940 con 0x7f9288066e80 2022-09-07T19:44:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928e59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92881a1ab0 con 0x7f92881015b0 2022-09-07T19:44:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928e59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92881a1c70 con 0x7f92880feac0 2022-09-07T19:44:18.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f928819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:18.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f928819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:50312/0 (socket says 172.21.15.80:50312) 2022-09-07T19:44:18.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 -- 172.21.15.80:0/1498933956 learned_addr learned my addr 172.21.15.80:0/1498933956 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:18.101 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928d59b700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 0x7f9288199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:18.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928dd9c700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92881015b0 0x7f92881a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:18.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 -- 172.21.15.80:0/1498933956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92881015b0 msgr2=0x7f92881a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.102 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92881015b0 0x7f92881a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 -- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 msgr2=0x7f9288199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 0x7f9288199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.097+0000 7f928cd9a700 1 -- 172.21.15.80:0/1498933956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278009470 con 0x7f92880feac0 2022-09-07T19:44:18.103 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.098+0000 7f928cd9a700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f928819a300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f927800e9c0 tx=0x7f927800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.098+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278004220 con 0x7f92880feac0 2022-09-07T19:44:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.098+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92840093b0 con 0x7f92880feac0 2022-09-07T19:44:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.098+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f9278004380 con 0x7f92880feac0 2022-09-07T19:44:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.098+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278003c50 con 0x7f92880feac0 2022-09-07T19:44:18.104 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.098+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92881a2250 con 0x7f92880feac0 2022-09-07T19:44:18.105 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.099+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928810f9a0 con 0x7f92880feac0 2022-09-07T19:44:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.101+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 127695+0+0 (secure 0 0 0) 0x7f927801e020 con 0x7f92880feac0 2022-09-07T19:44:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.102+0000 7f927e7fc700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 0x7f927409b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.106 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.102+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7f9278014070 con 0x7f92880feac0 2022-09-07T19:44:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.102+0000 7f928d59b700 1 -- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 msgr2=0x7f927409b640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.102+0000 7f928d59b700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 0x7f927409b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:44:18.107 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.106+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f927808ed00 con 0x7f92880feac0 2022-09-07T19:44:18.197 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:17 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:17.935+0000 7f863e6e7080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:44:18.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.303+0000 7f928d59b700 1 -- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 msgr2=0x7f927409b640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:18.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.303+0000 7f928d59b700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 0x7f927409b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:44:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.304+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f928805fa00 con 0x7f92880feac0 2022-09-07T19:44:18.310 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.309+0000 7f927e7fc700 1 -- 172.21.15.80:0/1498933956 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9278092320 con 0x7f92880feac0 2022-09-07T19:44:18.312 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 msgr2=0x7f927409b640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:44:18.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 0x7f927409b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 msgr2=0x7f928819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f928819a300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f927800e9c0 tx=0x7f927800ecd0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.313 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 shutdown_connections 2022-09-07T19:44:18.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9288066e80 0x7f9288199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7f9274099190 0x7f927409b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92881015b0 0x7f92881a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.314 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 --2- 172.21.15.80:0/1498933956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92880feac0 0x7f928819a300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 >> 172.21.15.80:0/1498933956 conn(0x7f92880f8180 msgr2=0x7f92880fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:18.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 shutdown_connections 2022-09-07T19:44:18.315 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.312+0000 7f928e59d700 1 -- 172.21.15.80:0/1498933956 wait complete. 2022-09-07T19:44:18.336 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:17 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:17.992+0000 7f3fbf943080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-07T19:44:18.336 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:18.131+0000 7f3fbf943080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-07T19:44:18.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2022-09-07T19:44:18.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2022-09-07T19:44:18.552 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-mon[96967]: mgrmap e19: x(active, since 9m), standbys: z, y 2022-09-07T19:44:18.552 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' 2022-09-07T19:44:18.555 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-mon[96967]: from='client.? ' entity='client.admin' 2022-09-07T19:44:18.556 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:17 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:17.929+0000 7ff0602c4080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:44:18.556 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:18.241+0000 7ff0602c4080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:44:18.557 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:18.328+0000 7ff0602c4080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:44:18.557 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:18.457+0000 7ff0602c4080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:44:18.558 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2022-09-07T19:44:18.558 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-mon[97606]: mgrmap e19: x(active, since 9m), standbys: z, y 2022-09-07T19:44:18.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' 2022-09-07T19:44:18.559 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-mon[97606]: from='client.? ' entity='client.admin' 2022-09-07T19:44:18.559 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:18.245+0000 7f863e6e7080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:44:18.560 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:18.331+0000 7f863e6e7080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:44:18.560 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:18.460+0000 7f863e6e7080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:44:18.560 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:18.551+0000 7f863e6e7080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:44:18.574 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 -- 172.21.15.80:0/1126199565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 msgr2=0x7fafec071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 --2- 172.21.15.80:0/1126199565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec071170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009810 tx=0x7fafdc009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:18.575 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 -- 172.21.15.80:0/1126199565 shutdown_connections 2022-09-07T19:44:18.576 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 --2- 172.21.15.80:0/1126199565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafec105c90 0x7fafec1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.576 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 --2- 172.21.15.80:0/1126199565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec071170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.576 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 --2- 172.21.15.80:0/1126199565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafec071740 0x7fafec071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.574+0000 7faff09ff700 1 -- 172.21.15.80:0/1126199565 >> 172.21.15.80:0/1126199565 conn(0x7fafec0f9480 msgr2=0x7fafec0fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:18.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.575+0000 7faff09ff700 1 -- 172.21.15.80:0/1126199565 shutdown_connections 2022-09-07T19:44:18.577 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.575+0000 7faff09ff700 1 -- 172.21.15.80:0/1126199565 wait complete. 2022-09-07T19:44:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.576+0000 7faff09ff700 1 Processor -- start 2022-09-07T19:44:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 -- start start 2022-09-07T19:44:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafec071740 0x7fafec101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec1016c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafec105c90 0x7fafec0fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0fe510 con 0x7fafec071740 2022-09-07T19:44:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0fe680 con 0x7fafec072c90 2022-09-07T19:44:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7faff09ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0fe840 con 0x7fafec105c90 2022-09-07T19:44:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7fafea59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafec071740 0x7fafec101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7fafe9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec1016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7fafe9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec1016c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.80:33156/0 (socket says 172.21.15.80:33156) 2022-09-07T19:44:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7fafe9d9b700 1 -- 172.21.15.80:0/1934700875 learned_addr learned my addr 172.21.15.80:0/1934700875 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.577+0000 7fafead9d700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafec105c90 0x7fafec0fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafe9d9b700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafec105c90 msgr2=0x7fafec0fdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafe9d9b700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafec105c90 0x7fafec0fdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafe9d9b700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafec071740 msgr2=0x7fafec101180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:18.584 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafe9d9b700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafec071740 0x7fafec101180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafe9d9b700 1 -- 172.21.15.80:0/1934700875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009470 con 0x7fafec072c90 2022-09-07T19:44:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafec071740 0x7fafec101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafe9d9b700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec1016c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafe000e740 tx=0x7fafe000ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0005220 con 0x7fafec072c90 2022-09-07T19:44:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fafe0005380 con 0x7fafec072c90 2022-09-07T19:44:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec1a21e0 con 0x7fafec072c90 2022-09-07T19:44:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.578+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0004b70 con 0x7fafec072c90 2022-09-07T19:44:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.579+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec1a2740 con 0x7fafec072c90 2022-09-07T19:44:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.580+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec10b7d0 con 0x7fafec072c90 2022-09-07T19:44:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.581+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) v1 ==== 127695+0+0 (secure 0 0 0) 0x7fafe001e020 con 0x7fafec072c90 2022-09-07T19:44:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.582+0000 7fafdb7fe700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.583+0000 7fafea59c700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.583+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9140+0+0 (secure 0 0 0) 0x7fafe0014070 con 0x7fafec072c90 2022-09-07T19:44:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.583+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-07T19:44:18.590 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.586+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fafe008eba0 con 0x7fafec072c90 2022-09-07T19:44:18.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:18.379+0000 7f3fbf943080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-07T19:44:18.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2022-09-07T19:44:18.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-mon[90124]: mgrmap e19: x(active, since 9m), standbys: z, y 2022-09-07T19:44:18.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' 2022-09-07T19:44:18.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-mon[90124]: from='client.? ' entity='client.admin' 2022-09-07T19:44:18.783 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.784+0000 7fafea59c700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:18.784 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.784+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-07T19:44:18.810 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:18.810+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 --> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fafec05f120 con 0x7fafd40990e0 2022-09-07T19:44:19.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:18.829+0000 7f3fbf943080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-07T19:44:19.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:18 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:18.960+0000 7f3fbf943080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-07T19:44:19.184 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:19.184+0000 7fafea59c700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:19.184 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:19.184+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-09-07T19:44:19.372 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:18.549+0000 7ff0602c4080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:44:19.373 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:18 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:18.966+0000 7ff0602c4080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:44:19.446 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:18 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:18.967+0000 7f863e6e7080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:44:19.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:19 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:19.137+0000 7f3fbf943080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-07T19:44:19.619 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:19 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:19.275+0000 7f3fbf943080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-07T19:44:19.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:19 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:19.527+0000 7ff0602c4080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:44:19.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:19 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:19.697+0000 7ff0602c4080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:44:19.946 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:19 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:19.530+0000 7f863e6e7080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:44:19.946 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:19 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:19.701+0000 7f863e6e7080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:44:19.985 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:19.985+0000 7fafea59c700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:19.985 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:19.985+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-09-07T19:44:20.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:19 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:19.880+0000 7f3fbf943080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-07T19:44:20.702 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:20 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:20.446+0000 7ff0602c4080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:44:20.702 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:20 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:20.535+0000 7ff0602c4080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:44:20.705 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:20 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:20.450+0000 7f863e6e7080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:44:20.705 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:20 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:20.541+0000 7f863e6e7080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:44:21.031 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:20 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:20.702+0000 7ff0602c4080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:44:21.031 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:20 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:20.885+0000 7ff0602c4080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:44:21.032 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:20 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:20.706+0000 7f863e6e7080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:44:21.032 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:20 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:20.888+0000 7f863e6e7080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:44:21.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:20 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:20.705+0000 7f3fbf943080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-07T19:44:21.119 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:20 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:20.942+0000 7f3fbf943080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-07T19:44:21.373 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:21 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:21.032+0000 7ff0602c4080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:44:21.425 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:21 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:21.033+0000 7f863e6e7080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:44:21.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:21.588+0000 7fafea59c700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:21.587 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:21.588+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2022-09-07T19:44:21.696 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:21 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:21.426+0000 7f863e6e7080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:44:21.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:21 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:21.426+0000 7ff0602c4080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:44:22.255 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:21 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:21.949+0000 7ff0602c4080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:44:22.256 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:21 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:21.949+0000 7f863e6e7080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:44:22.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:22 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:22.008+0000 7f3fbf943080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:44:22.368 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:22 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:22.157+0000 7f3fbf943080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-07T19:44:22.552 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:22 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:22.256+0000 7ff0602c4080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:44:22.552 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:22 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:22.442+0000 7ff0602c4080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:44:22.553 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:22 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:22.257+0000 7f863e6e7080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:44:22.554 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:22 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:22.443+0000 7f863e6e7080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:44:22.750 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:22 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:22.441+0000 7f3fbf943080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-07T19:44:22.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:22 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:22.553+0000 7ff0602c4080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:44:22.873 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:22 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:22.762+0000 7ff0602c4080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:44:22.946 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:22 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:22.554+0000 7f863e6e7080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:44:22.946 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:22 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:22.763+0000 7f863e6e7080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:44:23.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:22 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:22.750+0000 7f3fbf943080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-07T19:44:23.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:22 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:22.985+0000 7f3fbf943080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-07T19:44:23.464 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:23.465+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 20) v1 ==== 127695+0+0 (secure 0 0 0) 0x7fafe000c040 con 0x7fafec072c90 2022-09-07T19:44:23.696 INFO:journalctl@ceph.mgr.z.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-z[99593]: 2022-09-07T19:44:23.390+0000 7f863e6e7080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:44:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: Standby manager daemon z restarted 2022-09-07T19:44:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: Standby manager daemon z started 2022-09-07T19:44:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: Standby manager daemon y restarted 2022-09-07T19:44:23.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: Standby manager daemon y started 2022-09-07T19:44:23.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2022-09-07T19:44:23.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:44:23.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2022-09-07T19:44:23.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2022-09-07T19:44:23.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:44:23.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:44:23.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2022-09-07T19:44:23.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:23 smithi155 ceph-mon[97606]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:44:23.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:23.589+0000 7f3fbf943080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-07T19:44:23.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: Standby manager daemon z restarted 2022-09-07T19:44:23.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: Standby manager daemon z started 2022-09-07T19:44:23.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: Standby manager daemon y restarted 2022-09-07T19:44:23.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: Standby manager daemon y started 2022-09-07T19:44:23.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2022-09-07T19:44:23.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:44:23.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2022-09-07T19:44:23.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2022-09-07T19:44:23.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:44:23.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:44:23.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2022-09-07T19:44:23.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:23 smithi080 ceph-mon[90124]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:44:23.872 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-y[98313]: 2022-09-07T19:44:23.390+0000 7ff0602c4080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:44:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: Standby manager daemon z restarted 2022-09-07T19:44:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: Standby manager daemon z started 2022-09-07T19:44:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: Standby manager daemon y restarted 2022-09-07T19:44:23.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: Standby manager daemon y started 2022-09-07T19:44:23.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2022-09-07T19:44:23.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:44:23.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2022-09-07T19:44:23.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2022-09-07T19:44:23.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-09-07T19:44:23.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.155:0/2923013357' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:44:23.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2022-09-07T19:44:23.876 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:23 smithi154 ceph-mon[96967]: from='mgr.? 172.21.15.154:0/1085979239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-09-07T19:44:24.790 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:24.791+0000 7fafea59c700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/202237256 2022-09-07T19:44:24.791 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:24.791+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2022-09-07T19:44:24.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:24 smithi080 ceph-mon[90124]: mgrmap e20: x(active, since 9m), standbys: z, y 2022-09-07T19:44:24.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:24 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:24.515+0000 7f3fbf943080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-07T19:44:24.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:24 smithi154 ceph-mon[96967]: mgrmap e20: x(active, since 9m), standbys: z, y 2022-09-07T19:44:24.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:24 smithi155 ceph-mon[97606]: mgrmap e20: x(active, since 9m), standbys: z, y 2022-09-07T19:44:25.272 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:24 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:24.939+0000 7f3fbf943080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-07T19:44:25.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:25 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:25.272+0000 7f3fbf943080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-07T19:44:25.618 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:25 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:25.464+0000 7f3fbf943080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-07T19:44:26.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:25 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:25.833+0000 7f3fbf943080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-07T19:44:26.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:26.911+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 21) v1 ==== 127422+0+0 (secure 0 0 0) 0x7fafe00bfdd0 con 0x7fafec072c90 2022-09-07T19:44:26.911 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:26.911+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 msgr2=0x7fafd409b590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-07T19:44:26.912 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:26.911+0000 7fafdb7fe700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/202237256,v1:172.21.15.80:6801/202237256] conn(0x7fafd40990e0 0x7fafd409b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:27.118 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:26 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:26.845+0000 7f3fbf943080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-07T19:44:27.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:26 smithi080 ceph-mon[90124]: Active manager daemon x restarted 2022-09-07T19:44:27.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:26 smithi080 ceph-mon[90124]: Activating manager daemon x 2022-09-07T19:44:27.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:26 smithi080 ceph-mon[90124]: osdmap e94: 12 total, 12 up, 12 in 2022-09-07T19:44:27.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:26 smithi155 ceph-mon[97606]: Active manager daemon x restarted 2022-09-07T19:44:27.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:26 smithi155 ceph-mon[97606]: Activating manager daemon x 2022-09-07T19:44:27.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:26 smithi155 ceph-mon[97606]: osdmap e94: 12 total, 12 up, 12 in 2022-09-07T19:44:27.327 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:26 smithi154 ceph-mon[96967]: Active manager daemon x restarted 2022-09-07T19:44:27.328 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:26 smithi154 ceph-mon[96967]: Activating manager daemon x 2022-09-07T19:44:27.328 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:26 smithi154 ceph-mon[96967]: osdmap e94: 12 total, 12 up, 12 in 2022-09-07T19:44:27.594 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.388+0000 7f3f2642e700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.595 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.388+0000 7f3f2642e700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.595 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.388+0000 7f3f2642e700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.595 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.388+0000 7f3f2642e700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.596 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.388+0000 7f3f2642e700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.596 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.391+0000 7f3f23428700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.596 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.391+0000 7f3f23428700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.596 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.391+0000 7f3f23428700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.597 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.391+0000 7f3f23428700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.597 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:44:27.391+0000 7f3f23428700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:44:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:27.939+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mon.2 v2:172.21.15.154:3300/0 9 ==== mgrmap(e 22) v1 ==== 127532+0+0 (secure 0 0 0) 0x7fafe0004cf0 con 0x7fafec072c90 2022-09-07T19:44:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:27.940+0000 7fafdb7fe700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fafd402eff0 0x7fafd402f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:27.941 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:27.940+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 --> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fafec05f120 con 0x7fafd402eff0 2022-09-07T19:44:27.941 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:27.942+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fafd402eff0 0x7fafd402f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:27.952 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:27.951+0000 7fafea59c700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fafd402eff0 0x7fafd402f3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafdc005b50 tx=0x7fafdc009e70 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.021+0000 7fafdb7fe700 1 -- 172.21.15.80:0/1934700875 <== mgr.15243 v2:172.21.15.80:6800/3395855405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fafec05f120 con 0x7fafd402eff0 2022-09-07T19:44:28.021 INFO:teuthology.orchestra.run.smithi080.stdout:Schedule set for path / 2022-09-07T19:44:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.024+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fafd402eff0 msgr2=0x7fafd402f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.024+0000 7faff09ff700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fafd402eff0 0x7fafd402f3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafdc005b50 tx=0x7fafdc009e70 comp rx=0 tx=0).stop 2022-09-07T19:44:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.024+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 msgr2=0x7fafec1016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.024+0000 7faff09ff700 1 --2- 172.21.15.80:0/1934700875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafec072c90 0x7fafec1016c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafe000e740 tx=0x7fafe000ea50 comp rx=0 tx=0).stop 2022-09-07T19:44:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.025+0000 7fafead9d700 1 -- 172.21.15.80:0/1934700875 reap_dead start 2022-09-07T19:44:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.025+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 shutdown_connections 2022-09-07T19:44:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.025+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 >> 172.21.15.80:0/1934700875 conn(0x7fafec0f9480 msgr2=0x7fafec0fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:28.026 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.025+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 shutdown_connections 2022-09-07T19:44:28.026 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.025+0000 7faff09ff700 1 -- 172.21.15.80:0/1934700875 wait complete. 2022-09-07T19:44:28.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2022-09-07T19:44:28.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: mgrmap e21: x(active, starting, since 0.0612185s), standbys: z, y 2022-09-07T19:44:28.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:44:28.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:44:28.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:44:28.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:44:28.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2022-09-07T19:44:28.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2022-09-07T19:44:28.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2022-09-07T19:44:28.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2022-09-07T19:44:28.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2022-09-07T19:44:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2022-09-07T19:44:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2022-09-07T19:44:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2022-09-07T19:44:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2022-09-07T19:44:28.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2022-09-07T19:44:28.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2022-09-07T19:44:28.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-09-07T19:44:28.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2022-09-07T19:44:28.124 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-09-07T19:44:28.124 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:44:28.124 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:44:28.124 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:44:28.125 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:44:28.125 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:44:28.125 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:44:28.126 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:44:28.126 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:44:28.126 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:44:28.126 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:44:28.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:44:28.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:44:28.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-09-07T19:44:28.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-09-07T19:44:28.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-09-07T19:44:28.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: Manager daemon x is now available 2022-09-07T19:44:28.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:28.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:28.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:44:28.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:44:28.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:44:28.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:44:28.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:44:28.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:27 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:44:28.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: mgrmap e21: x(active, starting, since 0.0612185s), standbys: z, y 2022-09-07T19:44:28.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:44:28.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:44:28.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:44:28.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:44:28.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2022-09-07T19:44:28.199 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2022-09-07T19:44:28.200 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2022-09-07T19:44:28.200 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2022-09-07T19:44:28.201 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2022-09-07T19:44:28.201 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2022-09-07T19:44:28.202 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2022-09-07T19:44:28.202 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2022-09-07T19:44:28.203 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2022-09-07T19:44:28.203 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2022-09-07T19:44:28.204 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2022-09-07T19:44:28.204 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-09-07T19:44:28.205 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2022-09-07T19:44:28.205 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-09-07T19:44:28.205 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:44:28.205 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:44:28.206 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:44:28.206 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:44:28.206 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:44:28.206 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:44:28.207 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:44:28.207 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:44:28.207 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:44:28.207 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:44:28.208 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:44:28.208 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:44:28.208 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-09-07T19:44:28.208 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-09-07T19:44:28.208 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-09-07T19:44:28.209 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: Manager daemon x is now available 2022-09-07T19:44:28.209 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:28.209 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:28.209 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:44:28.210 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:44:28.210 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:44:28.210 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:44:28.210 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:44:28.210 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:27 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:44:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 -- 172.21.15.80:0/2983717428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 msgr2=0x7fbab4100410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 --2- 172.21.15.80:0/2983717428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 0x7fbab4100410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009810 tx=0x7fbab0009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 -- 172.21.15.80:0/2983717428 shutdown_connections 2022-09-07T19:44:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 --2- 172.21.15.80:0/2983717428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 0x7fbab4100410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 --2- 172.21.15.80:0/2983717428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41019d0 0x7fbab4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 --2- 172.21.15.80:0/2983717428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab4100950 0x7fbab4101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.293+0000 7fbabbfff700 1 -- 172.21.15.80:0/2983717428 >> 172.21.15.80:0/2983717428 conn(0x7fbab40fb710 msgr2=0x7fbab40fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.294+0000 7fbabbfff700 1 -- 172.21.15.80:0/2983717428 shutdown_connections 2022-09-07T19:44:28.296 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.294+0000 7fbabbfff700 1 -- 172.21.15.80:0/2983717428 wait complete. 2022-09-07T19:44:28.298 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.295+0000 7fbabbfff700 1 Processor -- start 2022-09-07T19:44:28.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.295+0000 7fbabbfff700 1 -- start start 2022-09-07T19:44:28.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 0x7fbab4195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab4100950 0x7fbab41960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.299 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 0x7fbab419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbabbfff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419d720 con 0x7fbab4100000 2022-09-07T19:44:28.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbabbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419d890 con 0x7fbab4100950 2022-09-07T19:44:28.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbabbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419da50 con 0x7fbab41019d0 2022-09-07T19:44:28.300 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbab9d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 0x7fbab4195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbaba59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 0x7fbab419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbaba59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 0x7fbab419d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:35480/0 (socket says 172.21.15.80:35480) 2022-09-07T19:44:28.301 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbaba59c700 1 -- 172.21.15.80:0/405436383 learned_addr learned my addr 172.21.15.80:0/405436383 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:28.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.296+0000 7fbab959a700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab4100950 0x7fbab41960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaba59c700 1 -- 172.21.15.80:0/405436383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab4100950 msgr2=0x7fbab41960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaba59c700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab4100950 0x7fbab41960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.302 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaba59c700 1 -- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 msgr2=0x7fbab4195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaba59c700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 0x7fbab4195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaba59c700 1 -- 172.21.15.80:0/405436383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40093b0 con 0x7fbab41019d0 2022-09-07T19:44:28.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaba59c700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 0x7fbab419d150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00ebf0 tx=0x7fbaac00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:28.303 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0099c0 con 0x7fbab41019d0 2022-09-07T19:44:28.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab0009470 con 0x7fbab41019d0 2022-09-07T19:44:28.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fbaac00cc90 con 0x7fbab41019d0 2022-09-07T19:44:28.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac010430 con 0x7fbab41019d0 2022-09-07T19:44:28.304 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.297+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab419e060 con 0x7fbab41019d0 2022-09-07T19:44:28.305 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.299+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab410b7f0 con 0x7fbab41019d0 2022-09-07T19:44:28.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.300+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 22) v1 ==== 127532+0+0 (secure 0 0 0) 0x7fbaac01e020 con 0x7fbab41019d0 2022-09-07T19:44:28.306 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.301+0000 7fbaaaffd700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fbaa0098ed0 0x7fbaa009b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.302+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9398+0+0 (secure 0 0 0) 0x7fbaac014070 con 0x7fbab41019d0 2022-09-07T19:44:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.302+0000 7fbab9d9b700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fbaa0098ed0 0x7fbaa009b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.303+0000 7fbab9d9b700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fbaa0098ed0 0x7fbaa009b380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbab000b4f0 tx=0x7fbab0009eb0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.304+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7fbaac08f510 con 0x7fbab41019d0 2022-09-07T19:44:28.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: mgrmap e21: x(active, starting, since 0.0612185s), standbys: z, y 2022-09-07T19:44:28.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-09-07T19:44:28.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-09-07T19:44:28.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-09-07T19:44:28.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:44:28.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2022-09-07T19:44:28.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2022-09-07T19:44:28.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2022-09-07T19:44:28.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2022-09-07T19:44:28.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2022-09-07T19:44:28.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2022-09-07T19:44:28.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2022-09-07T19:44:28.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2022-09-07T19:44:28.376 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2022-09-07T19:44:28.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2022-09-07T19:44:28.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2022-09-07T19:44:28.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-09-07T19:44:28.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2022-09-07T19:44:28.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-09-07T19:44:28.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-09-07T19:44:28.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-09-07T19:44:28.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-09-07T19:44:28.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-09-07T19:44:28.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-09-07T19:44:28.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-09-07T19:44:28.379 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-09-07T19:44:28.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-09-07T19:44:28.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2022-09-07T19:44:28.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2022-09-07T19:44:28.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2022-09-07T19:44:28.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2022-09-07T19:44:28.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-09-07T19:44:28.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-09-07T19:44:28.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-09-07T19:44:28.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: Manager daemon x is now available 2022-09-07T19:44:28.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:28.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:28.382 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:44:28.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:44:28.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:44:28.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:44:28.383 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:44:28.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:27 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:44:28.543 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.544+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 --> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fbab405f120 con 0x7fbaa0098ed0 2022-09-07T19:44:28.604 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.605+0000 7fbaaaffd700 1 -- 172.21.15.80:0/405436383 <== mgr.15243 v2:172.21.15.80:6800/3395855405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fbab405f120 con 0x7fbaa0098ed0 2022-09-07T19:44:28.605 INFO:teuthology.orchestra.run.smithi080.stdout:Retention added to path / 2022-09-07T19:44:28.607 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.607+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fbaa0098ed0 msgr2=0x7fbaa009b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.607 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.607+0000 7fbabbfff700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fbaa0098ed0 0x7fbaa009b380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbab000b4f0 tx=0x7fbab0009eb0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.607 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.607+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 msgr2=0x7fbab419d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.607+0000 7fbabbfff700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 0x7fbab419d150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00ebf0 tx=0x7fbaac00ef00 comp rx=0 tx=0).stop 2022-09-07T19:44:28.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 shutdown_connections 2022-09-07T19:44:28.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7fbaa0098ed0 0x7fbaa009b380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.608 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbab4100000 0x7fbab4195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbab41019d0 0x7fbab419d150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 --2- 172.21.15.80:0/405436383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab4100950 0x7fbab41960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 >> 172.21.15.80:0/405436383 conn(0x7fbab40fb710 msgr2=0x7fbab40fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 shutdown_connections 2022-09-07T19:44:28.610 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.608+0000 7fbabbfff700 1 -- 172.21.15.80:0/405436383 wait complete. 2022-09-07T19:44:28.636 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2022-09-07T19:44:28.870 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.870+0000 7ff278d9d700 1 -- 172.21.15.80:0/316290715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 msgr2=0x7ff274073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.870+0000 7ff278d9d700 1 --2- 172.21.15.80:0/316290715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274073a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009bb0 tx=0x7ff26c009ec0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.870+0000 7ff278d9d700 1 -- 172.21.15.80:0/316290715 shutdown_connections 2022-09-07T19:44:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.870+0000 7ff278d9d700 1 --2- 172.21.15.80:0/316290715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff274075240 0x7ff274075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.871+0000 7ff278d9d700 1 --2- 172.21.15.80:0/316290715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274073a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.871+0000 7ff278d9d700 1 --2- 172.21.15.80:0/316290715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff274074890 0x7ff274074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.871+0000 7ff278d9d700 1 -- 172.21.15.80:0/316290715 >> 172.21.15.80:0/316290715 conn(0x7ff2740fb6b0 msgr2=0x7ff2740fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.871+0000 7ff278d9d700 1 -- 172.21.15.80:0/316290715 shutdown_connections 2022-09-07T19:44:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.871+0000 7ff278d9d700 1 -- 172.21.15.80:0/316290715 wait complete. 2022-09-07T19:44:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.872+0000 7ff278d9d700 1 Processor -- start 2022-09-07T19:44:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 -- start start 2022-09-07T19:44:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff274074890 0x7ff27419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff274075240 0x7ff2741a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2741a1950 con 0x7ff274074890 2022-09-07T19:44:28.876 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2741a1ac0 con 0x7ff274075240 2022-09-07T19:44:28.877 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff278d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2741a1c80 con 0x7ff274073610 2022-09-07T19:44:28.877 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff2737fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.877 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.873+0000 7ff272ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff274074890 0x7ff27419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.80:35502/0 (socket says 172.21.15.80:35502) 2022-09-07T19:44:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 -- 172.21.15.80:0/126313290 learned_addr learned my addr 172.21.15.80:0/126313290 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff273fff700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff274075240 0x7ff2741a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 -- 172.21.15.80:0/126313290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff274075240 msgr2=0x7ff2741a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff274075240 0x7ff2741a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 -- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff274074890 msgr2=0x7ff27419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff274074890 0x7ff27419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 -- 172.21.15.80:0/126313290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0097e0 con 0x7ff274073610 2022-09-07T19:44:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff2737fe700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274199dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009ad0 tx=0x7ff26c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.874+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c003a80 con 0x7ff274073610 2022-09-07T19:44:28.881 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.875+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ff26c00fb10 con 0x7ff274073610 2022-09-07T19:44:28.881 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.875+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004450 con 0x7ff274073610 2022-09-07T19:44:28.881 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.875+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2741a1f00 con 0x7ff274073610 2022-09-07T19:44:28.881 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.875+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2741a2270 con 0x7ff274073610 2022-09-07T19:44:28.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.876+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27410fa10 con 0x7ff274073610 2022-09-07T19:44:28.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.879+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 22) v1 ==== 127532+0+0 (secure 0 0 0) 0x7ff26c020070 con 0x7ff274073610 2022-09-07T19:44:28.883 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.880+0000 7ff270ff9700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7ff25c099080 0x7ff25c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:28.884 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.881+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9398+0+0 (secure 0 0 0) 0x7ff26c0c3ef0 con 0x7ff274073610 2022-09-07T19:44:28.884 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.881+0000 7ff272ffd700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7ff25c099080 0x7ff25c09b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:28.884 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.882+0000 7ff272ffd700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7ff25c099080 0x7ff25c09b530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff268005fd0 tx=0x7ff268005ea0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:28.885 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.883+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7ff26c0901d0 con 0x7ff274073610 2022-09-07T19:44:28.947 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:28.948+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 23) v1 ==== 127815+0+0 (secure 0 0 0) 0x7ff26c00c040 con 0x7ff274073610 2022-09-07T19:44:29.127 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.127+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 --> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7ff27405fbd0 con 0x7ff25c099080 2022-09-07T19:44:29.134 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.135+0000 7ff270ff9700 1 -- 172.21.15.80:0/126313290 <== mgr.15243 v2:172.21.15.80:6800/3395855405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7ff27405fbd0 con 0x7ff25c099080 2022-09-07T19:44:29.135 INFO:teuthology.orchestra.run.smithi080.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2022-09-07T00:00:00", "created": "2022-09-07T19:44:27", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2022-09-07T19:44:29.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7ff25c099080 msgr2=0x7ff25c09b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7ff25c099080 0x7ff25c09b530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff268005fd0 tx=0x7ff268005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.138 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 msgr2=0x7ff274199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274199dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009ad0 tx=0x7ff26c00b910 comp rx=0 tx=0).stop 2022-09-07T19:44:29.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 shutdown_connections 2022-09-07T19:44:29.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7ff25c099080 0x7ff25c09b530 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.139 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff274075240 0x7ff2741a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff274073610 0x7ff274199dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 --2- 172.21.15.80:0/126313290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff274074890 0x7ff27419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 >> 172.21.15.80:0/126313290 conn(0x7ff2740fb6b0 msgr2=0x7ff2740fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:29.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 shutdown_connections 2022-09-07T19:44:29.140 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.138+0000 7ff278d9d700 1 -- 172.21.15.80:0/126313290 wait complete. 2022-09-07T19:44:29.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2022-09-07T19:44:29.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:28 smithi155 ceph-mon[97606]: mgrmap e22: x(active, since 1.08978s), standbys: z, y 2022-09-07T19:44:29.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:28 smithi155 ceph-mon[97606]: [07/Sep/2022:19:44:28] ENGINE Bus STARTING 2022-09-07T19:44:29.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:28 smithi155 ceph-mon[97606]: [07/Sep/2022:19:44:28] ENGINE Serving on https://172.21.15.80:7150 2022-09-07T19:44:29.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:28 smithi155 ceph-mon[97606]: [07/Sep/2022:19:44:28] ENGINE Serving on https://:::8765 2022-09-07T19:44:29.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:28 smithi155 ceph-mon[97606]: [07/Sep/2022:19:44:28] ENGINE Bus STARTED 2022-09-07T19:44:29.198 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:28 smithi155 ceph-mon[97606]: from='client.25387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:29.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:28 smithi080 ceph-mon[90124]: mgrmap e22: x(active, since 1.08978s), standbys: z, y 2022-09-07T19:44:29.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:28 smithi080 ceph-mon[90124]: [07/Sep/2022:19:44:28] ENGINE Bus STARTING 2022-09-07T19:44:29.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:28 smithi080 ceph-mon[90124]: [07/Sep/2022:19:44:28] ENGINE Serving on https://172.21.15.80:7150 2022-09-07T19:44:29.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:28 smithi080 ceph-mon[90124]: [07/Sep/2022:19:44:28] ENGINE Serving on https://:::8765 2022-09-07T19:44:29.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:28 smithi080 ceph-mon[90124]: [07/Sep/2022:19:44:28] ENGINE Bus STARTED 2022-09-07T19:44:29.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:28 smithi080 ceph-mon[90124]: from='client.25387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:29.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:28 smithi154 ceph-mon[96967]: mgrmap e22: x(active, since 1.08978s), standbys: z, y 2022-09-07T19:44:29.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:28 smithi154 ceph-mon[96967]: [07/Sep/2022:19:44:28] ENGINE Bus STARTING 2022-09-07T19:44:29.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:28 smithi154 ceph-mon[96967]: [07/Sep/2022:19:44:28] ENGINE Serving on https://172.21.15.80:7150 2022-09-07T19:44:29.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:28 smithi154 ceph-mon[96967]: [07/Sep/2022:19:44:28] ENGINE Serving on https://:::8765 2022-09-07T19:44:29.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:28 smithi154 ceph-mon[96967]: [07/Sep/2022:19:44:28] ENGINE Bus STARTED 2022-09-07T19:44:29.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:28 smithi154 ceph-mon[96967]: from='client.25387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:29.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 -- 172.21.15.80:0/3895647499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8066e80 msgr2=0x7f35b8100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 --2- 172.21.15.80:0/3895647499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8066e80 0x7f35b8100790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009810 tx=0x7f35b4009b20 comp rx=0 tx=0).stop 2022-09-07T19:44:29.408 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 -- 172.21.15.80:0/3895647499 shutdown_connections 2022-09-07T19:44:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 --2- 172.21.15.80:0/3895647499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 0x7f35b8105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 --2- 172.21.15.80:0/3895647499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8066e80 0x7f35b8100790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 --2- 172.21.15.80:0/3895647499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8100cd0 0x7f35b8103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 -- 172.21.15.80:0/3895647499 >> 172.21.15.80:0/3895647499 conn(0x7f35b80f8180 msgr2=0x7f35b80fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 -- 172.21.15.80:0/3895647499 shutdown_connections 2022-09-07T19:44:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.408+0000 7f35be99d700 1 -- 172.21.15.80:0/3895647499 wait complete. 2022-09-07T19:44:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 Processor -- start 2022-09-07T19:44:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 -- start start 2022-09-07T19:44:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 0x7f35b8195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8100cd0 0x7f35b8195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 0x7f35b819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b819d4e0 con 0x7f35b8066e80 2022-09-07T19:44:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b819d650 con 0x7f35b8100cd0 2022-09-07T19:44:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.410+0000 7f35be99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b819d810 con 0x7f35b81037c0 2022-09-07T19:44:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd99b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 0x7f35b8195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35be19c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 0x7f35b819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd99b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 0x7f35b8195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39694/0 (socket says 172.21.15.80:39694) 2022-09-07T19:44:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd99b700 1 -- 172.21.15.80:0/1326606081 learned_addr learned my addr 172.21.15.80:0/1326606081 (peer_addr_for_me v2:172.21.15.80:0/0) 2022-09-07T19:44:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd99b700 1 -- 172.21.15.80:0/1326606081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 msgr2=0x7f35b819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd99b700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 0x7f35b819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd99b700 1 -- 172.21.15.80:0/1326606081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8100cd0 msgr2=0x7f35b8195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.411+0000 7f35bd19a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8100cd0 0x7f35b8195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:29.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35bd99b700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8100cd0 0x7f35b8195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35bd99b700 1 -- 172.21.15.80:0/1326606081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009470 con 0x7f35b8066e80 2022-09-07T19:44:29.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35be19c700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 0x7f35b819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-07T19:44:29.417 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35bd19a700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8100cd0 0x7f35b8195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-07T19:44:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35bd99b700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 0x7f35b8195960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35b4006010 tx=0x7f35b400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b401d070 con 0x7f35b8066e80 2022-09-07T19:44:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7f35b400f930 con 0x7f35b8066e80 2022-09-07T19:44:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.412+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40047d0 con 0x7f35b8066e80 2022-09-07T19:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.413+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b819da90 con 0x7f35b8066e80 2022-09-07T19:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.414+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b819dec0 con 0x7f35b8066e80 2022-09-07T19:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.415+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b8109390 con 0x7f35b8066e80 2022-09-07T19:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.417+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) v1 ==== 127815+0+0 (secure 0 0 0) 0x7f35b400c040 con 0x7f35b8066e80 2022-09-07T19:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.419+0000 7f35aeffd700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7f35a4099260 0x7f35a409b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-07T19:44:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.419+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9398+0+0 (secure 0 0 0) 0x7f35b40c3310 con 0x7f35b8066e80 2022-09-07T19:44:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.419+0000 7f35bd19a700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7f35a4099260 0x7f35a409b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-07T19:44:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.420+0000 7f35bd19a700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7f35a4099260 0x7f35a409b710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35a8005fd0 tx=0x7f35a8005ea0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-07T19:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.423+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171119 (secure 0 0 0) 0x7f35b408f440 con 0x7f35b8066e80 2022-09-07T19:44:29.677 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.678+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 --> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f35b81054b0 con 0x7f35a4099260 2022-09-07T19:44:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.686+0000 7f35aeffd700 1 -- 172.21.15.80:0/1326606081 <== mgr.15243 v2:172.21.15.80:6800/3395855405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f35b81054b0 con 0x7f35a4099260 2022-09-07T19:44:29.686 INFO:teuthology.orchestra.run.smithi080.stdout:/ 1M 6M3h 2022-09-07T19:44:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.690+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7f35a4099260 msgr2=0x7f35a409b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.690+0000 7f35be99d700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7f35a4099260 0x7f35a409b710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35a8005fd0 tx=0x7f35a8005ea0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.690+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 msgr2=0x7f35b8195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-07T19:44:29.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.690+0000 7f35be99d700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 0x7f35b8195960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35b4006010 tx=0x7f35b400f690 comp rx=0 tx=0).stop 2022-09-07T19:44:29.691 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 shutdown_connections 2022-09-07T19:44:29.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:6800/3395855405,v1:172.21.15.80:6801/3395855405] conn(0x7f35a4099260 0x7f35a409b710 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b8066e80 0x7f35b8195960 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.692 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b81037c0 0x7f35b819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 --2- 172.21.15.80:0/1326606081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35b8100cd0 0x7f35b8195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-07T19:44:29.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 >> 172.21.15.80:0/1326606081 conn(0x7f35b80f8180 msgr2=0x7f35b80fa560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-07T19:44:29.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 shutdown_connections 2022-09-07T19:44:29.693 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:44:29.691+0000 7f35be99d700 1 -- 172.21.15.80:0/1326606081 wait complete. 2022-09-07T19:44:29.716 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2022-09-07T19:44:29.824 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2022-09-07T19:44:29.836 INFO:teuthology.run_tasks:Running task workunit... 2022-09-07T19:44:29.886 INFO:tasks.workunit:Pulling workunits from ref 152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:44:29.889 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-09-07T19:44:29.889 INFO:tasks.workunit:timeout=3h 2022-09-07T19:44:29.890 INFO:tasks.workunit:cleanup=True 2022-09-07T19:44:29.891 DEBUG:teuthology.orchestra.run.smithi080:> stat -- /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:29.956 INFO:teuthology.orchestra.run.smithi080.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:29.956 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-09-07T19:44:29.957 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2022-09-07T19:44:29.957 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-07T19:44:29.962 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:cephfs_t:s0 2022-09-07T19:44:29.962 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2022-09-07 19:42:40.071620163 +0000 2022-09-07T19:44:29.962 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2022-09-07 19:42:40.071620163 +0000 2022-09-07T19:44:29.962 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2022-09-07 19:44:16.064069199 +0000 2022-09-07T19:44:29.963 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2022-09-07 19:42:40.071620163 +0000 2022-09-07T19:44:29.964 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-09-07T19:44:29.964 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-09-07T19:44:30.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:29 smithi080 ceph-mon[90124]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:30.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:29 smithi080 ceph-mon[90124]: mgrmap e23: x(active, since 2s), standbys: z, y 2022-09-07T19:44:30.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:29 smithi080 ceph-mon[90124]: from='client.25393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:30.065 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 152194198413033811b31149de909a7ec5852a7f 2022-09-07T19:44:30.130 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-09-07T19:44:30.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:29 smithi155 ceph-mon[97606]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:30.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:29 smithi155 ceph-mon[97606]: mgrmap e23: x(active, since 2s), standbys: z, y 2022-09-07T19:44:30.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:29 smithi155 ceph-mon[97606]: from='client.25393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:30.346 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:29 smithi154 ceph-mon[96967]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:30.346 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:29 smithi154 ceph-mon[96967]: mgrmap e23: x(active, since 2s), standbys: z, y 2022-09-07T19:44:30.347 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:29 smithi154 ceph-mon[96967]: from='client.25393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:31.499 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:31.499 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.499 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.500 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.500 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.500 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.500 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.503 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.503 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.503 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.503 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.504 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.504 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.504 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.504 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.504 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:31 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.505 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:31.505 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.506 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.507 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.508 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.509 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.510 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.511 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:31 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2022-09-07T19:44:31.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:31.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:31.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:31 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:32.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:32.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi154 to 196.2M 2022-09-07T19:44:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Unable to set osd_memory_target on smithi154 to 205770342: error parsing value: Value '205770342' is below minimum 939524096 2022-09-07T19:44:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:44:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi155 to 196.2M 2022-09-07T19:44:32.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Unable to set osd_memory_target on smithi155 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2022-09-07T19:44:32.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:44:32.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:32.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:32.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:32.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:32 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:32.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:32.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi154 to 196.2M 2022-09-07T19:44:32.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Unable to set osd_memory_target on smithi154 to 205770342: error parsing value: Value '205770342' is below minimum 939524096 2022-09-07T19:44:32.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:44:32.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi155 to 196.2M 2022-09-07T19:44:32.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Unable to set osd_memory_target on smithi155 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2022-09-07T19:44:32.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:44:32.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:32.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:32.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:32.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:32 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:32.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:32.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi154 to 196.2M 2022-09-07T19:44:32.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Unable to set osd_memory_target on smithi154 to 205770342: error parsing value: Value '205770342' is below minimum 939524096 2022-09-07T19:44:32.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Updating smithi154:/etc/ceph/ceph.conf 2022-09-07T19:44:32.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi155 to 196.2M 2022-09-07T19:44:32.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Unable to set osd_memory_target on smithi155 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2022-09-07T19:44:32.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Updating smithi155:/etc/ceph/ceph.conf 2022-09-07T19:44:32.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:32.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:32.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:32.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:32 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:33.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:33.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:33.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:33.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.620 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:33 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:33 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: Updating smithi155:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:33.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: Updating smithi154:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:33.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:33.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:33 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:34.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:34 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:34.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:34 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2022-09-07T19:44:34.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:34.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:34.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:34 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2022-09-07T19:44:35.464 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:35 smithi080 ceph-mon[90124]: Adjusting osd_memory_target on smithi080 to 221.9M 2022-09-07T19:44:35.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:35 smithi080 ceph-mon[90124]: Unable to set osd_memory_target on smithi080 to 232710553: error parsing value: Value '232710553' is below minimum 939524096 2022-09-07T19:44:35.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:35 smithi080 ceph-mon[90124]: Updating smithi080:/etc/ceph/ceph.conf 2022-09-07T19:44:35.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:35 smithi080 ceph-mon[90124]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:35 smithi155 ceph-mon[97606]: Adjusting osd_memory_target on smithi080 to 221.9M 2022-09-07T19:44:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:35 smithi155 ceph-mon[97606]: Unable to set osd_memory_target on smithi080 to 232710553: error parsing value: Value '232710553' is below minimum 939524096 2022-09-07T19:44:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:35 smithi155 ceph-mon[97606]: Updating smithi080:/etc/ceph/ceph.conf 2022-09-07T19:44:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:35 smithi155 ceph-mon[97606]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:35 smithi154 ceph-mon[96967]: Adjusting osd_memory_target on smithi080 to 221.9M 2022-09-07T19:44:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:35 smithi154 ceph-mon[96967]: Unable to set osd_memory_target on smithi080 to 232710553: error parsing value: Value '232710553' is below minimum 939524096 2022-09-07T19:44:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:35 smithi154 ceph-mon[96967]: Updating smithi080:/etc/ceph/ceph.conf 2022-09-07T19:44:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:35 smithi154 ceph-mon[96967]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.conf 2022-09-07T19:44:36.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:36 smithi080 ceph-mon[90124]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 132 KiB/s wr, 51 op/s 2022-09-07T19:44:36.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:36 smithi080 ceph-mon[90124]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:36 smithi155 ceph-mon[97606]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 132 KiB/s wr, 51 op/s 2022-09-07T19:44:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:36 smithi155 ceph-mon[97606]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:36 smithi154 ceph-mon[96967]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 132 KiB/s wr, 51 op/s 2022-09-07T19:44:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:36 smithi154 ceph-mon[96967]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2022-09-07T19:44:37.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:37 smithi080 ceph-mon[90124]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:37.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:37 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:37 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.468 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:37 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:37 smithi154 ceph-mon[96967]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:37.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:37 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:37 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:37 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:37 smithi155 ceph-mon[97606]: Updating smithi080:/var/lib/ceph/cc599a0c-2ee3-11ed-8431-001a4aab830c/config/ceph.client.admin.keyring 2022-09-07T19:44:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:37 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:37 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:37 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2022-09-07T19:44:38.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:38.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:44:38.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:44:38.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:38 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2022-09-07T19:44:38.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:38.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:44:38.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:44:38.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:38 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2022-09-07T19:44:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:44:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:44:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:44:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:38.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:38 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:44:40.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:40 smithi155 ceph-mon[97606]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 84 KiB/s wr, 35 op/s 2022-09-07T19:44:40.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:40 smithi080 ceph-mon[90124]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 84 KiB/s wr, 35 op/s 2022-09-07T19:44:40.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:40 smithi154 ceph-mon[96967]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 84 KiB/s wr, 35 op/s 2022-09-07T19:44:42.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:42 smithi155 ceph-mon[97606]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2022-09-07T19:44:42.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:42 smithi080 ceph-mon[90124]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2022-09-07T19:44:42.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:42 smithi154 ceph-mon[96967]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2022-09-07T19:44:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:44 smithi155 ceph-mon[97606]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2022-09-07T19:44:44.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:44 smithi080 ceph-mon[90124]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2022-09-07T19:44:44.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:44 smithi154 ceph-mon[96967]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 77 KiB/s wr, 32 op/s 2022-09-07T19:44:46.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:46 smithi155 ceph-mon[97606]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 77 KiB/s wr, 34 op/s 2022-09-07T19:44:46.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:46 smithi080 ceph-mon[90124]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 77 KiB/s wr, 34 op/s 2022-09-07T19:44:46.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:46 smithi154 ceph-mon[96967]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 77 KiB/s wr, 34 op/s 2022-09-07T19:44:48.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:48 smithi155 ceph-mon[97606]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:44:48.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:48 smithi080 ceph-mon[90124]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:44:48.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:48 smithi154 ceph-mon[96967]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:44:50.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:50 smithi155 ceph-mon[97606]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:44:50.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:50 smithi080 ceph-mon[90124]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:44:50.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:50 smithi154 ceph-mon[96967]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:44:52.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:52 smithi155 ceph-mon[97606]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:52.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:52 smithi080 ceph-mon[90124]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:52.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:52 smithi154 ceph-mon[96967]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:54.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:54 smithi155 ceph-mon[97606]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:54.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:54 smithi080 ceph-mon[90124]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:54.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:54 smithi154 ceph-mon[96967]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:56.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:56 smithi155 ceph-mon[97606]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:44:56.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:56 smithi080 ceph-mon[90124]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:44:56.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:56 smithi154 ceph-mon[96967]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:44:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:44:58 smithi155 ceph-mon[97606]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:58.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:44:58 smithi080 ceph-mon[90124]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:44:58.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:44:58 smithi154 ceph-mon[96967]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:00 smithi155 ceph-mon[97606]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:45:00.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:00 smithi080 ceph-mon[90124]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:45:00.868 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:45:00 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:45:00.621+0000 7f3f048eb700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:45:00.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:45:00 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:45:00.621+0000 7f3f048eb700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:45:00.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:45:00 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:45:00.621+0000 7f3f048eb700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:45:00.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:45:00 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:45:00.621+0000 7f3f048eb700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:45:00.869 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Sep 07 19:45:00 smithi080 ceph-cc599a0c-2ee3-11ed-8431-001a4aab830c-mgr-x[90368]: 2022-09-07T19:45:00.621+0000 7f3f048eb700 -1 client.0 error registering admin socket command: (17) File exists 2022-09-07T19:45:00.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:00 smithi154 ceph-mon[96967]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:45:02.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:02 smithi155 ceph-mon[97606]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:02.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:02 smithi155 ceph-mon[97606]: mgrmap e24: x(active, since 34s), standbys: z, y 2022-09-07T19:45:02.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:02 smithi080 ceph-mon[90124]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:02.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:02 smithi080 ceph-mon[90124]: mgrmap e24: x(active, since 34s), standbys: z, y 2022-09-07T19:45:02.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:02 smithi154 ceph-mon[96967]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:02.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:02 smithi154 ceph-mon[96967]: mgrmap e24: x(active, since 34s), standbys: z, y 2022-09-07T19:45:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:04 smithi155 ceph-mon[97606]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:04.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:04 smithi080 ceph-mon[90124]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:04.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:04 smithi154 ceph-mon[96967]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:45:06.047 INFO:tasks.workunit.client.0.smithi080.stderr:Updating files: 70% (4823/6793) Updating files: 71% (4824/6793) Updating files: 72% (4891/6793) Updating files: 73% (4959/6793) Updating files: 74% (5027/6793) Updating files: 75% (5095/6793) Updating files: 76% (5163/6793) Updating files: 77% (5231/6793) Updating files: 78% (5299/6793) Updating files: 79% (5367/6793) Updating files: 80% (5435/6793) Updating files: 81% (5503/6793) Updating files: 82% (5571/6793) Updating files: 83% (5639/6793) Updating files: 84% (5707/6793) Updating files: 85% (5775/6793) Updating files: 86% (5842/6793) Updating files: 87% (5910/6793) Updating files: 88% (5978/6793) Updating files: 89% (6046/6793) Updating files: 90% (6114/6793) Updating files: 91% (6182/6793) Updating files: 92% (6250/6793) Updating files: 93% (6318/6793) Updating files: 94% (6386/6793) Updating files: 95% (6454/6793) Updating files: 96% (6522/6793) Updating files: 97% (6590/6793) Updating files: 98% (6658/6793) Updating files: 99% (6726/6793) Updating files: 100% (6793/6793) Updating files: 100% (6793/6793), done. 2022-09-07T19:45:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:06 smithi155 ceph-mon[97606]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:45:06.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:06 smithi080 ceph-mon[90124]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:45:06.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:06 smithi154 ceph-mon[96967]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:45:08.707 INFO:tasks.workunit.client.0.smithi080.stderr:Note: switching to '152194198413033811b31149de909a7ec5852a7f'. 2022-09-07T19:45:08.707 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.708 INFO:tasks.workunit.client.0.smithi080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-09-07T19:45:08.708 INFO:tasks.workunit.client.0.smithi080.stderr:changes and commit them, and you can discard any commits you make in this 2022-09-07T19:45:08.708 INFO:tasks.workunit.client.0.smithi080.stderr:state without impacting any branches by switching back to a branch. 2022-09-07T19:45:08.708 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.709 INFO:tasks.workunit.client.0.smithi080.stderr:If you want to create a new branch to retain commits you create, you may 2022-09-07T19:45:08.709 INFO:tasks.workunit.client.0.smithi080.stderr:do so (now or later) by using -c with the switch command. Example: 2022-09-07T19:45:08.710 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.710 INFO:tasks.workunit.client.0.smithi080.stderr: git switch -c 2022-09-07T19:45:08.710 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.710 INFO:tasks.workunit.client.0.smithi080.stderr:Or undo this operation with: 2022-09-07T19:45:08.710 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.711 INFO:tasks.workunit.client.0.smithi080.stderr: git switch - 2022-09-07T19:45:08.711 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.711 INFO:tasks.workunit.client.0.smithi080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-09-07T19:45:08.711 INFO:tasks.workunit.client.0.smithi080.stderr: 2022-09-07T19:45:08.712 INFO:tasks.workunit.client.0.smithi080.stderr:HEAD is now at 15219419841 Merge PR #46821 into wip-pdonnell-testing-20220907.015905 2022-09-07T19:45:08.757 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-09-07T19:45:08.822 INFO:tasks.workunit.client.0.smithi080.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-09-07T19:45:08.828 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-09-07T19:45:08.829 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-09-07T19:45:08.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:08 smithi080 ceph-mon[90124]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:45:08.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:08 smithi154 ceph-mon[96967]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:45:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:08 smithi155 ceph-mon[97606]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:45:09.571 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-09-07T19:45:09.675 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-09-07T19:45:09.755 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-09-07T19:45:09.760 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-09-07T19:45:09.760 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-09-07T19:45:09.839 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-09-07T19:45:09.851 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2022-09-07T19:45:09.852 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-09-07T19:45:09.910 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2022-09-07T19:45:09.912 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2022-09-07T19:45:09.912 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=152194198413033811b31149de909a7ec5852a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2022-09-07T19:45:09.988 INFO:tasks.workunit.client.0.smithi080.stdout:test large (16MB) dio write 2022-09-07T19:45:09.988 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test large (16MB) dio write' 2022-09-07T19:45:09.988 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2022-09-07T19:45:10.190 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2022-09-07T19:45:10.191 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2022-09-07T19:45:10.191 INFO:tasks.workunit.client.0.smithi080.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.19769 s, 84.9 MB/s 2022-09-07T19:45:10.195 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo OK 2022-09-07T19:45:10.196 INFO:tasks.workunit.client.0.smithi080.stdout:OK 2022-09-07T19:45:10.197 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-09-07T19:45:10.197 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-09-07T19:45:10.299 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2022-09-07T19:45:10.300 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=152194198413033811b31149de909a7ec5852a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2022-09-07T19:45:10.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:10 smithi080 ceph-mon[90124]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2022-09-07T19:45:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:10 smithi154 ceph-mon[96967]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2022-09-07T19:45:10.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:10 smithi155 ceph-mon[97606]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2022-09-07T19:45:12.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:12 smithi080 ceph-mon[90124]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 18 op/s 2022-09-07T19:45:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:12 smithi154 ceph-mon[96967]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 18 op/s 2022-09-07T19:45:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:12 smithi155 ceph-mon[97606]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 18 op/s 2022-09-07T19:45:14.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:14 smithi080 ceph-mon[90124]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 18 op/s 2022-09-07T19:45:14.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:14 smithi154 ceph-mon[96967]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 18 op/s 2022-09-07T19:45:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:14 smithi155 ceph-mon[97606]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 18 op/s 2022-09-07T19:45:16.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:16 smithi080 ceph-mon[90124]: pgmap v27: 129 pgs: 129 active+clean; 18 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 288 op/s 2022-09-07T19:45:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:16 smithi154 ceph-mon[96967]: pgmap v27: 129 pgs: 129 active+clean; 18 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 288 op/s 2022-09-07T19:45:16.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:16 smithi155 ceph-mon[97606]: pgmap v27: 129 pgs: 129 active+clean; 18 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 288 op/s 2022-09-07T19:45:18.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:18 smithi080 ceph-mon[90124]: pgmap v28: 129 pgs: 129 active+clean; 18 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 273 op/s 2022-09-07T19:45:18.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:18 smithi154 ceph-mon[96967]: pgmap v28: 129 pgs: 129 active+clean; 18 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 273 op/s 2022-09-07T19:45:18.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:18 smithi155 ceph-mon[97606]: pgmap v28: 129 pgs: 129 active+clean; 18 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 273 op/s 2022-09-07T19:45:19.999 INFO:tasks.workunit.client.0.smithi080.stdout:.......... 2022-09-07T19:45:20.000 INFO:tasks.workunit.client.0.smithi080.stdout:do_o_direct_reads: SUCCESS 2022-09-07T19:45:20.006 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-09-07T19:45:20.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-09-07T19:45:20.105 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2022-09-07T19:45:20.105 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=152194198413033811b31149de909a7ec5852a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2022-09-07T19:45:20.180 INFO:tasks.workunit.client.0.smithi080.stdout:test read from hole 2022-09-07T19:45:20.181 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test read from hole' 2022-09-07T19:45:20.181 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2022-09-07T19:45:20.184 INFO:tasks.workunit.client.0.smithi080.stderr:0+0 records in 2022-09-07T19:45:20.184 INFO:tasks.workunit.client.0.smithi080.stderr:0+0 records out 2022-09-07T19:45:20.184 INFO:tasks.workunit.client.0.smithi080.stderr:0 bytes copied, 9.1715e-05 s, 0.0 kB/s 2022-09-07T19:45:20.185 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2022-09-07T19:45:20.189 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records in 2022-09-07T19:45:20.190 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records out 2022-09-07T19:45:20.190 INFO:tasks.workunit.client.0.smithi080.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00245907 s, 416 kB/s 2022-09-07T19:45:20.190 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2022-09-07T19:45:20.192 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records in 2022-09-07T19:45:20.192 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records out 2022-09-07T19:45:20.193 INFO:tasks.workunit.client.0.smithi080.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000125458 s, 8.2 MB/s 2022-09-07T19:45:20.193 INFO:tasks.workunit.client.0.smithi080.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2022-09-07T19:45:20.195 INFO:tasks.workunit.client.0.smithi080.stdout:other thing 2022-09-07T19:45:20.196 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'other thing' 2022-09-07T19:45:20.196 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2022-09-07T19:45:20.198 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2022-09-07T19:45:20.198 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2022-09-07T19:45:20.199 INFO:tasks.workunit.client.0.smithi080.stderr:500 bytes copied, 0.000117102 s, 4.3 MB/s 2022-09-07T19:45:20.199 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2022-09-07T19:45:20.213 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records in 2022-09-07T19:45:20.214 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records out 2022-09-07T19:45:20.214 INFO:tasks.workunit.client.0.smithi080.stderr:500 bytes copied, 0.0114091 s, 43.8 kB/s 2022-09-07T19:45:20.214 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2022-09-07T19:45:20.221 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records in 2022-09-07T19:45:20.221 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records out 2022-09-07T19:45:20.222 INFO:tasks.workunit.client.0.smithi080.stderr:500 bytes copied, 0.00431079 s, 116 kB/s 2022-09-07T19:45:20.222 INFO:tasks.workunit.client.0.smithi080.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2022-09-07T19:45:20.224 INFO:tasks.workunit.client.0.smithi080.stdout:OK 2022-09-07T19:45:20.226 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo OK 2022-09-07T19:45:20.226 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-09-07T19:45:20.227 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-09-07T19:45:20.330 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2022-09-07T19:45:20.331 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=152194198413033811b31149de909a7ec5852a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2022-09-07T19:45:20.416 INFO:tasks.workunit.client.0.smithi080.stdout:writing first 3 bytes of 10k file 2022-09-07T19:45:20.417 INFO:tasks.workunit.client.0.smithi080.stdout:reading O_DIRECT 2022-09-07T19:45:20.417 INFO:tasks.workunit.client.0.smithi080.stdout:got 10000 2022-09-07T19:45:20.418 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-09-07T19:45:20.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-09-07T19:45:20.518 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2022-09-07T19:45:20.519 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=152194198413033811b31149de909a7ec5852a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2022-09-07T19:45:20.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:20 smithi080 ceph-mon[90124]: pgmap v29: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 800 op/s 2022-09-07T19:45:20.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:20 smithi154 ceph-mon[96967]: pgmap v29: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 800 op/s 2022-09-07T19:45:20.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:20 smithi155 ceph-mon[97606]: pgmap v29: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 800 op/s 2022-09-07T19:45:22.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:22 smithi080 ceph-mon[90124]: pgmap v30: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 797 op/s 2022-09-07T19:45:22.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:22 smithi154 ceph-mon[96967]: pgmap v30: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 797 op/s 2022-09-07T19:45:22.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:22 smithi155 ceph-mon[97606]: pgmap v30: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 797 op/s 2022-09-07T19:45:24.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:24 smithi080 ceph-mon[90124]: pgmap v31: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 797 op/s 2022-09-07T19:45:24.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:24 smithi154 ceph-mon[96967]: pgmap v31: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 797 op/s 2022-09-07T19:45:24.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:24 smithi155 ceph-mon[97606]: pgmap v31: 129 pgs: 129 active+clean; 1.7 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 797 op/s 2022-09-07T19:45:26.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:26 smithi080 ceph-mon[90124]: pgmap v32: 129 pgs: 129 active+clean; 1.9 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.4 MiB/s wr, 1.02k op/s 2022-09-07T19:45:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:26 smithi154 ceph-mon[96967]: pgmap v32: 129 pgs: 129 active+clean; 1.9 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.4 MiB/s wr, 1.02k op/s 2022-09-07T19:45:26.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:26 smithi155 ceph-mon[97606]: pgmap v32: 129 pgs: 129 active+clean; 1.9 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.4 MiB/s wr, 1.02k op/s 2022-09-07T19:45:27.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:45:27.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:27 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:45:27.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:45:27.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:27 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:45:27.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:45:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:27 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:45:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:45:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:27 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:45:27.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:45:27.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:27 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:45:27.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:45:27.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:27 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:45:28.224 INFO:tasks.workunit.client.0.smithi080.stdout:writing pattern 2022-09-07T19:45:28.224 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 1024 2022-09-07T19:45:28.224 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 1024 2022-09-07T19:45:28.224 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 1024 2022-09-07T19:45:28.225 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 1024 2022-09-07T19:45:28.225 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 2048 2022-09-07T19:45:28.225 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 2048 2022-09-07T19:45:28.225 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 2048 2022-09-07T19:45:28.226 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 2048 2022-09-07T19:45:28.226 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 4096 2022-09-07T19:45:28.226 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 4096 2022-09-07T19:45:28.226 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 4096 2022-09-07T19:45:28.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 4096 2022-09-07T19:45:28.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 8192 2022-09-07T19:45:28.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 8192 2022-09-07T19:45:28.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 8192 2022-09-07T19:45:28.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 8192 2022-09-07T19:45:28.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 16384 2022-09-07T19:45:28.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 16384 2022-09-07T19:45:28.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 16384 2022-09-07T19:45:28.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 16384 2022-09-07T19:45:28.229 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:28.229 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:28.229 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:28.229 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:28.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:28.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:28.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:28.231 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:28.231 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:28.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:28.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:28.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:28.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:28.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:28.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:28.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:28.234 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:28.234 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:28.234 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:28.234 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:28.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:28.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:28.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:28.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:28.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:28.236 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:28.236 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:28.236 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:28.236 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:28.238 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:28.238 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:28.238 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:28.238 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:28.239 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:28.239 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:28.239 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:28.239 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:28.240 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:28.240 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:28.240 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:28.241 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:28.241 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:28.241 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:28.241 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:28.242 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:28.242 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:28.243 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:28.243 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:28.243 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:28.243 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:28.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:28.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:28.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:28.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:28.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:28.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:28.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:28.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:28.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:28.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:28.246 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:28.246 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:28.283 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:28.283 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:28.283 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:28.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:28.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:28.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:28.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:28.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:28.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:28.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:28.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:28.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:28.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:28.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:28.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:28.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:28.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:28.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:28.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:28.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:28.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:28.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:28.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:28.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:28.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:28.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:28.290 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:28.290 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:28.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:28.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:28.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:28.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:28.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:28.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:28.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:28.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:28.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:28.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:28.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:28.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:28.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:28.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:28.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:28.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:28.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:28.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:28.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:28.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:28.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:28.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:28.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:28.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:28.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:28.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:28.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:28.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:28.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:28.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:28.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:28.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:28.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:28.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:28.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:28.300 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:28.300 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:28.300 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:28.301 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:28.301 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:28.301 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:28.302 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:28.302 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:28.302 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:28.302 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:28.303 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:28.303 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:28.303 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:28.303 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:28.303 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:28.304 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:28.304 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:28.304 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:28.304 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:28.305 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:28.305 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:28.305 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:28.305 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:28.305 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:28.306 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:28.321 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:28.321 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:28.321 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:28.321 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:28.322 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:28.322 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:28.322 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:28.322 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:28.323 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:28.323 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:28.324 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:28.324 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:28.325 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:28.325 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:28.326 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:28.326 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:28.326 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:28.326 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:28.327 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:28.327 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:28.327 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:28.327 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:28.328 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:28.328 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:28.329 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:28.329 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:28.329 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:28.329 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:28.330 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:28.330 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:28.330 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:28.330 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:28.331 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:28.331 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:28.331 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:28.331 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:28.332 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:28.332 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:28.332 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:28.332 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:28.332 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:28.333 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:28.333 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:28.333 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:28.334 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:28.334 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:28.335 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:28.335 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:28.335 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:28.335 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:28.336 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:28.336 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:28.336 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:28.336 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:28.337 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:28.337 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:28.337 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:28.337 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:28.338 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:28.338 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:28.338 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:28.339 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:28.339 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:28.339 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:28.339 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:28.340 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:28.340 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:28.340 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:28.340 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:28.341 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:28.341 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:28.341 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:28.341 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:28.342 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:28.342 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:28.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:28.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:28.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:28.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:28.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:28.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:28.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:28.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:28.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:28.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:28.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:28.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:28.360 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:28.360 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:28.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:28.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:28.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:28.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:28.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:28.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:28.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:28.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:28.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:28.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:28.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:28.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:28.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:28.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:28.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:28.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:28.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:28.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:28.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:28.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:28.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:28.366 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:28.366 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:28.366 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:28.366 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:28.367 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:28.367 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:28.367 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:28.368 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:28.368 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:28.368 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:28.368 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:28.369 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:28.369 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:28.369 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:28.369 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:28.370 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:28.370 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:28.370 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:28.370 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:28.371 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:28.371 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:28.371 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:28.371 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:28.371 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:28.372 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:28.372 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:28.372 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:28.372 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:28.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:28.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:28.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:28.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:28.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:28.374 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:28.374 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:28.374 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 1024 2022-09-07T19:45:28.374 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 1024 2022-09-07T19:45:28.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 1024 2022-09-07T19:45:28.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 1024 2022-09-07T19:45:28.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 2048 2022-09-07T19:45:28.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 2048 2022-09-07T19:45:28.376 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 2048 2022-09-07T19:45:28.376 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 2048 2022-09-07T19:45:28.376 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 4096 2022-09-07T19:45:28.376 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 4096 2022-09-07T19:45:28.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 4096 2022-09-07T19:45:28.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 4096 2022-09-07T19:45:28.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 8192 2022-09-07T19:45:28.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 8192 2022-09-07T19:45:28.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 8192 2022-09-07T19:45:28.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 8192 2022-09-07T19:45:28.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 16384 2022-09-07T19:45:28.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 16384 2022-09-07T19:45:28.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 16384 2022-09-07T19:45:28.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 16384 2022-09-07T19:45:28.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:28.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:28.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:28.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:28.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:28.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:28.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:28.381 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:28.381 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:28.415 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:28.415 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:28.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:28.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:28.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:28.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:28.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:28.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:28.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:28.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:28.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:28.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:28.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:28.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:28.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:28.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:28.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:28.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:28.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:28.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:28.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:28.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:28.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:28.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:28.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:28.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:28.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:28.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:28.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:28.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:28.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:28.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:28.423 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:28.423 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:28.423 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:28.423 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:28.423 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:28.424 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:28.424 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:28.424 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:28.424 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:28.424 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:28.425 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:28.425 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:28.425 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:28.425 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:28.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:28.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:28.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:28.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:28.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:28.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:28.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:28.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:28.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:28.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:28.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:28.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:28.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:28.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:28.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:28.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:28.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:28.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:28.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:28.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:28.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:28.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:28.431 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:28.431 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:28.431 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:28.431 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:28.432 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:28.432 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:28.432 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:28.432 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:28.432 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:28.433 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:28.433 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:28.433 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:28.433 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:28.434 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:28.434 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:28.434 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:28.465 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:28.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:28.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:28.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:28.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:28.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:28.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:28.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:28.468 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:28.468 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:28.469 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:28.469 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:28.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:28.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:28.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:28.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:28.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:28.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:28.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:28.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:28.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:28.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:28.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:28.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:28.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:28.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:28.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:28.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:28.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:28.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:28.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:28.476 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:28.476 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:28.477 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:28.477 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:28.478 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:28.478 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:28.478 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:28.478 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:28.479 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:28.479 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:28.479 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:28.479 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:28.480 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:28.480 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:28.480 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:28.481 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:28.481 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:28.482 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:28.482 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:28.483 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:28.483 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:28.484 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:28.484 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:28.484 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:28.485 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:28.485 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:28.486 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:28.486 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:28.486 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:28.486 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:28.487 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:28.487 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:28.487 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:28.488 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:28.488 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:28.488 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:28.489 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:28.489 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:28.490 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:28.490 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:28.490 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:28.490 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:28.491 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:28.491 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:28.491 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:28.491 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:28.491 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:28.492 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:28.492 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:28.492 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:28.492 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:28.493 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:28.493 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:28.497 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:28.497 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:28.498 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:28.498 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:28.498 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:28.498 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:28.499 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:28.499 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:28.499 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:28.500 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:28.500 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:28.500 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:28.500 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:28.500 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:28.501 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:28.501 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:28.501 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:28.501 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:28.502 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:28.502 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:28.502 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:28.502 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:28.502 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:28.503 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:28.503 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:28.503 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:28.503 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:28.504 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:28.504 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:28.504 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:28.504 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:28.504 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:28.505 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:28.505 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:28.505 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:28.506 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:28.506 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:28.506 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:28.506 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:28.506 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:28.507 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:28.507 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:28.507 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:28.508 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:28.508 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:28.508 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:28.508 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:28.508 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:28.509 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:28.509 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:28.509 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:28.509 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:28.510 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:28.510 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:28.510 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:28.510 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:28.511 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:28.511 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:28.511 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:28.511 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:28.511 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:28.512 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:28.512 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:28.512 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:28.512 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:28.512 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:28.513 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:28.513 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:28.513 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:28.513 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:28.514 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:28.514 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:28.514 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:28.514 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:28.514 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:28.515 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:28.515 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:28.515 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:28.515 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:28.516 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:28.516 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:28.516 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:28.516 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:28.516 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:28.538 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:28.538 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:28.539 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:28.539 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:28.539 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:28.539 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:28.540 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:28.540 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:28.540 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:28.540 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:28.540 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:28.541 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:28.541 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:28.541 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:28.541 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:28.542 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:28.542 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:28.542 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:28.542 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:28.542 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:28.543 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:28.543 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:28.543 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:28.543 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:28.544 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:28.544 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:28.544 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:28.544 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:28.544 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:28.545 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:28.545 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:28.545 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:28.545 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:28.546 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:28.546 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:28.546 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:28.546 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:28.546 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:28.547 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:28.547 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2022-09-07T19:45:28.547 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 1024 2022-09-07T19:45:28.547 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2022-09-07T19:45:28.548 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 1024 2022-09-07T19:45:28.548 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2022-09-07T19:45:28.548 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 2048 2022-09-07T19:45:28.548 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2022-09-07T19:45:28.548 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 2048 2022-09-07T19:45:28.549 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2022-09-07T19:45:28.549 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 4096 2022-09-07T19:45:28.549 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2022-09-07T19:45:28.549 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 4096 2022-09-07T19:45:28.550 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2022-09-07T19:45:28.550 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 8192 2022-09-07T19:45:28.550 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2022-09-07T19:45:28.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 8192 2022-09-07T19:45:28.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2022-09-07T19:45:28.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 16384 2022-09-07T19:45:28.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2022-09-07T19:45:28.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 16384 2022-09-07T19:45:28.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:28.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:28.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:28.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:28.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:28.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:28.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:28.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:28.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:28.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:28.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:28.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:28.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:28.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:28.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:28.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:28.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:28.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:28.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:28.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:28.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:28.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:28.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:28.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:28.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:28.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:28.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:28.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:28.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:28.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:28.595 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:28.595 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:28.595 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:28.595 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:28.596 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:28.596 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:28.596 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:28.596 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:28.597 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:28.597 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:28.597 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:28.597 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:28.598 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:28.598 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:28.598 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:28.598 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:28.599 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:28.599 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:28.599 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:28.599 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:28.600 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:28.600 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:28.600 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:28.600 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:28.600 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:28.601 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:28.601 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:28.601 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:28.601 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:28.602 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:28.602 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:28.602 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:28.603 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:28.603 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:28.603 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:28.603 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:28.604 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:28.604 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:28.604 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:28.604 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:28.605 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:28.605 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:28.606 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:28.606 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:28.606 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:28.606 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:28.607 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:28.607 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:28.607 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:28.607 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:28.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:28.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:28.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:28.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:28.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:28.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:28.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:28.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:28.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:28.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:28.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:28.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:28.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:28.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:28.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:28.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:28.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:28.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:28.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:28.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:28.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:28.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:28.641 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:28.642 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:28.642 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:28.642 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:28.643 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:28.643 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:28.643 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:28.644 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:28.644 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:28.644 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:28.645 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:28.645 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:28.645 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:28.645 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:28.646 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:28.646 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:28.646 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:28.647 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:28.647 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:28.648 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:28.648 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:28.648 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:28.649 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:28.649 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:28.650 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:28.650 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:28.650 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:28.651 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:28.651 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:28.652 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:28.652 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:28.653 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:28.653 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:28.654 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:28.654 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:28.655 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:28.656 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:28.656 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:28.656 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:28.657 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:28.657 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:28.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:28.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:28.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:28.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:28.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:28.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:28.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:28.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:28.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:28.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:28.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:28.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:28.664 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:28.664 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:28.665 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:28.665 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:28.666 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:28.666 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:28.666 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:28.667 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:28.667 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:28.668 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:28.668 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:28.668 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:28.669 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:28.669 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:28.670 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:28.670 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:28.670 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:28.671 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:28.671 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:28.672 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:28.672 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:28.673 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:28.673 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:28.673 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:28.674 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:28.674 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:28.674 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:28.674 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:28.675 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:28.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:28.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:28.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:28.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:28.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:28.683 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:28.683 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:28.683 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:28.683 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:28.684 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:28.684 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:28.684 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:28.684 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:28.684 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:28.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:28.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:28.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:28.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:28.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:28.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:28.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:28.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:28.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:28.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:28.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:28.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:28.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:28.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:28.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:28.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:28.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:28.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:28.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:28.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:28.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:28.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:28.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:28.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:28.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:28.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:28.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:28.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:28.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:28.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:28.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:28.692 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:28.692 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:28.692 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:28.692 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:28.692 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:28.693 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:28.693 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:28.693 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:28.693 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:28.693 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:28.694 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:28.694 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:28.694 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:28.694 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:28.695 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:28.695 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:28.695 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:28.695 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:28.695 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:28.696 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:28.696 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:28.696 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:28.696 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:28.696 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:28.697 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:28.697 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:28.697 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:28.697 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:28.697 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:28.698 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:28.698 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:28.698 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:28.698 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:28.699 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:28.699 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:28.699 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:28.699 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:28.700 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:28.725 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:28.726 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:28.726 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:28.726 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:28.726 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:28.727 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:28.727 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:28.727 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:28.727 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:28.727 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:28.729 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:28.729 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:28.729 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:28.729 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:28.729 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:28.730 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:28.730 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:28.730 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:28.730 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:28.731 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:28.731 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:28.731 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:28.731 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:28.731 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:28.732 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2022-09-07T19:45:28.732 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 1024 2022-09-07T19:45:28.732 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2022-09-07T19:45:28.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 1024 2022-09-07T19:45:28.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2022-09-07T19:45:28.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 2048 2022-09-07T19:45:28.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2022-09-07T19:45:28.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 2048 2022-09-07T19:45:28.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2022-09-07T19:45:28.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 4096 2022-09-07T19:45:28.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2022-09-07T19:45:28.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 4096 2022-09-07T19:45:28.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2022-09-07T19:45:28.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 8192 2022-09-07T19:45:28.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2022-09-07T19:45:28.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 8192 2022-09-07T19:45:28.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2022-09-07T19:45:28.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 16384 2022-09-07T19:45:28.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2022-09-07T19:45:28.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 16384 2022-09-07T19:45:28.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:28.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:28.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:28.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:28.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:28.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:28.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:28.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:28.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:28.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:28.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:28.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:28.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:28.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:28.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:28.740 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:28.740 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:28.740 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:28.740 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:28.741 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:28.741 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:28.741 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:28.742 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:28.742 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:28.742 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:28.742 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:28.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:28.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:28.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:28.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:28.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:28.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:28.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:28.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:28.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:28.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:28.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:28.783 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:28.783 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:28.783 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:28.784 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:28.784 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:28.784 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:28.784 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:28.785 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:28.785 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:28.785 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:28.785 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:28.785 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:28.786 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:28.786 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:28.786 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:28.786 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:28.787 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:28.787 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:28.787 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:28.787 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:28.787 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:28.788 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:28.788 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:28.788 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:28.788 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:28.788 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:28.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:28.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:28.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:28.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:28.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:28.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:28.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:28.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:28.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:28.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:28.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:28.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:28.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:28.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:28.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:28.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:28.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:28.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:28.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:28.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:28.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:28.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:28.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:28.806 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:28.806 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:28.807 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:28.807 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:28.807 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:28.807 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:28.808 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:28.808 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:28.808 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:28.808 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:28.809 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:28.809 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:28.809 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:28.809 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:28.809 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:28.810 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:28.810 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:28.810 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:28.810 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:28.811 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:28.811 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:28.811 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:28.811 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:28.811 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:28.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:28.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:28.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:28.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:28.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:28.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:28.824 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:28.825 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:28.825 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:28.825 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:28.826 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:28.826 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:28.826 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:28.826 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:28.827 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:28.827 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:28.827 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:28.828 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:28.828 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:28.828 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:28.828 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:28.829 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:28.829 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:28.829 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:28.829 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:28.829 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:28.830 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:28.830 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:28.830 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:28.830 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:28.831 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:28.831 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:28.831 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:28.831 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:28.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:28.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:28.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:28.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:28.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:28.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:28.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:28.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:28.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:28.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:28.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:28.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:28.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:28.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:28.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:28.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:28.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:28.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:28.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:28.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:28.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:28.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:28.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:28.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:28.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:28.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:28.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:28.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:28.839 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:28.839 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:28.839 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:28.839 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:28.840 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:28.840 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:28.840 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:28.840 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:28.840 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:28.841 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:28.841 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:28.841 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:28.841 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:28.841 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:28.842 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:28.842 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:28.842 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:28.842 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:28.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:28.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:28.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:28.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:28.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:28.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:28.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:28.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:28.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:28.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:28.858 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:28.858 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:28.858 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:28.858 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:28.859 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:28.859 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:28.859 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:28.860 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:28.860 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:28.860 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:28.860 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:28.860 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:28.861 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:28.861 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:28.861 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:28.861 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:28.862 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:28.862 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:28.862 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:28.862 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:28.863 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:28.863 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:28.863 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:28.863 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:28.864 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:28.864 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:28.864 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:28.864 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:28.864 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:28.865 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:28.865 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:28.865 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:28.866 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:28.866 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:28.866 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:28.866 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:28.866 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:28.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:28.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:28.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:28.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:28.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:28.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:28.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:28.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:28.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:28.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:28.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:28.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:28.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:28.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:28.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:28.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:28.873 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:28.873 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:28.874 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:28.874 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:28.874 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:28.875 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:28.875 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:28.876 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:28.876 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:28.877 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:28.877 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:28.878 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:28.878 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:28.879 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:28.879 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:28.879 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:28.880 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:28.880 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:28.880 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:28.881 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:28.881 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:28.882 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:28.882 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:28.882 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:28.883 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:28.883 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:28.883 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:28.883 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:28.884 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:28 smithi154 ceph-mon[96967]: pgmap v33: 129 pgs: 129 active+clean; 1.9 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.9 KiB/s wr, 745 op/s 2022-09-07T19:45:28.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:28 smithi080 ceph-mon[90124]: pgmap v33: 129 pgs: 129 active+clean; 1.9 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.9 KiB/s wr, 745 op/s 2022-09-07T19:45:28.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:28.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:28.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:28.905 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:28.905 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:28.905 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:28.905 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:28.905 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:28.906 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:28.906 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:28.906 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:28.907 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:28.907 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:28.907 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:28.908 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:28.908 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:28.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:28.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:28.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:28.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2022-09-07T19:45:28.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 1024 2022-09-07T19:45:28.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2022-09-07T19:45:28.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 1024 2022-09-07T19:45:28.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2022-09-07T19:45:28.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 2048 2022-09-07T19:45:28.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2022-09-07T19:45:28.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 2048 2022-09-07T19:45:28.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2022-09-07T19:45:28.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 4096 2022-09-07T19:45:28.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2022-09-07T19:45:28.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 4096 2022-09-07T19:45:28.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2022-09-07T19:45:28.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 8192 2022-09-07T19:45:28.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2022-09-07T19:45:28.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 8192 2022-09-07T19:45:28.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2022-09-07T19:45:28.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 16384 2022-09-07T19:45:28.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2022-09-07T19:45:28.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 16384 2022-09-07T19:45:28.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:28.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:28.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:28.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:28.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:28.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:28.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:28.916 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:28.916 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:28.916 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:28.916 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:28.917 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:28.917 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:28.917 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:28.918 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:28.918 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:28.918 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:28.918 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:28.919 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:28.919 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:28.919 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:28.919 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:28.920 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:28.920 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:28.920 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:28.920 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:28.920 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:28.921 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:28.921 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:28.921 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:28.921 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:28.922 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:28.922 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:28.922 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:28.922 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:28.922 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:28.923 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:28.923 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:28.923 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:28.924 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:28.924 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:28.924 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:28.924 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:28.925 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:28.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:28 smithi155 ceph-mon[97606]: pgmap v33: 129 pgs: 129 active+clean; 1.9 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.9 KiB/s wr, 745 op/s 2022-09-07T19:45:28.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:28.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:28.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:28.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:28.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:28.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:28.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:28.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:28.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:28.965 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:28.965 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:28.965 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:28.965 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:28.965 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:28.966 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:28.966 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:28.966 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:28.966 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:28.967 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:28.967 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:28.967 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:28.967 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:28.967 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:28.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:28.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:28.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:28.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:28.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:28.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:28.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:28.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:28.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:28.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:28.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:28.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:28.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:28.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:28.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:28.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:28.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:28.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:28.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:28.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:28.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:28.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:28.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:28.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:28.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:28.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:28.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:28.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:28.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:28.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:28.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:28.975 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:28.975 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:28.975 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:28.975 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:28.976 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:28.976 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:28.976 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:28.976 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:28.977 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:28.977 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:28.977 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:28.977 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:28.977 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:28.978 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:28.978 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:28.978 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:28.978 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:28.979 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:28.979 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:28.979 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:28.979 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:28.979 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:28.980 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:28.980 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:28.980 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:28.980 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:28.981 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:28.981 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:29.000 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:29.001 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:29.001 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:29.001 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:29.002 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:29.002 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:29.002 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:29.002 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:29.003 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:29.003 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:29.003 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:29.003 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:29.003 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:29.004 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:29.004 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:29.004 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:29.004 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:29.005 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:29.005 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:29.005 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:29.005 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:29.006 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:29.006 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:29.006 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:29.006 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:29.006 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:29.007 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:29.007 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:29.007 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:29.007 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:29.008 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:29.008 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:29.008 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:29.008 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:29.009 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:29.009 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:29.009 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:29.009 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:29.009 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:29.010 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:29.010 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:29.010 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:29.010 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:29.011 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:29.011 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:29.011 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:29.011 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:29.012 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:29.012 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:29.012 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:29.012 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:29.012 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:29.013 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:29.013 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:29.013 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:29.013 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:29.014 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:29.014 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:29.014 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:29.014 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:29.015 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:29.015 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:29.015 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:29.015 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:29.015 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:29.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:29.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:29.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:29.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:29.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:29.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:29.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:29.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:29.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:29.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:29.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:29.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:29.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:29.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:29.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:29.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:29.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:29.036 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:29.036 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:29.037 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:29.037 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:29.037 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:29.037 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:29.038 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:29.038 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:29.038 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:29.038 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:29.039 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:29.039 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:29.039 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:29.039 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:29.040 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:29.040 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:29.040 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:29.040 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:29.040 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:29.041 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:29.041 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:29.041 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:29.041 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:29.042 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:29.042 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:29.042 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:29.042 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:29.042 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:29.043 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:29.043 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:29.043 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:29.043 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:29.044 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:29.044 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:29.044 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:29.044 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:29.044 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:29.045 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:29.045 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:29.045 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:29.045 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:29.046 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:29.046 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:29.046 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:29.046 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:29.047 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:29.047 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:29.047 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:29.048 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:29.048 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:29.048 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:29.048 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:29.048 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:29.049 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:29.049 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:29.049 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:29.049 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:29.050 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:29.050 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:29.050 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:29.050 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:29.050 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:29.051 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:29.051 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:29.051 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:29.051 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:29.052 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:29.052 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:29.052 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:29.052 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:29.052 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:29.053 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:29.053 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:29.053 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:29.053 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:29.054 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:29.054 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:29.054 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:29.054 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:29.055 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:29.055 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:29.055 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:29.055 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:29.084 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:29.085 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:29.085 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:29.085 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:29.086 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:29.086 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:29.086 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:29.086 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:29.087 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:29.087 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2022-09-07T19:45:29.087 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 1024 2022-09-07T19:45:29.087 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2022-09-07T19:45:29.088 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 1024 2022-09-07T19:45:29.088 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2022-09-07T19:45:29.088 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 2048 2022-09-07T19:45:29.088 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2022-09-07T19:45:29.089 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 2048 2022-09-07T19:45:29.089 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2022-09-07T19:45:29.089 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 4096 2022-09-07T19:45:29.089 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2022-09-07T19:45:29.089 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 4096 2022-09-07T19:45:29.090 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2022-09-07T19:45:29.090 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 8192 2022-09-07T19:45:29.091 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2022-09-07T19:45:29.091 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 8192 2022-09-07T19:45:29.092 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2022-09-07T19:45:29.092 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 16384 2022-09-07T19:45:29.093 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2022-09-07T19:45:29.093 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 16384 2022-09-07T19:45:29.094 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:29.094 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:29.095 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:29.095 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:29.096 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:29.096 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:29.096 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:29.097 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:29.097 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:29.098 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:29.098 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:29.099 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:29.099 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:29.100 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:29.100 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:29.101 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:29.101 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:29.102 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:29.102 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:29.102 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:29.102 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:29.103 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:29.103 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:29.103 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:29.103 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:29.104 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:29.104 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:29.104 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:29.105 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:29.105 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:29.105 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:29.105 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:29.106 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:29.106 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:29.106 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:29.107 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:29.107 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:29.107 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:29.108 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:29.108 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:29.109 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:29.109 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:29.110 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:29.110 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:29.111 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:29.111 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:29.112 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:29.112 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:29.113 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:29.113 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:29.113 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:29.113 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:29.114 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:29.148 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:29.149 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:29.149 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:29.149 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:29.149 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:29.150 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:29.150 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:29.150 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:29.150 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:29.151 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:29.151 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:29.151 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:29.151 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:29.152 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:29.152 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:29.152 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:29.152 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:29.152 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:29.153 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:29.153 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:29.153 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:29.153 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:29.153 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:29.154 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:29.154 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:29.154 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:29.155 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:29.155 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:29.155 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:29.155 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:29.156 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:29.156 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:29.156 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:29.156 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:29.156 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:29.157 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:29.157 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:29.157 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:29.157 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:29.158 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:29.158 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:29.158 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:29.158 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:29.158 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:29.159 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:29.159 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:29.159 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:29.159 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:29.159 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:29.160 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:29.160 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:29.160 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:29.160 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:29.161 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:29.161 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:29.161 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:29.161 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:29.162 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:29.162 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:29.162 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:29.162 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:29.162 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:29.163 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:29.163 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:29.163 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:29.163 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:29.164 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:29.164 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:29.164 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:29.164 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:29.164 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:29.165 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:29.165 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:29.165 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:29.165 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:29.166 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:29.166 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:29.166 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:29.166 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:29.166 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:29.167 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:29.167 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:29.167 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:29.182 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:29.182 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:29.182 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:29.182 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:29.183 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:29.183 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:29.183 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:29.183 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:29.184 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:29.184 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:29.184 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:29.184 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:29.185 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:29.185 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:29.185 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:29.185 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:29.185 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:29.186 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:29.186 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:29.186 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:29.187 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:29.187 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:29.188 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:29.188 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:29.188 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:29.188 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:29.189 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:29.189 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:29.189 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:29.189 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:29.190 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:29.190 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:29.190 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:29.190 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:29.191 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:29.191 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:29.191 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:29.191 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:29.191 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:29.192 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:29.192 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:29.192 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:29.192 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:29.193 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:29.193 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:29.193 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:29.193 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:29.194 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:29.194 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:29.194 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:29.194 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:29.195 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:29.195 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:29.195 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:29.195 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:29.196 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:29.196 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:29.196 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:29.196 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:29.197 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:29.197 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:29.197 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:29.197 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:29.198 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:29.198 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:29.198 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:29.199 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:29.199 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:29.199 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:29.199 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:29.200 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:29.200 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:29.200 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:29.200 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:29.201 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:29.201 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:29.201 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:29.201 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:29.201 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:29.202 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:29.202 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:29.202 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:29.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:29.227 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:29.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:29.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:29.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:29.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:29.228 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:29.229 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:29.229 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:29.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:29.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:29.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:29.230 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:29.231 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:29.231 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:29.231 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:29.231 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:29.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:29.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:29.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:29.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:29.232 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:29.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:29.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:29.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:29.233 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:29.234 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:29.234 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:29.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:29.235 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:29.236 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:29.236 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:29.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:29.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:29.237 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:29.238 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:29.238 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:29.239 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:29.239 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:29.240 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:29.240 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:29.241 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:29.241 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:29.242 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:29.242 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:29.242 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:29.243 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:29.243 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:29.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:29.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:29.244 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:29.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:29.245 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:29.246 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:29.246 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:29.246 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:29.246 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:29.247 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:29.247 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:29.247 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:29.247 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:29.248 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:29.248 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:29.248 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:29.248 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:29.249 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:29.249 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:29.249 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:29.249 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:29.249 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:29.250 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:29.250 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:29.251 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:29.251 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:29.251 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:29.251 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:29.252 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:29.252 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:29.252 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:29.252 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:29.252 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:29.253 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:29.280 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2022-09-07T19:45:29.280 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 1024 2022-09-07T19:45:29.280 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2022-09-07T19:45:29.281 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 1024 2022-09-07T19:45:29.281 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2022-09-07T19:45:29.281 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 2048 2022-09-07T19:45:29.281 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2022-09-07T19:45:29.282 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 2048 2022-09-07T19:45:29.282 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2022-09-07T19:45:29.282 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 4096 2022-09-07T19:45:29.283 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2022-09-07T19:45:29.283 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 4096 2022-09-07T19:45:29.283 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2022-09-07T19:45:29.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 8192 2022-09-07T19:45:29.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2022-09-07T19:45:29.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 8192 2022-09-07T19:45:29.284 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2022-09-07T19:45:29.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 16384 2022-09-07T19:45:29.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2022-09-07T19:45:29.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 16384 2022-09-07T19:45:29.285 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:29.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:29.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:29.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:29.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:29.286 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:29.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:29.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:29.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:29.287 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:29.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:29.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:29.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:29.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:29.288 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:29.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:29.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:29.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:29.289 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:29.290 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:29.290 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:29.290 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:29.290 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:29.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:29.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:29.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:29.291 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:29.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:29.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:29.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:29.292 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:29.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:29.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:29.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:29.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:29.293 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:29.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:29.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:29.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:29.294 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:29.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:29.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:29.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:29.295 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:29.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:29.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:29.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:29.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:29.296 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:29.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:29.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:29.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:29.297 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:29.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:29.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:29.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:29.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:29.298 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:29.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:29.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:29.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:29.299 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:29.300 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:29.340 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:29.341 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:29.341 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:29.342 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:29.342 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:29.342 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:29.342 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:29.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:29.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:29.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:29.343 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:29.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:29.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:29.344 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:29.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:29.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:29.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:29.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:29.345 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:29.346 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:29.347 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:29.347 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:29.347 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:29.347 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:29.348 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:29.348 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:29.348 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:29.349 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:29.349 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:29.349 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:29.350 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:29.350 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:29.350 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:29.351 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:29.351 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:29.351 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:29.351 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:29.352 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:29.352 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:29.352 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:29.352 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:29.353 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:29.353 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:29.354 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:29.355 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:29.355 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:29.356 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:29.356 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:29.357 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:29.357 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:29.358 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:29.358 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:29.358 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:29.359 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:29.359 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:29.359 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:29.359 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:29.360 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:29.360 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:29.360 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:29.360 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:29.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:29.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:29.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:29.361 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:29.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:29.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:29.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:29.362 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:29.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:29.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:29.363 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:29.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:29.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:29.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:29.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:29.364 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:29.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:29.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:29.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:29.365 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:29.366 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:29.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:29.373 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:29.374 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:29.374 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:29.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:29.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:29.375 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:29.376 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:29.376 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:29.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:29.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:29.377 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:29.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:29.378 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:29.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:29.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:29.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:29.379 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:29.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:29.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:29.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:29.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:29.380 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:29.381 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:29.381 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:29.381 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:29.381 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:29.382 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:29.382 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:29.382 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:29.383 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:29.383 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:29.383 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:29.383 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:29.384 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:29.384 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:29.384 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:29.385 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:29.385 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:29.385 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:29.385 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:29.386 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:29.386 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:29.386 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:29.386 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:29.387 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:29.387 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:29.387 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:29.387 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:29.388 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:29.388 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:29.388 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:29.388 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:29.389 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:29.389 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:29.389 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:29.390 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:29.390 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:29.390 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:29.391 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:29.391 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:29.391 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:29.392 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:29.392 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:29.393 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:29.393 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:29.393 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:29.394 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:29.394 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:29.395 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:29.395 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:29.396 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:29.396 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:29.397 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:29.397 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:29.397 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:29.398 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:29.398 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:29.399 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:29.399 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:29.400 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:29.400 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:29.401 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:29.406 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:29.406 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:29.406 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:29.407 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:29.407 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:29.407 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:29.408 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:29.408 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:29.408 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:29.409 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:29.409 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:29.409 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:29.409 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:29.410 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:29.410 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:29.411 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:29.411 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:29.412 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:29.412 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:29.412 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:29.413 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:29.413 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:29.413 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:29.413 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:29.414 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:29.414 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:29.414 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:29.414 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:29.414 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:29.415 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:29.415 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:29.415 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:29.415 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2022-09-07T19:45:29.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 1024 2022-09-07T19:45:29.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2022-09-07T19:45:29.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 1024 2022-09-07T19:45:29.416 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2022-09-07T19:45:29.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 2048 2022-09-07T19:45:29.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2022-09-07T19:45:29.417 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 2048 2022-09-07T19:45:29.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2022-09-07T19:45:29.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 4096 2022-09-07T19:45:29.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2022-09-07T19:45:29.418 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 4096 2022-09-07T19:45:29.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2022-09-07T19:45:29.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 8192 2022-09-07T19:45:29.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2022-09-07T19:45:29.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 8192 2022-09-07T19:45:29.419 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2022-09-07T19:45:29.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 16384 2022-09-07T19:45:29.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2022-09-07T19:45:29.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 16384 2022-09-07T19:45:29.420 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2022-09-07T19:45:29.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 1024 2022-09-07T19:45:29.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2022-09-07T19:45:29.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 1024 2022-09-07T19:45:29.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2022-09-07T19:45:29.421 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 2048 2022-09-07T19:45:29.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2022-09-07T19:45:29.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 2048 2022-09-07T19:45:29.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2022-09-07T19:45:29.422 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 4096 2022-09-07T19:45:29.423 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2022-09-07T19:45:29.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 4096 2022-09-07T19:45:29.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2022-09-07T19:45:29.426 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 8192 2022-09-07T19:45:29.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2022-09-07T19:45:29.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 8192 2022-09-07T19:45:29.427 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2022-09-07T19:45:29.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 16384 2022-09-07T19:45:29.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2022-09-07T19:45:29.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 16384 2022-09-07T19:45:29.428 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2022-09-07T19:45:29.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 1024 2022-09-07T19:45:29.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2022-09-07T19:45:29.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 1024 2022-09-07T19:45:29.429 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2022-09-07T19:45:29.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 2048 2022-09-07T19:45:29.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2022-09-07T19:45:29.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 2048 2022-09-07T19:45:29.430 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2022-09-07T19:45:29.431 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 4096 2022-09-07T19:45:29.457 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2022-09-07T19:45:29.458 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 4096 2022-09-07T19:45:29.458 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2022-09-07T19:45:29.458 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 8192 2022-09-07T19:45:29.458 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2022-09-07T19:45:29.459 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 8192 2022-09-07T19:45:29.459 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2022-09-07T19:45:29.459 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 16384 2022-09-07T19:45:29.460 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2022-09-07T19:45:29.460 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 16384 2022-09-07T19:45:29.460 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2022-09-07T19:45:29.460 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 1024 2022-09-07T19:45:29.461 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2022-09-07T19:45:29.461 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 1024 2022-09-07T19:45:29.461 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2022-09-07T19:45:29.461 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 2048 2022-09-07T19:45:29.461 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2022-09-07T19:45:29.462 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 2048 2022-09-07T19:45:29.462 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2022-09-07T19:45:29.462 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 4096 2022-09-07T19:45:29.462 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2022-09-07T19:45:29.463 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 4096 2022-09-07T19:45:29.463 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2022-09-07T19:45:29.463 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 8192 2022-09-07T19:45:29.463 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2022-09-07T19:45:29.463 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 8192 2022-09-07T19:45:29.464 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2022-09-07T19:45:29.464 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 16384 2022-09-07T19:45:29.464 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2022-09-07T19:45:29.464 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 16384 2022-09-07T19:45:29.465 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2022-09-07T19:45:29.465 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 1024 2022-09-07T19:45:29.465 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2022-09-07T19:45:29.465 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 1024 2022-09-07T19:45:29.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2022-09-07T19:45:29.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 2048 2022-09-07T19:45:29.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2022-09-07T19:45:29.466 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 2048 2022-09-07T19:45:29.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2022-09-07T19:45:29.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 4096 2022-09-07T19:45:29.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2022-09-07T19:45:29.467 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 4096 2022-09-07T19:45:29.468 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2022-09-07T19:45:29.468 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 8192 2022-09-07T19:45:29.468 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2022-09-07T19:45:29.468 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 8192 2022-09-07T19:45:29.469 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2022-09-07T19:45:29.469 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 16384 2022-09-07T19:45:29.469 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2022-09-07T19:45:29.469 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 16384 2022-09-07T19:45:29.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2022-09-07T19:45:29.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 1024 2022-09-07T19:45:29.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2022-09-07T19:45:29.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 1024 2022-09-07T19:45:29.470 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2022-09-07T19:45:29.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 2048 2022-09-07T19:45:29.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2022-09-07T19:45:29.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 2048 2022-09-07T19:45:29.471 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2022-09-07T19:45:29.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 4096 2022-09-07T19:45:29.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2022-09-07T19:45:29.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 4096 2022-09-07T19:45:29.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2022-09-07T19:45:29.472 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 8192 2022-09-07T19:45:29.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2022-09-07T19:45:29.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 8192 2022-09-07T19:45:29.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2022-09-07T19:45:29.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 16384 2022-09-07T19:45:29.473 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2022-09-07T19:45:29.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 16384 2022-09-07T19:45:29.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2022-09-07T19:45:29.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 1024 2022-09-07T19:45:29.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2022-09-07T19:45:29.474 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 1024 2022-09-07T19:45:29.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2022-09-07T19:45:29.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 2048 2022-09-07T19:45:29.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2022-09-07T19:45:29.475 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 2048 2022-09-07T19:45:29.476 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2022-09-07T19:45:29.476 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 4096 2022-09-07T19:45:29.476 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2022-09-07T19:45:29.477 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 4096 2022-09-07T19:45:29.477 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2022-09-07T19:45:29.517 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 8192 2022-09-07T19:45:29.517 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2022-09-07T19:45:29.517 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 8192 2022-09-07T19:45:29.518 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2022-09-07T19:45:29.518 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 16384 2022-09-07T19:45:29.518 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2022-09-07T19:45:29.518 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 16384 2022-09-07T19:45:29.519 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2022-09-07T19:45:29.519 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 1024 2022-09-07T19:45:29.519 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2022-09-07T19:45:29.519 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 1024 2022-09-07T19:45:29.519 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2022-09-07T19:45:29.520 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 2048 2022-09-07T19:45:29.520 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2022-09-07T19:45:29.520 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 2048 2022-09-07T19:45:29.520 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2022-09-07T19:45:29.520 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 4096 2022-09-07T19:45:29.521 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2022-09-07T19:45:29.521 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 4096 2022-09-07T19:45:29.521 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2022-09-07T19:45:29.521 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 8192 2022-09-07T19:45:29.522 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2022-09-07T19:45:29.522 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 8192 2022-09-07T19:45:29.522 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2022-09-07T19:45:29.522 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 16384 2022-09-07T19:45:29.522 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2022-09-07T19:45:29.523 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 16384 2022-09-07T19:45:29.523 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2022-09-07T19:45:29.523 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 1024 2022-09-07T19:45:29.523 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2022-09-07T19:45:29.523 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 1024 2022-09-07T19:45:29.524 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2022-09-07T19:45:29.524 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 2048 2022-09-07T19:45:29.524 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2022-09-07T19:45:29.524 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 2048 2022-09-07T19:45:29.525 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2022-09-07T19:45:29.525 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 4096 2022-09-07T19:45:29.525 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2022-09-07T19:45:29.525 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 4096 2022-09-07T19:45:29.525 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2022-09-07T19:45:29.526 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 8192 2022-09-07T19:45:29.526 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2022-09-07T19:45:29.526 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 8192 2022-09-07T19:45:29.526 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2022-09-07T19:45:29.526 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 16384 2022-09-07T19:45:29.527 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2022-09-07T19:45:29.527 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 16384 2022-09-07T19:45:29.527 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2022-09-07T19:45:29.527 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 1024 2022-09-07T19:45:29.528 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2022-09-07T19:45:29.528 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 1024 2022-09-07T19:45:29.528 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2022-09-07T19:45:29.528 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 2048 2022-09-07T19:45:29.528 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2022-09-07T19:45:29.529 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 2048 2022-09-07T19:45:29.529 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2022-09-07T19:45:29.529 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 4096 2022-09-07T19:45:29.529 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2022-09-07T19:45:29.530 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 4096 2022-09-07T19:45:29.530 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2022-09-07T19:45:29.530 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 8192 2022-09-07T19:45:29.530 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2022-09-07T19:45:29.530 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 8192 2022-09-07T19:45:29.531 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2022-09-07T19:45:29.531 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 16384 2022-09-07T19:45:29.531 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2022-09-07T19:45:29.531 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 16384 2022-09-07T19:45:29.531 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2022-09-07T19:45:29.532 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 1024 2022-09-07T19:45:29.532 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2022-09-07T19:45:29.532 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 1024 2022-09-07T19:45:29.532 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2022-09-07T19:45:29.532 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 2048 2022-09-07T19:45:29.533 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2022-09-07T19:45:29.533 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 2048 2022-09-07T19:45:29.533 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2022-09-07T19:45:29.533 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 4096 2022-09-07T19:45:29.534 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2022-09-07T19:45:29.534 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 4096 2022-09-07T19:45:29.534 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2022-09-07T19:45:29.534 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 8192 2022-09-07T19:45:29.534 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2022-09-07T19:45:29.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 8192 2022-09-07T19:45:29.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2022-09-07T19:45:29.551 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 16384 2022-09-07T19:45:29.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2022-09-07T19:45:29.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 16384 2022-09-07T19:45:29.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2022-09-07T19:45:29.552 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 1024 2022-09-07T19:45:29.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2022-09-07T19:45:29.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 1024 2022-09-07T19:45:29.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2022-09-07T19:45:29.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 2048 2022-09-07T19:45:29.553 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2022-09-07T19:45:29.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 2048 2022-09-07T19:45:29.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2022-09-07T19:45:29.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 4096 2022-09-07T19:45:29.554 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2022-09-07T19:45:29.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 4096 2022-09-07T19:45:29.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2022-09-07T19:45:29.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 8192 2022-09-07T19:45:29.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2022-09-07T19:45:29.555 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 8192 2022-09-07T19:45:29.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2022-09-07T19:45:29.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 16384 2022-09-07T19:45:29.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2022-09-07T19:45:29.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 16384 2022-09-07T19:45:29.556 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2022-09-07T19:45:29.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 1024 2022-09-07T19:45:29.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2022-09-07T19:45:29.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 1024 2022-09-07T19:45:29.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2022-09-07T19:45:29.557 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 2048 2022-09-07T19:45:29.558 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2022-09-07T19:45:29.558 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 2048 2022-09-07T19:45:29.558 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2022-09-07T19:45:29.558 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 4096 2022-09-07T19:45:29.559 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2022-09-07T19:45:29.559 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 4096 2022-09-07T19:45:29.559 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2022-09-07T19:45:29.559 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 8192 2022-09-07T19:45:29.559 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2022-09-07T19:45:29.560 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 8192 2022-09-07T19:45:29.560 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2022-09-07T19:45:29.560 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 16384 2022-09-07T19:45:29.560 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2022-09-07T19:45:29.561 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 16384 2022-09-07T19:45:29.561 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2022-09-07T19:45:29.561 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 1024 2022-09-07T19:45:29.561 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2022-09-07T19:45:29.561 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 1024 2022-09-07T19:45:29.562 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2022-09-07T19:45:29.562 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 2048 2022-09-07T19:45:29.562 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2022-09-07T19:45:29.562 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 2048 2022-09-07T19:45:29.562 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2022-09-07T19:45:29.563 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 4096 2022-09-07T19:45:29.563 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2022-09-07T19:45:29.563 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 4096 2022-09-07T19:45:29.563 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2022-09-07T19:45:29.564 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 8192 2022-09-07T19:45:29.564 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2022-09-07T19:45:29.564 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 8192 2022-09-07T19:45:29.564 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2022-09-07T19:45:29.564 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 16384 2022-09-07T19:45:29.565 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2022-09-07T19:45:29.565 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 16384 2022-09-07T19:45:29.565 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2022-09-07T19:45:29.565 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 1024 2022-09-07T19:45:29.565 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2022-09-07T19:45:29.566 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 1024 2022-09-07T19:45:29.566 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2022-09-07T19:45:29.566 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 2048 2022-09-07T19:45:29.566 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2022-09-07T19:45:29.567 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 2048 2022-09-07T19:45:29.567 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2022-09-07T19:45:29.567 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 4096 2022-09-07T19:45:29.567 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2022-09-07T19:45:29.567 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 4096 2022-09-07T19:45:29.568 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2022-09-07T19:45:29.568 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 8192 2022-09-07T19:45:29.568 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2022-09-07T19:45:29.568 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 8192 2022-09-07T19:45:29.568 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2022-09-07T19:45:30.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 16384 2022-09-07T19:45:30.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2022-09-07T19:45:30.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 16384 2022-09-07T19:45:30.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2022-09-07T19:45:30.022 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 1024 2022-09-07T19:45:30.022 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2022-09-07T19:45:30.022 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 1024 2022-09-07T19:45:30.022 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2022-09-07T19:45:30.023 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 2048 2022-09-07T19:45:30.023 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2022-09-07T19:45:30.023 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 2048 2022-09-07T19:45:30.023 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2022-09-07T19:45:30.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 4096 2022-09-07T19:45:30.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2022-09-07T19:45:30.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 4096 2022-09-07T19:45:30.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2022-09-07T19:45:30.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 8192 2022-09-07T19:45:30.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2022-09-07T19:45:30.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 8192 2022-09-07T19:45:30.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2022-09-07T19:45:30.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 16384 2022-09-07T19:45:30.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2022-09-07T19:45:30.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 16384 2022-09-07T19:45:30.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2022-09-07T19:45:30.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 1024 2022-09-07T19:45:30.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2022-09-07T19:45:30.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 1024 2022-09-07T19:45:30.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2022-09-07T19:45:30.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 2048 2022-09-07T19:45:30.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2022-09-07T19:45:30.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 2048 2022-09-07T19:45:30.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2022-09-07T19:45:30.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 4096 2022-09-07T19:45:30.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2022-09-07T19:45:30.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 4096 2022-09-07T19:45:30.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2022-09-07T19:45:30.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 8192 2022-09-07T19:45:30.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2022-09-07T19:45:30.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 8192 2022-09-07T19:45:30.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2022-09-07T19:45:30.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 16384 2022-09-07T19:45:30.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2022-09-07T19:45:30.031 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 16384 2022-09-07T19:45:30.031 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2022-09-07T19:45:30.031 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 1024 2022-09-07T19:45:30.031 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2022-09-07T19:45:30.031 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 1024 2022-09-07T19:45:30.032 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2022-09-07T19:45:30.032 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 2048 2022-09-07T19:45:30.032 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2022-09-07T19:45:30.032 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 2048 2022-09-07T19:45:30.033 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2022-09-07T19:45:30.033 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 4096 2022-09-07T19:45:30.033 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2022-09-07T19:45:30.033 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 4096 2022-09-07T19:45:30.033 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2022-09-07T19:45:30.034 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 8192 2022-09-07T19:45:30.034 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2022-09-07T19:45:30.034 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 8192 2022-09-07T19:45:30.034 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2022-09-07T19:45:30.034 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 16384 2022-09-07T19:45:30.035 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2022-09-07T19:45:30.035 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 16384 2022-09-07T19:45:30.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:30.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:30.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:30.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 1024 2022-09-07T19:45:30.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:30.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:30.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:30.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 2048 2022-09-07T19:45:30.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:30.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:30.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:30.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 4096 2022-09-07T19:45:30.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:30.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:30.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:30.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 8192 2022-09-07T19:45:30.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:30.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:30.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:30.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 16384 2022-09-07T19:45:30.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:30.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:30 smithi080 ceph-mon[90124]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 KiB/s wr, 750 op/s 2022-09-07T19:45:30.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:30 smithi154 ceph-mon[96967]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 KiB/s wr, 750 op/s 2022-09-07T19:45:30.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:30 smithi155 ceph-mon[97606]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 KiB/s wr, 750 op/s 2022-09-07T19:45:31.715 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:31.715 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:31.715 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 1024 2022-09-07T19:45:31.716 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:31.716 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:31.716 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:31.716 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 2048 2022-09-07T19:45:31.717 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:31.717 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:31.718 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:31.719 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 4096 2022-09-07T19:45:31.719 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:31.719 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:31.720 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:31.720 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 8192 2022-09-07T19:45:31.721 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:31.721 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:31.722 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:31.722 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 16384 2022-09-07T19:45:31.723 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:31.723 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:31.724 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:31.724 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 1024 2022-09-07T19:45:31.724 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:31.725 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:31.725 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:31.726 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 2048 2022-09-07T19:45:31.726 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:31.726 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:31.727 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:31.727 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 4096 2022-09-07T19:45:31.728 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:31.728 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:31.729 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:31.729 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 8192 2022-09-07T19:45:31.729 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:31.730 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:31.730 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:31.731 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 16384 2022-09-07T19:45:31.731 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:31.732 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:31.732 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:31.733 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 1024 2022-09-07T19:45:31.733 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:31.733 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:31.734 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:31.734 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 2048 2022-09-07T19:45:31.735 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:31.735 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:31.735 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:31.736 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 4096 2022-09-07T19:45:31.736 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:31.736 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:31.737 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:31.737 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 8192 2022-09-07T19:45:31.737 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:31.738 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:31.738 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:31.738 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 16384 2022-09-07T19:45:31.739 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:31.739 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:31.739 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:31.739 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 1024 2022-09-07T19:45:31.740 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:31.740 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:31.740 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:31.740 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 2048 2022-09-07T19:45:31.740 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:31.741 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:31.741 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:31.741 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 4096 2022-09-07T19:45:31.741 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:31.742 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:31.742 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:31.742 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 8192 2022-09-07T19:45:31.742 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:31.742 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:31.743 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:31.743 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 16384 2022-09-07T19:45:31.743 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:31.743 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:31.743 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:31.744 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 1024 2022-09-07T19:45:31.744 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:31.744 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:31.745 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:32.822 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 2048 2022-09-07T19:45:32.823 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:32.823 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:32.823 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:32.823 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 4096 2022-09-07T19:45:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 8192 2022-09-07T19:45:32.825 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:32.825 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:32.825 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:32.825 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 16384 2022-09-07T19:45:32.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:32.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:32.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:32.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 1024 2022-09-07T19:45:32.827 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:32.827 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:32.836 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:32.836 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 2048 2022-09-07T19:45:32.837 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:32.837 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:32.837 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:32.837 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 4096 2022-09-07T19:45:32.838 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:32.838 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:32.838 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:32.838 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 8192 2022-09-07T19:45:32.839 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:32.839 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:32.839 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:32.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 16384 2022-09-07T19:45:32.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:32.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:32.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:32.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 1024 2022-09-07T19:45:32.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:32.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:32.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:32.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 2048 2022-09-07T19:45:32.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:32.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:32.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:32.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 4096 2022-09-07T19:45:32.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:32.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:32.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:32.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 8192 2022-09-07T19:45:32.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:32.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:32.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:32.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 16384 2022-09-07T19:45:32.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:32.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:32.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:32.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 1024 2022-09-07T19:45:32.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:32.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:32.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:32.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 2048 2022-09-07T19:45:32.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:32.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:32.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:32.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 4096 2022-09-07T19:45:32.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:32.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:32.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:32.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 8192 2022-09-07T19:45:32.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:32.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:32.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:32.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 16384 2022-09-07T19:45:32.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:32.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:32.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:32.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 1024 2022-09-07T19:45:32.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:32.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:32.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:32.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 2048 2022-09-07T19:45:32.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:32.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:32.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:32.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 4096 2022-09-07T19:45:32.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:32 smithi080 ceph-mon[90124]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 10 KiB/s wr, 223 op/s 2022-09-07T19:45:32.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:32 smithi154 ceph-mon[96967]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 10 KiB/s wr, 223 op/s 2022-09-07T19:45:32.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:32 smithi155 ceph-mon[97606]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 10 KiB/s wr, 223 op/s 2022-09-07T19:45:33.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:33.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:33.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:33.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 8192 2022-09-07T19:45:33.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:33.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:33.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:33.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 16384 2022-09-07T19:45:33.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:33.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:33.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:33.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 1024 2022-09-07T19:45:33.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:33.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:33.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:33.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 2048 2022-09-07T19:45:33.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:33.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:33.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:33.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 4096 2022-09-07T19:45:33.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:33.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:33.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:33.495 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 8192 2022-09-07T19:45:33.495 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:33.495 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:33.495 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:33.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 16384 2022-09-07T19:45:33.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:33.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:33.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:33.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 1024 2022-09-07T19:45:33.497 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:33.497 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:33.497 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:33.497 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 2048 2022-09-07T19:45:33.497 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:33.498 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:33.498 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:33.498 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 4096 2022-09-07T19:45:33.498 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:33.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:33.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:33.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 8192 2022-09-07T19:45:33.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:33.500 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:33.500 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:33.500 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 16384 2022-09-07T19:45:33.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:33.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:33.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:33.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 1024 2022-09-07T19:45:33.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:33.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:33.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:33.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 2048 2022-09-07T19:45:33.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:33.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:33.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:33.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 4096 2022-09-07T19:45:33.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:33.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:33.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:33.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 8192 2022-09-07T19:45:33.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:33.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:33.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:33.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 16384 2022-09-07T19:45:33.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:33.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:33.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:33.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 1024 2022-09-07T19:45:33.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:33.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:33.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:33.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 2048 2022-09-07T19:45:33.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:33.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:33.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:33.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 4096 2022-09-07T19:45:33.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:33.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:33.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:33.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 8192 2022-09-07T19:45:33.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:33.509 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:34.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:34 smithi080 ceph-mon[90124]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 10 KiB/s wr, 223 op/s 2022-09-07T19:45:34.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:34 smithi154 ceph-mon[96967]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 10 KiB/s wr, 223 op/s 2022-09-07T19:45:34.874 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:34.874 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 16384 2022-09-07T19:45:34.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:34.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:34.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:34.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 1024 2022-09-07T19:45:34.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:34.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:34.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:34.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 2048 2022-09-07T19:45:34.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:34.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:34.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:34.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 4096 2022-09-07T19:45:34.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:34.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:34.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:34.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 8192 2022-09-07T19:45:34.879 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:34.879 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:34.879 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:34.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 16384 2022-09-07T19:45:34.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:34.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:34.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:34.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 1024 2022-09-07T19:45:34.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:34.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:34.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:34.882 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 2048 2022-09-07T19:45:34.882 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:34.882 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:34.883 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:34.883 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 4096 2022-09-07T19:45:34.883 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:34.883 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:34.884 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:34.884 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 8192 2022-09-07T19:45:34.885 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:34.885 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:34.885 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:34.886 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 16384 2022-09-07T19:45:34.886 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:34.886 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:34.887 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:34.887 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 1024 2022-09-07T19:45:34.887 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:34.887 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:34.888 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:34.888 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 2048 2022-09-07T19:45:34.888 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:34.888 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:34.889 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:34.889 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 4096 2022-09-07T19:45:34.889 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:34.889 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:34.890 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:34.890 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 8192 2022-09-07T19:45:34.891 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:34.891 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:34.892 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:34.892 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 16384 2022-09-07T19:45:34.892 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:34.893 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:34.893 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:34.893 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 1024 2022-09-07T19:45:34.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:34.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:34.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:34.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 2048 2022-09-07T19:45:34.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:34.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:34.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:34.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 4096 2022-09-07T19:45:34.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:34.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:34.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:34.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 8192 2022-09-07T19:45:34.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:34.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:34.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:34.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 16384 2022-09-07T19:45:34.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:34.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:34.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:34 smithi155 ceph-mon[97606]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 10 KiB/s wr, 223 op/s 2022-09-07T19:45:36.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:36.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 1024 2022-09-07T19:45:36.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:36.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:36.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:36.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 2048 2022-09-07T19:45:36.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:36.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:36.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:36.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 4096 2022-09-07T19:45:36.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:36.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:36.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:36.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 8192 2022-09-07T19:45:36.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:36.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:36.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:36.509 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 16384 2022-09-07T19:45:36.509 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:36.509 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:36.509 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:36.510 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 1024 2022-09-07T19:45:36.510 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:36.510 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:36.510 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:36.511 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 2048 2022-09-07T19:45:36.511 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:36.511 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:36.511 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:36.511 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 4096 2022-09-07T19:45:36.512 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:36.512 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:36.512 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:36.512 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 8192 2022-09-07T19:45:36.513 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:36.513 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:36.513 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:36.513 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 16384 2022-09-07T19:45:36.513 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:36.514 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:36.514 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:36.514 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 1024 2022-09-07T19:45:36.514 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:36.514 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:36.515 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:36.515 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 2048 2022-09-07T19:45:36.515 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:36.516 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:36.516 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:36.516 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 4096 2022-09-07T19:45:36.516 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:36.517 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:36.517 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:36.517 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 8192 2022-09-07T19:45:36.517 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:36.518 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:36.518 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:36.518 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 16384 2022-09-07T19:45:36.519 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:36.519 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:36.519 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:36.520 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 1024 2022-09-07T19:45:36.520 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:36.520 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:36.520 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:36.521 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 2048 2022-09-07T19:45:36.521 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:36.521 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:36.521 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:36.521 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 4096 2022-09-07T19:45:36.522 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:36.522 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:36.522 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:36.522 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 8192 2022-09-07T19:45:36.523 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:36.523 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:36.523 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:36.523 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 16384 2022-09-07T19:45:36.523 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:36.524 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:36.524 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:36.524 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 1024 2022-09-07T19:45:36.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:36 smithi080 ceph-mon[90124]: pgmap v37: 129 pgs: 129 active+clean; 291 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 822 KiB/s wr, 403 op/s 2022-09-07T19:45:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:36 smithi154 ceph-mon[96967]: pgmap v37: 129 pgs: 129 active+clean; 291 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 822 KiB/s wr, 403 op/s 2022-09-07T19:45:36.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:36 smithi155 ceph-mon[97606]: pgmap v37: 129 pgs: 129 active+clean; 291 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 822 KiB/s wr, 403 op/s 2022-09-07T19:45:37.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:37.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:37.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:37.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 2048 2022-09-07T19:45:37.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:37.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:37.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:37.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 4096 2022-09-07T19:45:37.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:37.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:37.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:37.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 8192 2022-09-07T19:45:37.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:37.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:37.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:37.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 16384 2022-09-07T19:45:37.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:37.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:37.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:37.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 1024 2022-09-07T19:45:37.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:37.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:37.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:37.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 2048 2022-09-07T19:45:37.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:37.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:37.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:37.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 4096 2022-09-07T19:45:37.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:37.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:37.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:37.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 8192 2022-09-07T19:45:37.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:37.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:37.129 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:37.129 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 16384 2022-09-07T19:45:37.129 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:37.130 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:37.130 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:37.131 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 1024 2022-09-07T19:45:37.131 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:37.134 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:37.134 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:37.134 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 2048 2022-09-07T19:45:37.135 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:37.135 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:37.135 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:37.135 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 4096 2022-09-07T19:45:37.136 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:37.136 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:37.136 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:37.136 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 8192 2022-09-07T19:45:37.137 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:37.137 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:37.137 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:37.138 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 16384 2022-09-07T19:45:37.138 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:37.139 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:37.139 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:37.139 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 1024 2022-09-07T19:45:37.140 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:37.140 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:37.140 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:37.140 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 2048 2022-09-07T19:45:37.141 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:37.141 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:37.141 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:37.142 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 4096 2022-09-07T19:45:37.142 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:37.142 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:37.142 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:37.142 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 8192 2022-09-07T19:45:37.143 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:37.143 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:37.143 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:37.143 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 16384 2022-09-07T19:45:37.144 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:37.144 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:37.144 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:37.144 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 1024 2022-09-07T19:45:37.144 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:37.145 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:37.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:37.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 2048 2022-09-07T19:45:37.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:37.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:37.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:37.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 4096 2022-09-07T19:45:37.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:37.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:37.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:37.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 8192 2022-09-07T19:45:37.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:37.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:37.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:37.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 16384 2022-09-07T19:45:37.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:37.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:37.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:37.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 1024 2022-09-07T19:45:37.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:37.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:37.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:37.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 2048 2022-09-07T19:45:37.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:37.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:37.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:37.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 4096 2022-09-07T19:45:37.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:37.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:37.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:37.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 8192 2022-09-07T19:45:37.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:37.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:37.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:37.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 16384 2022-09-07T19:45:37.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:37.903 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:37.903 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:37.903 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 1024 2022-09-07T19:45:37.903 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:37.903 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:37.904 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:37.904 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 2048 2022-09-07T19:45:37.904 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:37.904 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:37.905 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:37.905 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 4096 2022-09-07T19:45:37.905 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:37.905 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:37.905 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:37.906 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 8192 2022-09-07T19:45:37.906 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:37.906 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:37.907 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:37.907 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 16384 2022-09-07T19:45:37.907 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:37.907 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:37.907 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:37.908 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 1024 2022-09-07T19:45:37.908 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:37.908 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:37.908 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:37.908 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 2048 2022-09-07T19:45:37.909 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:37.909 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:37.909 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:37.909 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 4096 2022-09-07T19:45:37.910 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:37.910 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:37.910 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:37.910 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 8192 2022-09-07T19:45:37.911 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:37.911 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:37.911 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:37.911 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 16384 2022-09-07T19:45:37.912 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:37.912 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:37.912 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:37.912 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 1024 2022-09-07T19:45:37.913 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:37.913 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:37.913 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:37.913 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 2048 2022-09-07T19:45:37.913 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:38.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:38 smithi080 ceph-mon[90124]: pgmap v38: 129 pgs: 129 active+clean; 291 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 814 KiB/s wr, 184 op/s 2022-09-07T19:45:38.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:38 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:45:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:38 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:45:38.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:38 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:45:38.872 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:38 smithi154 ceph-mon[96967]: pgmap v38: 129 pgs: 129 active+clean; 291 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 814 KiB/s wr, 184 op/s 2022-09-07T19:45:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:45:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:45:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:45:38.939 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:38 smithi155 ceph-mon[97606]: pgmap v38: 129 pgs: 129 active+clean; 291 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 814 KiB/s wr, 184 op/s 2022-09-07T19:45:38.939 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:45:38.940 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:45:38.940 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:45:40.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:39 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:39 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:39 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:39 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:39 smithi080 ceph-mon[90124]: pgmap v39: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 247 op/s 2022-09-07T19:45:40.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:39 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:39 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:39 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:39 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:39 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:39 smithi154 ceph-mon[96967]: pgmap v39: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 247 op/s 2022-09-07T19:45:40.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:39 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:39 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:39 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:39 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:39 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:39 smithi155 ceph-mon[97606]: pgmap v39: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 247 op/s 2022-09-07T19:45:40.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:39 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:45:40.263 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:40.263 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:40.263 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 4096 2022-09-07T19:45:40.264 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:40.264 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:40.264 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:40.264 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 8192 2022-09-07T19:45:40.265 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:40.265 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:40.265 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:40.266 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 16384 2022-09-07T19:45:40.266 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:40.266 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:40.266 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:40.267 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 1024 2022-09-07T19:45:40.267 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:40.267 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:40.267 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:40.267 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 2048 2022-09-07T19:45:40.268 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:40.268 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:40.268 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:40.268 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 4096 2022-09-07T19:45:40.269 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:40.269 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:40.269 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:40.269 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 8192 2022-09-07T19:45:40.270 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:40.270 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:40.270 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:40.270 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 16384 2022-09-07T19:45:40.270 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:40.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:40.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:40.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 1024 2022-09-07T19:45:40.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:40.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:40.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:40.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 2048 2022-09-07T19:45:40.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:40.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:40.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:40.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 4096 2022-09-07T19:45:40.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:40.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:40.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:40.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 8192 2022-09-07T19:45:40.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:40.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:40.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:40.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 16384 2022-09-07T19:45:40.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:40.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:40.276 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:40.276 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 1024 2022-09-07T19:45:40.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:40.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:40.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:40.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 2048 2022-09-07T19:45:40.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:40.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:40.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:40.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 4096 2022-09-07T19:45:40.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:40.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:40.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:40.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 8192 2022-09-07T19:45:40.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:40.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:40.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:40.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 16384 2022-09-07T19:45:40.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:40.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:40.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:40.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 1024 2022-09-07T19:45:40.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:40.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:40.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:40.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 2048 2022-09-07T19:45:40.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:41.790 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:41.790 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:41.791 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 4096 2022-09-07T19:45:41.791 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:41.792 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:41.792 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:41.793 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 8192 2022-09-07T19:45:41.793 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:41.794 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:41.794 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:41.794 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 16384 2022-09-07T19:45:41.795 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:41.795 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:41.796 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:41.796 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 1024 2022-09-07T19:45:41.797 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:41.797 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:41.797 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:41.798 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 2048 2022-09-07T19:45:41.798 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:41.799 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:41.799 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:41.799 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 4096 2022-09-07T19:45:41.799 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:41.800 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:41.800 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:41.800 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 8192 2022-09-07T19:45:41.800 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:41.800 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:41.801 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:41.801 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 16384 2022-09-07T19:45:41.801 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:41.801 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:41.802 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:41.802 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 1024 2022-09-07T19:45:41.802 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:41.802 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:41.802 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:41.803 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 2048 2022-09-07T19:45:41.803 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:41.803 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:41.804 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:41.804 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 4096 2022-09-07T19:45:41.805 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:41.805 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:41.805 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:41.805 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 8192 2022-09-07T19:45:41.805 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:41.806 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:41.806 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:41.806 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 16384 2022-09-07T19:45:41.806 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:41.807 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:41.807 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:41.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 1024 2022-09-07T19:45:41.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:41.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:41.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:41.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 2048 2022-09-07T19:45:41.809 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:41.809 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:41.809 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:41.809 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 4096 2022-09-07T19:45:41.810 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:41.810 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:41.810 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:41.811 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 8192 2022-09-07T19:45:41.811 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:41.812 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:41.812 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:41.812 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 16384 2022-09-07T19:45:41.812 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:41.813 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:41.813 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:41.813 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 1024 2022-09-07T19:45:41.814 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:41.814 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:41.814 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:41.815 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 2048 2022-09-07T19:45:41.815 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:41.815 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:42.361 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:42.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 4096 2022-09-07T19:45:42.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:42.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:42.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:42.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 8192 2022-09-07T19:45:42.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:42.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:42.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:42.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 16384 2022-09-07T19:45:42.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:42.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:42.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:42.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 1024 2022-09-07T19:45:42.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:42.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:42.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:42.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 2048 2022-09-07T19:45:42.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:42.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:42.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:42.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 4096 2022-09-07T19:45:42.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:42.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:42.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:42.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 8192 2022-09-07T19:45:42.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:42.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:42.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:42.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 16384 2022-09-07T19:45:42.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:42.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:42.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:42.369 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 1024 2022-09-07T19:45:42.369 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:42.369 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:42.369 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:42.370 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 2048 2022-09-07T19:45:42.370 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:42.370 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:42.370 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:42.370 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 4096 2022-09-07T19:45:42.371 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:42.371 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:42.371 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:42.371 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 8192 2022-09-07T19:45:42.371 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:42.372 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:42.372 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:42.372 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 16384 2022-09-07T19:45:42.372 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:42.373 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:42.373 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:42.373 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 1024 2022-09-07T19:45:42.373 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:42.374 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:42.374 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:42.374 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 2048 2022-09-07T19:45:42.374 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:42.374 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:42.375 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:42.375 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 4096 2022-09-07T19:45:42.375 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:42.375 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:42.376 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:42.376 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 8192 2022-09-07T19:45:42.376 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:42.376 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:42.376 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:42.377 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 16384 2022-09-07T19:45:42.377 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:42.377 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:42.377 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:42.378 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 1024 2022-09-07T19:45:42.378 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:42.378 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:42.378 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:42.378 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 2048 2022-09-07T19:45:42.379 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:42.379 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:42.379 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:42.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:42 smithi155 ceph-mon[97606]: pgmap v40: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 243 op/s 2022-09-07T19:45:42.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:42 smithi080 ceph-mon[90124]: pgmap v40: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 243 op/s 2022-09-07T19:45:42.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:42 smithi154 ceph-mon[96967]: pgmap v40: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 243 op/s 2022-09-07T19:45:43.328 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 4096 2022-09-07T19:45:43.328 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:43.328 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:43.328 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:43.329 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 8192 2022-09-07T19:45:43.329 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:43.329 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:43.329 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:43.330 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 16384 2022-09-07T19:45:43.330 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:43.330 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:43.330 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:43.331 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 1024 2022-09-07T19:45:43.331 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:43.331 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:43.331 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:43.331 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 2048 2022-09-07T19:45:43.332 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:43.332 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:43.332 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:43.332 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 4096 2022-09-07T19:45:43.332 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:43.333 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:43.333 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:43.333 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 8192 2022-09-07T19:45:43.333 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:43.334 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:43.334 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:43.334 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 16384 2022-09-07T19:45:43.334 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:43.334 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:43.335 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:43.335 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 1024 2022-09-07T19:45:43.335 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:43.335 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:43.336 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:43.336 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 2048 2022-09-07T19:45:43.336 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:43.336 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:43.336 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:43.337 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 4096 2022-09-07T19:45:43.337 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:43.337 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:43.337 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:43.337 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 8192 2022-09-07T19:45:43.338 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:43.338 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:43.338 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:43.338 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 16384 2022-09-07T19:45:43.338 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:43.339 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:43.339 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:43.339 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 1024 2022-09-07T19:45:43.339 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:43.340 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:43.340 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:43.340 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 2048 2022-09-07T19:45:43.340 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:43.340 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:43.341 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:43.341 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 4096 2022-09-07T19:45:43.341 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:43.341 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:43.341 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:43.342 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 8192 2022-09-07T19:45:43.342 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:43.342 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:43.342 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:43.343 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 16384 2022-09-07T19:45:43.343 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:43.344 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:43.344 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:43.344 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 1024 2022-09-07T19:45:43.344 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:43.345 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:43.345 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:43.345 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 2048 2022-09-07T19:45:43.345 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:43.345 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:43.346 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:43.346 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 4096 2022-09-07T19:45:44.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:44 smithi080 ceph-mon[90124]: pgmap v41: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 243 op/s 2022-09-07T19:45:44.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:44 smithi154 ceph-mon[96967]: pgmap v41: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 243 op/s 2022-09-07T19:45:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:44 smithi155 ceph-mon[97606]: pgmap v41: 129 pgs: 129 active+clean; 582 MiB data, 187 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 1.0 MiB/s wr, 243 op/s 2022-09-07T19:45:45.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:45.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:45.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:45.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 8192 2022-09-07T19:45:45.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:45.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:45.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:45.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 16384 2022-09-07T19:45:45.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:45.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:45.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:45.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 1024 2022-09-07T19:45:45.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:45.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:45.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:45.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 2048 2022-09-07T19:45:45.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:45.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:45.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:45.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 4096 2022-09-07T19:45:45.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:45.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:45.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:45.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 8192 2022-09-07T19:45:45.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:45.284 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:45.284 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:45.284 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 16384 2022-09-07T19:45:45.285 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:45.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:45.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:45.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 1024 2022-09-07T19:45:45.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:45.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:45.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:45.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 2048 2022-09-07T19:45:45.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:45.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:45.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:45.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 4096 2022-09-07T19:45:45.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:45.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:45.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:45.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 8192 2022-09-07T19:45:45.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:45.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:45.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:45.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 16384 2022-09-07T19:45:45.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:45.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:45.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:45.291 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 1024 2022-09-07T19:45:45.291 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:45.291 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:45.291 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:45.291 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 2048 2022-09-07T19:45:45.292 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:45.292 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:45.292 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:45.292 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 4096 2022-09-07T19:45:45.293 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:45.293 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:45.293 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:45.293 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 8192 2022-09-07T19:45:45.294 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:45.294 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:45.295 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:45.295 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 16384 2022-09-07T19:45:45.295 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:45.295 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:45.296 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:45.297 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 1024 2022-09-07T19:45:45.297 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:45.297 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:45.297 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:45.298 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 2048 2022-09-07T19:45:45.298 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:45.298 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:45.298 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:45.299 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 4096 2022-09-07T19:45:45.299 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:46.270 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:46.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:46.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 8192 2022-09-07T19:45:46.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:46.271 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:46.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:46.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 16384 2022-09-07T19:45:46.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:46.272 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:46.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:46.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 1024 2022-09-07T19:45:46.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:46.273 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:46.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:46.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 2048 2022-09-07T19:45:46.274 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:46.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:46.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:46.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 4096 2022-09-07T19:45:46.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:46.275 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:46.276 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:46.276 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 8192 2022-09-07T19:45:46.276 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:46.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:46.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:46.277 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 16384 2022-09-07T19:45:46.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:46.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:46.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:46.278 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 1024 2022-09-07T19:45:46.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:46.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:46.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:46.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 2048 2022-09-07T19:45:46.279 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:46.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:46.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:46.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 4096 2022-09-07T19:45:46.280 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:46.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:46.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:46.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 8192 2022-09-07T19:45:46.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:46.281 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:46.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:46.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 16384 2022-09-07T19:45:46.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:46.282 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:46.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:46.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 1024 2022-09-07T19:45:46.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:46.283 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:46.284 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:46.284 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 2048 2022-09-07T19:45:46.284 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:46.285 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:46.285 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:46.285 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 4096 2022-09-07T19:45:46.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:46.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:46.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:46.286 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 8192 2022-09-07T19:45:46.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:46.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:46.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:46.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 16384 2022-09-07T19:45:46.287 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:46.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:46.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:46.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 1024 2022-09-07T19:45:46.288 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:46.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:46.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:46.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 2048 2022-09-07T19:45:46.289 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:46.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:46.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:46.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 4096 2022-09-07T19:45:46.290 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:46 smithi154 ceph-mon[96967]: pgmap v42: 129 pgs: 129 active+clean; 143 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 1.3 MiB/s wr, 332 op/s 2022-09-07T19:45:46.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:46 smithi080 ceph-mon[90124]: pgmap v42: 129 pgs: 129 active+clean; 143 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 1.3 MiB/s wr, 332 op/s 2022-09-07T19:45:46.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:46 smithi155 ceph-mon[97606]: pgmap v42: 129 pgs: 129 active+clean; 143 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 1.3 MiB/s wr, 332 op/s 2022-09-07T19:45:46.870 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:46.871 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:46.871 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 8192 2022-09-07T19:45:46.871 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:46.872 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:46.872 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:46.872 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 16384 2022-09-07T19:45:46.872 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:46.872 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:46.873 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:46.873 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 1024 2022-09-07T19:45:46.873 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:46.873 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:46.874 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:46.874 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 2048 2022-09-07T19:45:46.874 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:46.874 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:46.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:46.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 4096 2022-09-07T19:45:46.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:46.875 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:46.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:46.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 8192 2022-09-07T19:45:46.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:46.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:46.876 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:46.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 16384 2022-09-07T19:45:46.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:46.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:46.877 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:46.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 1024 2022-09-07T19:45:46.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:46.878 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:46.879 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:46.879 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 2048 2022-09-07T19:45:46.879 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:46.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:46.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:46.880 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 4096 2022-09-07T19:45:46.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:46.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:46.881 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:46.882 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 8192 2022-09-07T19:45:46.882 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:46.883 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:46.883 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:46.884 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 16384 2022-09-07T19:45:46.884 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:46.884 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:46.884 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:46.885 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 1024 2022-09-07T19:45:46.885 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:46.885 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:46.886 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:46.886 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 2048 2022-09-07T19:45:46.887 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:46.887 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:46.888 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:46.888 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 4096 2022-09-07T19:45:46.889 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:46.889 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:46.890 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:46.890 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 8192 2022-09-07T19:45:46.890 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:46.891 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:46.891 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:46.892 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 16384 2022-09-07T19:45:46.892 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:46.893 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:46.893 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:46.893 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 1024 2022-09-07T19:45:46.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:46.894 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:46.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:46.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 2048 2022-09-07T19:45:46.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:46.895 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:46.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:46.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 4096 2022-09-07T19:45:46.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:46.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:48.110 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:48.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 8192 2022-09-07T19:45:48.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:48.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:48.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:48.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 16384 2022-09-07T19:45:48.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:48.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:48.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:48.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 1024 2022-09-07T19:45:48.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:48.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:48.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:48.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 2048 2022-09-07T19:45:48.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:48.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:48.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:48.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 4096 2022-09-07T19:45:48.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:48.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:48.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:48.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 8192 2022-09-07T19:45:48.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:48.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:48.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:48.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 16384 2022-09-07T19:45:48.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:48.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:48.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:48.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 1024 2022-09-07T19:45:48.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:48.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:48.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:48.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 2048 2022-09-07T19:45:48.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:48.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:48.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:48.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 4096 2022-09-07T19:45:48.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:48.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:48.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:48.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 8192 2022-09-07T19:45:48.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:48.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:48.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:48.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 16384 2022-09-07T19:45:48.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:48.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:48.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:48.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 1024 2022-09-07T19:45:48.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:48.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:48.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:48.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 2048 2022-09-07T19:45:48.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:48.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:48.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:48.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 4096 2022-09-07T19:45:48.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:48.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:48.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:48.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 8192 2022-09-07T19:45:48.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:48.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:48.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:48.125 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 16384 2022-09-07T19:45:48.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:48.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:48.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:48.126 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 1024 2022-09-07T19:45:48.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:48.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:48.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:48.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 2048 2022-09-07T19:45:48.127 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:48.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:48.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:48.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 4096 2022-09-07T19:45:48.128 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:48.129 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:48.129 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:48.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:48 smithi080 ceph-mon[90124]: pgmap v43: 129 pgs: 129 active+clean; 143 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 523 KiB/s wr, 152 op/s 2022-09-07T19:45:48.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:48 smithi154 ceph-mon[96967]: pgmap v43: 129 pgs: 129 active+clean; 143 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 523 KiB/s wr, 152 op/s 2022-09-07T19:45:48.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:48 smithi155 ceph-mon[97606]: pgmap v43: 129 pgs: 129 active+clean; 143 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 523 KiB/s wr, 152 op/s 2022-09-07T19:45:50.183 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 8192 2022-09-07T19:45:50.183 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:50.183 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:50.184 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:50.184 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 16384 2022-09-07T19:45:50.184 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:50.184 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:50.185 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:50.185 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 1024 2022-09-07T19:45:50.185 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:50.185 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:50.186 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:50.186 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 2048 2022-09-07T19:45:50.186 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:50.186 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:50.186 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:50.187 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 4096 2022-09-07T19:45:50.187 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:50.187 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:50.187 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:50.188 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 8192 2022-09-07T19:45:50.188 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:50.188 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:50.189 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:50.189 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 16384 2022-09-07T19:45:50.189 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:50.189 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:50.189 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:50.190 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 1024 2022-09-07T19:45:50.190 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:50.190 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:50.190 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:50.191 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 2048 2022-09-07T19:45:50.191 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:50.191 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:50.191 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:50.191 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 4096 2022-09-07T19:45:50.192 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:50.192 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:50.192 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:50.192 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 8192 2022-09-07T19:45:50.192 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:50.193 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:50.193 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:50.193 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 16384 2022-09-07T19:45:50.193 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:50.193 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:50.194 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:50.194 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 1024 2022-09-07T19:45:50.194 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:50.194 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:50.195 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:50.195 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 2048 2022-09-07T19:45:50.195 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:50.195 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:50.195 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:50.196 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 4096 2022-09-07T19:45:50.196 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:50.196 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:50.196 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:50.197 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 8192 2022-09-07T19:45:50.197 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:50.197 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:50.197 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:50.198 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 16384 2022-09-07T19:45:50.198 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:50.198 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:50.198 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:50.199 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 1024 2022-09-07T19:45:50.199 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:50.199 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:50.199 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:50.199 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 2048 2022-09-07T19:45:50.200 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:50.200 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:50.200 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:50.200 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 4096 2022-09-07T19:45:50.200 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:50.201 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:50.201 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:50.201 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 8192 2022-09-07T19:45:50.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:50 smithi080 ceph-mon[90124]: pgmap v44: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s rd, 771 KiB/s wr, 226 op/s 2022-09-07T19:45:50.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:50 smithi154 ceph-mon[96967]: pgmap v44: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s rd, 771 KiB/s wr, 226 op/s 2022-09-07T19:45:50.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:50 smithi155 ceph-mon[97606]: pgmap v44: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s rd, 771 KiB/s wr, 226 op/s 2022-09-07T19:45:50.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:50.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:50.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:50.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 16384 2022-09-07T19:45:50.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:50.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:50.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:50.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 1024 2022-09-07T19:45:50.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:50.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:50.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:50.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 2048 2022-09-07T19:45:50.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:50.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:50.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:50.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 4096 2022-09-07T19:45:50.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:50.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:50.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:50.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 8192 2022-09-07T19:45:50.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:50.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:50.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:50.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 16384 2022-09-07T19:45:50.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:50.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:50.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:50.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 1024 2022-09-07T19:45:50.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:50.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:50.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:50.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 2048 2022-09-07T19:45:50.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:50.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:50.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:50.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 4096 2022-09-07T19:45:50.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:50.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:50.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:50.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 8192 2022-09-07T19:45:50.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:50.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:50.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:50.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 16384 2022-09-07T19:45:50.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:50.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:50.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:50.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 1024 2022-09-07T19:45:50.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:50.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:50.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:50.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 2048 2022-09-07T19:45:50.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:50.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:50.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:50.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 4096 2022-09-07T19:45:50.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:50.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:50.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:50.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 8192 2022-09-07T19:45:50.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:50.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:50.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:50.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 16384 2022-09-07T19:45:50.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:50.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:50.856 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:50.856 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 1024 2022-09-07T19:45:50.856 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:50.856 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:50.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:50.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 2048 2022-09-07T19:45:50.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:50.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:50.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:50.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 4096 2022-09-07T19:45:50.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:50.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:50.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:50.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 8192 2022-09-07T19:45:51.535 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:51.536 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:51.536 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:51.537 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 16384 2022-09-07T19:45:51.537 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:51.538 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:51.538 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:51.539 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 1024 2022-09-07T19:45:51.539 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:51.540 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:51.540 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:51.541 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 2048 2022-09-07T19:45:51.541 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:51.542 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:51.543 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:51.543 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 4096 2022-09-07T19:45:51.544 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:51.544 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:51.544 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:51.545 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 8192 2022-09-07T19:45:51.545 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:51.546 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:51.546 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:51.547 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 16384 2022-09-07T19:45:51.547 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:51.548 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:51.548 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:51.549 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 1024 2022-09-07T19:45:51.550 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:51.550 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:51.551 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:51.551 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 2048 2022-09-07T19:45:51.552 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:51.552 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:51.553 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:51.553 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 4096 2022-09-07T19:45:51.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:51.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:51.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:51.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 8192 2022-09-07T19:45:51.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:51.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:51.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:51.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 16384 2022-09-07T19:45:51.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:51.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:51.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:51.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 1024 2022-09-07T19:45:51.560 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:51.560 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:51.561 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:51.561 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 2048 2022-09-07T19:45:51.562 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:51.562 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:51.563 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:51.563 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 4096 2022-09-07T19:45:51.564 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:51.564 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:51.565 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:51.565 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 8192 2022-09-07T19:45:51.566 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:51.566 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:51.566 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:51.566 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 16384 2022-09-07T19:45:51.567 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:51.567 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:51.567 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:51.567 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 1024 2022-09-07T19:45:51.567 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:51.568 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:51.568 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:51.568 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 2048 2022-09-07T19:45:51.568 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:51.569 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:51.569 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:51.569 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 4096 2022-09-07T19:45:51.569 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:51.569 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:51.570 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:51.570 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 8192 2022-09-07T19:45:51.570 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:52.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:52 smithi080 ceph-mon[90124]: pgmap v45: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 525 KiB/s wr, 163 op/s 2022-09-07T19:45:52.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:52 smithi154 ceph-mon[96967]: pgmap v45: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 525 KiB/s wr, 163 op/s 2022-09-07T19:45:52.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:52 smithi155 ceph-mon[97606]: pgmap v45: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 525 KiB/s wr, 163 op/s 2022-09-07T19:45:53.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:53.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:53.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 16384 2022-09-07T19:45:53.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:53.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:53.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:53.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 1024 2022-09-07T19:45:53.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:53.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:53.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:53.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 2048 2022-09-07T19:45:53.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:53.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:53.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:53.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 4096 2022-09-07T19:45:53.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:53.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:53.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:53.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 8192 2022-09-07T19:45:53.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:53.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:53.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:53.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 16384 2022-09-07T19:45:53.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:53.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:53.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:53.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 1024 2022-09-07T19:45:53.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:53.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:53.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:53.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 2048 2022-09-07T19:45:53.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:53.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:53.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:53.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 4096 2022-09-07T19:45:53.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:53.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:53.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:53.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 8192 2022-09-07T19:45:53.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:53.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:53.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:53.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 16384 2022-09-07T19:45:53.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:53.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:53.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:53.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 1024 2022-09-07T19:45:53.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:53.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:53.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:53.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 2048 2022-09-07T19:45:53.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:53.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:53.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:53.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 4096 2022-09-07T19:45:53.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:53.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:53.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:53.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 8192 2022-09-07T19:45:53.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:53.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:53.043 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:53.043 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 16384 2022-09-07T19:45:53.043 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:53.043 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:53.043 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:53.044 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 1024 2022-09-07T19:45:53.044 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:53.044 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:53.044 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:53.045 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 2048 2022-09-07T19:45:53.045 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:53.045 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:53.045 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:53.045 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 4096 2022-09-07T19:45:53.046 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:53.046 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:53.046 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:53.046 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 8192 2022-09-07T19:45:53.046 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:53.047 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:54.418 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:54.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 16384 2022-09-07T19:45:54.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:54.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:54.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:54.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 1024 2022-09-07T19:45:54.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:54.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:54.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:54.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 2048 2022-09-07T19:45:54.422 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:54.422 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:54.422 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:54.422 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 4096 2022-09-07T19:45:54.423 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:54.423 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:54.423 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:54.423 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 8192 2022-09-07T19:45:54.424 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:54.424 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:54.424 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:54.424 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 16384 2022-09-07T19:45:54.425 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:54.425 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:54.425 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:54.425 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 1024 2022-09-07T19:45:54.425 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:54.426 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:54.426 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:54.426 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 2048 2022-09-07T19:45:54.426 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:54.427 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:54.427 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:54.428 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 4096 2022-09-07T19:45:54.428 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:54.428 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:54.429 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:54.429 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 8192 2022-09-07T19:45:54.430 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:54.430 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:54.431 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:54.431 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 16384 2022-09-07T19:45:54.432 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:54.432 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:54.433 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:54.433 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 1024 2022-09-07T19:45:54.433 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:54.434 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:54.434 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:54.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 2048 2022-09-07T19:45:54.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:54.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:54.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:54.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 4096 2022-09-07T19:45:54.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:54.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:54.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:54.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 8192 2022-09-07T19:45:54.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:54.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:54.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:54.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 16384 2022-09-07T19:45:54.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:54.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:54.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:54.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 1024 2022-09-07T19:45:54.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:54.440 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:54.440 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:54.440 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 2048 2022-09-07T19:45:54.441 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:54.441 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:54.441 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:54.442 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 4096 2022-09-07T19:45:54.442 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:54.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:54.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:54.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 8192 2022-09-07T19:45:54.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:54.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:54.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:54.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:54 smithi080 ceph-mon[90124]: pgmap v46: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 525 KiB/s wr, 163 op/s 2022-09-07T19:45:54.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:54 smithi154 ceph-mon[96967]: pgmap v46: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 525 KiB/s wr, 163 op/s 2022-09-07T19:45:54.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:54 smithi155 ceph-mon[97606]: pgmap v46: 129 pgs: 129 active+clean; 189 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 525 KiB/s wr, 163 op/s 2022-09-07T19:45:55.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 16384 2022-09-07T19:45:55.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:55.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:55.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:55.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 1024 2022-09-07T19:45:55.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:55.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:55.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:55.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 2048 2022-09-07T19:45:55.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:55.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:55.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:55.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 4096 2022-09-07T19:45:55.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:55.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:55.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:55.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 8192 2022-09-07T19:45:55.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:55.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:55.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:55.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 16384 2022-09-07T19:45:55.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:55.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:55.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:55.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 1024 2022-09-07T19:45:55.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:55.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:55.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:55.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 2048 2022-09-07T19:45:55.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:55.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:55.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:55.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 4096 2022-09-07T19:45:55.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:55.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:55.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:55.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 8192 2022-09-07T19:45:55.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:55.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:55.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:55.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 16384 2022-09-07T19:45:55.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:55.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:55.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:55.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 1024 2022-09-07T19:45:55.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:55.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:55.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:55.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 2048 2022-09-07T19:45:55.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:55.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:55.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:55.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 4096 2022-09-07T19:45:55.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:55.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:55.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:55.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 8192 2022-09-07T19:45:55.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:55.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:55.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:55.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 16384 2022-09-07T19:45:55.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:55.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:55.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:55.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 1024 2022-09-07T19:45:55.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:55.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:55.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:55.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 2048 2022-09-07T19:45:55.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:55.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:55.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:55.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 4096 2022-09-07T19:45:55.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:55.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:55.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:55.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 8192 2022-09-07T19:45:55.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:55.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:55.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:55.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 16384 2022-09-07T19:45:55.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:55.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:55.840 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:55.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 1024 2022-09-07T19:45:55.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:55.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:55.841 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:55.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 2048 2022-09-07T19:45:55.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:55.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:55.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:55.842 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 4096 2022-09-07T19:45:55.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:55.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:55.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:55.843 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 8192 2022-09-07T19:45:55.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:55.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:55.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:55.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 16384 2022-09-07T19:45:55.844 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:55.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:55.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:55.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 1024 2022-09-07T19:45:55.845 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:55.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:55.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:55.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 2048 2022-09-07T19:45:55.846 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:55.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:55.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:55.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 4096 2022-09-07T19:45:55.847 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:55.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:55.848 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:55.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 8192 2022-09-07T19:45:55.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:55.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:55.849 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:55.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 16384 2022-09-07T19:45:55.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:55.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:55.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:55.850 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 1024 2022-09-07T19:45:55.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:55.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:55.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:55.851 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 2048 2022-09-07T19:45:55.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:55.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:55.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:55.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 4096 2022-09-07T19:45:55.852 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:55.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:55.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:55.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 8192 2022-09-07T19:45:55.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:55.853 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:55.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:55.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 16384 2022-09-07T19:45:55.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:55.854 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:55.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:55.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 1024 2022-09-07T19:45:55.855 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:55.856 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:55.856 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:55.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 2048 2022-09-07T19:45:55.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:55.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:55.857 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:55.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 4096 2022-09-07T19:45:55.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:55.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:55.858 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:55.859 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 8192 2022-09-07T19:45:55.859 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:55.859 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:55.859 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:55.859 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 16384 2022-09-07T19:45:56.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:56 smithi080 ceph-mon[90124]: pgmap v47: 129 pgs: 129 active+clean; 183 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 774 KiB/s wr, 238 op/s 2022-09-07T19:45:56.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:56 smithi154 ceph-mon[96967]: pgmap v47: 129 pgs: 129 active+clean; 183 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 774 KiB/s wr, 238 op/s 2022-09-07T19:45:56.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:56 smithi155 ceph-mon[97606]: pgmap v47: 129 pgs: 129 active+clean; 183 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 774 KiB/s wr, 238 op/s 2022-09-07T19:45:57.347 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:57.347 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:57.348 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:57.348 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 1024 2022-09-07T19:45:57.348 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:57.348 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:57.349 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:57.349 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 2048 2022-09-07T19:45:57.349 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:57.349 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:57.349 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:57.350 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 4096 2022-09-07T19:45:57.350 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:57.350 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:57.351 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:57.351 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 8192 2022-09-07T19:45:57.351 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:57.352 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:57.352 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:57.352 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 16384 2022-09-07T19:45:57.353 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:57.353 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:57.353 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:57.353 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 1024 2022-09-07T19:45:57.354 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:57.354 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:57.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:57.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 2048 2022-09-07T19:45:57.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:57.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:57.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:57.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 4096 2022-09-07T19:45:57.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:57.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:57.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:57.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 8192 2022-09-07T19:45:57.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:57.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:57.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:57.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 16384 2022-09-07T19:45:57.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:57.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:57.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:57.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 1024 2022-09-07T19:45:57.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:57.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:57.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:57.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 2048 2022-09-07T19:45:57.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:57.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:57.361 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:57.361 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 4096 2022-09-07T19:45:57.361 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:57.361 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:57.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:57.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 8192 2022-09-07T19:45:57.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:57.362 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:57.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:57.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 16384 2022-09-07T19:45:57.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:57.363 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:57.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:57.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 1024 2022-09-07T19:45:57.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:57.364 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:57.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:57.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 2048 2022-09-07T19:45:57.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:57.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:57.365 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:57.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 4096 2022-09-07T19:45:57.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:57.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:57.366 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:57.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 8192 2022-09-07T19:45:57.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:57.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:57.367 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:57.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 16384 2022-09-07T19:45:57.368 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:58.483 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:58.484 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:58.484 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 1024 2022-09-07T19:45:58.484 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:58.484 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:58.484 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:58.485 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 2048 2022-09-07T19:45:58.485 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:58.485 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:58.485 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:58.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 4096 2022-09-07T19:45:58.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:58.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:58.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:58.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 8192 2022-09-07T19:45:58.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:58.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:58.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:58.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 16384 2022-09-07T19:45:58.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:58.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:58.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:58.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 1024 2022-09-07T19:45:58.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:58.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:58.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:58.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 2048 2022-09-07T19:45:58.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:58.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:58.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:58.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 4096 2022-09-07T19:45:58.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:58.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:58.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:58.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 8192 2022-09-07T19:45:58.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:58.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:58.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:58.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 16384 2022-09-07T19:45:58.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:58.493 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:58.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:58.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 1024 2022-09-07T19:45:58.494 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:58.495 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:58.495 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:58.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 2048 2022-09-07T19:45:58.496 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:58.497 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:58.498 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:58.498 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 4096 2022-09-07T19:45:58.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:58.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:58.499 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:58.500 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 8192 2022-09-07T19:45:58.500 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:58.500 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:58.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:58.501 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 16384 2022-09-07T19:45:58.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:58.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:58.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:58.502 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 1024 2022-09-07T19:45:58.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:58.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:58.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:58.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 2048 2022-09-07T19:45:58.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:58.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:58.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:58.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 4096 2022-09-07T19:45:58.504 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:58.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:58.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:58.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 8192 2022-09-07T19:45:58.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:58.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:58.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:58.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 16384 2022-09-07T19:45:58.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:58.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:58.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:45:58 smithi080 ceph-mon[90124]: pgmap v48: 129 pgs: 129 active+clean; 183 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 496 KiB/s wr, 149 op/s 2022-09-07T19:45:58.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:45:58 smithi154 ceph-mon[96967]: pgmap v48: 129 pgs: 129 active+clean; 183 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 496 KiB/s wr, 149 op/s 2022-09-07T19:45:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:45:58 smithi155 ceph-mon[97606]: pgmap v48: 129 pgs: 129 active+clean; 183 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 496 KiB/s wr, 149 op/s 2022-09-07T19:45:59.106 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:59.106 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 1024 2022-09-07T19:45:59.107 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:59.107 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:59.107 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:59.107 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 2048 2022-09-07T19:45:59.108 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:59.108 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:59.108 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:59.108 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 4096 2022-09-07T19:45:59.108 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:59.109 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:59.109 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:59.109 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 8192 2022-09-07T19:45:59.109 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:59.110 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:59.110 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:59.110 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 16384 2022-09-07T19:45:59.110 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:59.110 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:59.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:59.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 1024 2022-09-07T19:45:59.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:59.111 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:59.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:59.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 2048 2022-09-07T19:45:59.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:59.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:59.112 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:59.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 4096 2022-09-07T19:45:59.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:59.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:59.113 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:59.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 8192 2022-09-07T19:45:59.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:59.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:59.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:59.114 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 16384 2022-09-07T19:45:59.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:59.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:59.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:59.115 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 1024 2022-09-07T19:45:59.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:59.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:59.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:59.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 2048 2022-09-07T19:45:59.116 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:59.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:59.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:59.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 4096 2022-09-07T19:45:59.117 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:59.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:59.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:59.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 8192 2022-09-07T19:45:59.118 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:59.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:59.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:59.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 16384 2022-09-07T19:45:59.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:59.119 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:59.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:59.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 1024 2022-09-07T19:45:59.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:59.120 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:59.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:59.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 2048 2022-09-07T19:45:59.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:59.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:59.121 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:59.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 4096 2022-09-07T19:45:59.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:59.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:59.122 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:59.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 8192 2022-09-07T19:45:59.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:59.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:59.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:59.123 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 16384 2022-09-07T19:45:59.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2022-09-07T19:45:59.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 1024 2022-09-07T19:45:59.124 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2022-09-07T19:46:00.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 1024 2022-09-07T19:46:00.225 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2022-09-07T19:46:00.225 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 2048 2022-09-07T19:46:00.225 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2022-09-07T19:46:00.225 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 2048 2022-09-07T19:46:00.226 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2022-09-07T19:46:00.226 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 4096 2022-09-07T19:46:00.226 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2022-09-07T19:46:00.228 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 4096 2022-09-07T19:46:00.229 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2022-09-07T19:46:00.229 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 8192 2022-09-07T19:46:00.229 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2022-09-07T19:46:00.230 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 8192 2022-09-07T19:46:00.230 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2022-09-07T19:46:00.230 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 16384 2022-09-07T19:46:00.231 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2022-09-07T19:46:00.231 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 16384 2022-09-07T19:46:00.231 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2022-09-07T19:46:00.231 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 1024 2022-09-07T19:46:00.232 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2022-09-07T19:46:00.232 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 1024 2022-09-07T19:46:00.232 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2022-09-07T19:46:00.232 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 2048 2022-09-07T19:46:00.233 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2022-09-07T19:46:00.233 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 2048 2022-09-07T19:46:00.233 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2022-09-07T19:46:00.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 4096 2022-09-07T19:46:00.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2022-09-07T19:46:00.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 4096 2022-09-07T19:46:00.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2022-09-07T19:46:00.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 8192 2022-09-07T19:46:00.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2022-09-07T19:46:00.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 8192 2022-09-07T19:46:00.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2022-09-07T19:46:00.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 16384 2022-09-07T19:46:00.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2022-09-07T19:46:00.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 16384 2022-09-07T19:46:00.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2022-09-07T19:46:00.240 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 1024 2022-09-07T19:46:00.240 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2022-09-07T19:46:00.240 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 1024 2022-09-07T19:46:00.241 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2022-09-07T19:46:00.241 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 2048 2022-09-07T19:46:00.242 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2022-09-07T19:46:00.242 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 2048 2022-09-07T19:46:00.243 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2022-09-07T19:46:00.243 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 4096 2022-09-07T19:46:00.243 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2022-09-07T19:46:00.244 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 4096 2022-09-07T19:46:00.244 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2022-09-07T19:46:00.244 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 8192 2022-09-07T19:46:00.245 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2022-09-07T19:46:00.245 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 8192 2022-09-07T19:46:00.246 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2022-09-07T19:46:00.246 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 16384 2022-09-07T19:46:00.246 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2022-09-07T19:46:00.247 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 16384 2022-09-07T19:46:00.247 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2022-09-07T19:46:00.248 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 1024 2022-09-07T19:46:00.248 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2022-09-07T19:46:00.248 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 1024 2022-09-07T19:46:00.248 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2022-09-07T19:46:00.248 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 2048 2022-09-07T19:46:00.249 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2022-09-07T19:46:00.249 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 2048 2022-09-07T19:46:00.249 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2022-09-07T19:46:00.249 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 4096 2022-09-07T19:46:00.250 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2022-09-07T19:46:00.250 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 4096 2022-09-07T19:46:00.250 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2022-09-07T19:46:00.251 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 8192 2022-09-07T19:46:00.251 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2022-09-07T19:46:00.251 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 8192 2022-09-07T19:46:00.251 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2022-09-07T19:46:00.251 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 16384 2022-09-07T19:46:00.252 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2022-09-07T19:46:00.252 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 16384 2022-09-07T19:46:00.252 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2022-09-07T19:46:00.252 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 1024 2022-09-07T19:46:00.252 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2022-09-07T19:46:00.253 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 1024 2022-09-07T19:46:00.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:00 smithi080 ceph-mon[90124]: pgmap v49: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 716 KiB/s wr, 210 op/s 2022-09-07T19:46:00.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:00 smithi080 ceph-mon[90124]: mgrmap e25: x(active, since 92s), standbys: z, y 2022-09-07T19:46:00.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:00 smithi154 ceph-mon[96967]: pgmap v49: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 716 KiB/s wr, 210 op/s 2022-09-07T19:46:00.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:00 smithi154 ceph-mon[96967]: mgrmap e25: x(active, since 92s), standbys: z, y 2022-09-07T19:46:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:00 smithi155 ceph-mon[97606]: pgmap v49: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 716 KiB/s wr, 210 op/s 2022-09-07T19:46:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:00 smithi155 ceph-mon[97606]: mgrmap e25: x(active, since 92s), standbys: z, y 2022-09-07T19:46:02.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:02 smithi080 ceph-mon[90124]: pgmap v50: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 468 KiB/s wr, 136 op/s 2022-09-07T19:46:02.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:02 smithi154 ceph-mon[96967]: pgmap v50: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 468 KiB/s wr, 136 op/s 2022-09-07T19:46:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2022-09-07T19:46:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 2048 2022-09-07T19:46:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2022-09-07T19:46:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 2048 2022-09-07T19:46:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2022-09-07T19:46:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 4096 2022-09-07T19:46:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2022-09-07T19:46:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 4096 2022-09-07T19:46:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2022-09-07T19:46:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 8192 2022-09-07T19:46:02.638 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2022-09-07T19:46:02.638 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 8192 2022-09-07T19:46:02.638 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2022-09-07T19:46:02.639 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 16384 2022-09-07T19:46:02.639 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2022-09-07T19:46:02.640 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 16384 2022-09-07T19:46:02.640 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2022-09-07T19:46:02.640 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 1024 2022-09-07T19:46:02.641 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2022-09-07T19:46:02.641 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 1024 2022-09-07T19:46:02.641 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2022-09-07T19:46:02.642 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 2048 2022-09-07T19:46:02.642 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2022-09-07T19:46:02.642 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 2048 2022-09-07T19:46:02.643 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2022-09-07T19:46:02.643 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 4096 2022-09-07T19:46:02.643 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2022-09-07T19:46:02.644 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 4096 2022-09-07T19:46:02.644 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2022-09-07T19:46:02.644 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 8192 2022-09-07T19:46:02.645 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2022-09-07T19:46:02.645 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 8192 2022-09-07T19:46:02.645 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2022-09-07T19:46:02.645 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 16384 2022-09-07T19:46:02.646 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2022-09-07T19:46:02.646 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 16384 2022-09-07T19:46:02.646 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2022-09-07T19:46:02.647 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 1024 2022-09-07T19:46:02.647 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2022-09-07T19:46:02.647 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 1024 2022-09-07T19:46:02.648 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2022-09-07T19:46:02.648 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 2048 2022-09-07T19:46:02.648 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2022-09-07T19:46:02.648 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 2048 2022-09-07T19:46:02.649 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2022-09-07T19:46:02.649 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 4096 2022-09-07T19:46:02.649 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2022-09-07T19:46:02.650 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 4096 2022-09-07T19:46:02.650 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2022-09-07T19:46:02.650 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 8192 2022-09-07T19:46:02.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2022-09-07T19:46:02.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 8192 2022-09-07T19:46:02.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2022-09-07T19:46:02.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 16384 2022-09-07T19:46:02.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2022-09-07T19:46:02.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 16384 2022-09-07T19:46:02.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2022-09-07T19:46:02.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 1024 2022-09-07T19:46:02.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2022-09-07T19:46:02.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 1024 2022-09-07T19:46:02.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2022-09-07T19:46:02.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 2048 2022-09-07T19:46:02.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2022-09-07T19:46:02.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 2048 2022-09-07T19:46:02.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2022-09-07T19:46:02.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 4096 2022-09-07T19:46:02.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2022-09-07T19:46:02.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 4096 2022-09-07T19:46:02.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2022-09-07T19:46:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 8192 2022-09-07T19:46:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2022-09-07T19:46:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 8192 2022-09-07T19:46:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2022-09-07T19:46:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 16384 2022-09-07T19:46:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2022-09-07T19:46:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 16384 2022-09-07T19:46:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2022-09-07T19:46:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 1024 2022-09-07T19:46:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2022-09-07T19:46:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 1024 2022-09-07T19:46:02.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:02 smithi155 ceph-mon[97606]: pgmap v50: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 468 KiB/s wr, 136 op/s 2022-09-07T19:46:03.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2022-09-07T19:46:03.808 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 2048 2022-09-07T19:46:03.809 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2022-09-07T19:46:03.809 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 2048 2022-09-07T19:46:03.810 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2022-09-07T19:46:03.810 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 4096 2022-09-07T19:46:03.810 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2022-09-07T19:46:03.811 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 4096 2022-09-07T19:46:03.811 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2022-09-07T19:46:03.812 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 8192 2022-09-07T19:46:03.812 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2022-09-07T19:46:03.813 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 8192 2022-09-07T19:46:03.813 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2022-09-07T19:46:03.813 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 16384 2022-09-07T19:46:03.814 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2022-09-07T19:46:03.814 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 16384 2022-09-07T19:46:03.815 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2022-09-07T19:46:03.815 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 1024 2022-09-07T19:46:03.816 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2022-09-07T19:46:03.816 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 1024 2022-09-07T19:46:03.816 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2022-09-07T19:46:03.817 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 2048 2022-09-07T19:46:03.817 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2022-09-07T19:46:03.818 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 2048 2022-09-07T19:46:03.818 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2022-09-07T19:46:03.819 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 4096 2022-09-07T19:46:03.819 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2022-09-07T19:46:03.819 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 4096 2022-09-07T19:46:03.820 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2022-09-07T19:46:03.820 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 8192 2022-09-07T19:46:03.821 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2022-09-07T19:46:03.821 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 8192 2022-09-07T19:46:03.822 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2022-09-07T19:46:03.822 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 16384 2022-09-07T19:46:03.823 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2022-09-07T19:46:03.823 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 16384 2022-09-07T19:46:03.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2022-09-07T19:46:03.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 1024 2022-09-07T19:46:03.824 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2022-09-07T19:46:03.825 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 1024 2022-09-07T19:46:03.825 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2022-09-07T19:46:03.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 2048 2022-09-07T19:46:03.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2022-09-07T19:46:03.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 2048 2022-09-07T19:46:03.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2022-09-07T19:46:03.826 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 4096 2022-09-07T19:46:03.827 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2022-09-07T19:46:03.827 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 4096 2022-09-07T19:46:03.827 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2022-09-07T19:46:03.828 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 8192 2022-09-07T19:46:03.828 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2022-09-07T19:46:03.828 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 8192 2022-09-07T19:46:03.829 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2022-09-07T19:46:03.829 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 16384 2022-09-07T19:46:03.830 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2022-09-07T19:46:03.830 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 16384 2022-09-07T19:46:03.830 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2022-09-07T19:46:03.831 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 1024 2022-09-07T19:46:03.831 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2022-09-07T19:46:03.831 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 1024 2022-09-07T19:46:03.831 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2022-09-07T19:46:03.831 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 2048 2022-09-07T19:46:03.832 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2022-09-07T19:46:03.832 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 2048 2022-09-07T19:46:03.832 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2022-09-07T19:46:03.832 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 4096 2022-09-07T19:46:03.833 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2022-09-07T19:46:03.833 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 4096 2022-09-07T19:46:03.833 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2022-09-07T19:46:03.833 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 8192 2022-09-07T19:46:03.834 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2022-09-07T19:46:03.834 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 8192 2022-09-07T19:46:03.834 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2022-09-07T19:46:03.834 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 16384 2022-09-07T19:46:03.835 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2022-09-07T19:46:03.835 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 16384 2022-09-07T19:46:03.835 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2022-09-07T19:46:03.835 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 1024 2022-09-07T19:46:03.836 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2022-09-07T19:46:03.836 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 1024 2022-09-07T19:46:03.836 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2022-09-07T19:46:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 2048 2022-09-07T19:46:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2022-09-07T19:46:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 2048 2022-09-07T19:46:04.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2022-09-07T19:46:04.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 4096 2022-09-07T19:46:04.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2022-09-07T19:46:04.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 4096 2022-09-07T19:46:04.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2022-09-07T19:46:04.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 8192 2022-09-07T19:46:04.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2022-09-07T19:46:04.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 8192 2022-09-07T19:46:04.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2022-09-07T19:46:04.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 16384 2022-09-07T19:46:04.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2022-09-07T19:46:04.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 16384 2022-09-07T19:46:04.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2022-09-07T19:46:04.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 1024 2022-09-07T19:46:04.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2022-09-07T19:46:04.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 1024 2022-09-07T19:46:04.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2022-09-07T19:46:04.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 2048 2022-09-07T19:46:04.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2022-09-07T19:46:04.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 2048 2022-09-07T19:46:04.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2022-09-07T19:46:04.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 4096 2022-09-07T19:46:04.408 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2022-09-07T19:46:04.408 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 4096 2022-09-07T19:46:04.408 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2022-09-07T19:46:04.408 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 8192 2022-09-07T19:46:04.408 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2022-09-07T19:46:04.409 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 8192 2022-09-07T19:46:04.409 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2022-09-07T19:46:04.409 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 16384 2022-09-07T19:46:04.409 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2022-09-07T19:46:04.410 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 16384 2022-09-07T19:46:04.410 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2022-09-07T19:46:04.410 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 1024 2022-09-07T19:46:04.410 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2022-09-07T19:46:04.411 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 1024 2022-09-07T19:46:04.411 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2022-09-07T19:46:04.411 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 2048 2022-09-07T19:46:04.411 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2022-09-07T19:46:04.411 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 2048 2022-09-07T19:46:04.412 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2022-09-07T19:46:04.412 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 4096 2022-09-07T19:46:04.412 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2022-09-07T19:46:04.412 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 4096 2022-09-07T19:46:04.413 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2022-09-07T19:46:04.413 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 8192 2022-09-07T19:46:04.413 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2022-09-07T19:46:04.413 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 8192 2022-09-07T19:46:04.413 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2022-09-07T19:46:04.414 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 16384 2022-09-07T19:46:04.414 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2022-09-07T19:46:04.414 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 16384 2022-09-07T19:46:04.414 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2022-09-07T19:46:04.415 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 1024 2022-09-07T19:46:04.415 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2022-09-07T19:46:04.415 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 1024 2022-09-07T19:46:04.416 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2022-09-07T19:46:04.416 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 2048 2022-09-07T19:46:04.416 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2022-09-07T19:46:04.417 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 2048 2022-09-07T19:46:04.417 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2022-09-07T19:46:04.417 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 4096 2022-09-07T19:46:04.418 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2022-09-07T19:46:04.418 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 4096 2022-09-07T19:46:04.418 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2022-09-07T19:46:04.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 8192 2022-09-07T19:46:04.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2022-09-07T19:46:04.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 8192 2022-09-07T19:46:04.419 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2022-09-07T19:46:04.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 16384 2022-09-07T19:46:04.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2022-09-07T19:46:04.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 16384 2022-09-07T19:46:04.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2022-09-07T19:46:04.420 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 1024 2022-09-07T19:46:04.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2022-09-07T19:46:04.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 1024 2022-09-07T19:46:04.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2022-09-07T19:46:04.421 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 2048 2022-09-07T19:46:04.503 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2022-09-07T19:46:04.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 2048 2022-09-07T19:46:04.505 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2022-09-07T19:46:04.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 4096 2022-09-07T19:46:04.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2022-09-07T19:46:04.506 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 4096 2022-09-07T19:46:04.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2022-09-07T19:46:04.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 8192 2022-09-07T19:46:04.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2022-09-07T19:46:04.507 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 8192 2022-09-07T19:46:04.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2022-09-07T19:46:04.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 16384 2022-09-07T19:46:04.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2022-09-07T19:46:04.508 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 16384 2022-09-07T19:46:04.510 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-09-07T19:46:04.511 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-09-07T19:46:04.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:04 smithi080 ceph-mon[90124]: pgmap v51: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 468 KiB/s wr, 136 op/s 2022-09-07T19:46:04.610 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2022-09-07T19:46:04.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2022-09-07T19:46:04.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:04 smithi154 ceph-mon[96967]: pgmap v51: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 468 KiB/s wr, 136 op/s 2022-09-07T19:46:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:04 smithi155 ceph-mon[97606]: pgmap v51: 129 pgs: 129 active+clean; 557 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 468 KiB/s wr, 136 op/s 2022-09-07T19:46:05.796 DEBUG:teuthology.parallel:result is None 2022-09-07T19:46:05.798 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2022-09-07T19:46:05.898 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2022-09-07T19:46:05.898 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2022-09-07T19:46:05.911 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2022-09-07T19:46:05.912 INFO:teuthology.task.exec:Executing custom commands... 2022-09-07T19:46:05.912 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2022-09-07T19:46:05.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2022-09-07T19:46:06.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2022-09-07T19:46:06.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:06 smithi080 ceph-mon[90124]: pgmap v52: 129 pgs: 129 active+clean; 824 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 798 KiB/s wr, 201 op/s 2022-09-07T19:46:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:06 smithi154 ceph-mon[96967]: pgmap v52: 129 pgs: 129 active+clean; 824 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 798 KiB/s wr, 201 op/s 2022-09-07T19:46:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:06 smithi155 ceph-mon[97606]: pgmap v52: 129 pgs: 129 active+clean; 824 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 798 KiB/s wr, 201 op/s 2022-09-07T19:46:08.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:08 smithi080 ceph-mon[90124]: pgmap v53: 129 pgs: 129 active+clean; 824 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 549 KiB/s wr, 126 op/s 2022-09-07T19:46:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:08 smithi154 ceph-mon[96967]: pgmap v53: 129 pgs: 129 active+clean; 824 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 549 KiB/s wr, 126 op/s 2022-09-07T19:46:08.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:08 smithi155 ceph-mon[97606]: pgmap v53: 129 pgs: 129 active+clean; 824 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 549 KiB/s wr, 126 op/s 2022-09-07T19:46:10.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:10 smithi080 ceph-mon[90124]: pgmap v54: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 708 KiB/s wr, 208 op/s 2022-09-07T19:46:10.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:10 smithi154 ceph-mon[96967]: pgmap v54: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 708 KiB/s wr, 208 op/s 2022-09-07T19:46:10.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:10 smithi155 ceph-mon[97606]: pgmap v54: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 708 KiB/s wr, 208 op/s 2022-09-07T19:46:12.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:12 smithi080 ceph-mon[90124]: pgmap v55: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 489 KiB/s wr, 146 op/s 2022-09-07T19:46:12.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:12 smithi154 ceph-mon[96967]: pgmap v55: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 489 KiB/s wr, 146 op/s 2022-09-07T19:46:12.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:12 smithi155 ceph-mon[97606]: pgmap v55: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 489 KiB/s wr, 146 op/s 2022-09-07T19:46:14.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:14 smithi080 ceph-mon[90124]: pgmap v56: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 489 KiB/s wr, 146 op/s 2022-09-07T19:46:14.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:14 smithi154 ceph-mon[96967]: pgmap v56: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 489 KiB/s wr, 146 op/s 2022-09-07T19:46:14.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:14 smithi155 ceph-mon[97606]: pgmap v56: 129 pgs: 129 active+clean; 19 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 489 KiB/s wr, 146 op/s 2022-09-07T19:46:16.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:16 smithi080 ceph-mon[90124]: pgmap v57: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 495 KiB/s wr, 150 op/s 2022-09-07T19:46:16.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:16 smithi154 ceph-mon[96967]: pgmap v57: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 495 KiB/s wr, 150 op/s 2022-09-07T19:46:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:16 smithi155 ceph-mon[97606]: pgmap v57: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 495 KiB/s wr, 150 op/s 2022-09-07T19:46:18.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:18 smithi080 ceph-mon[90124]: pgmap v58: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 166 KiB/s wr, 85 op/s 2022-09-07T19:46:18.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:18 smithi154 ceph-mon[96967]: pgmap v58: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 166 KiB/s wr, 85 op/s 2022-09-07T19:46:18.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:18 smithi155 ceph-mon[97606]: pgmap v58: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 166 KiB/s wr, 85 op/s 2022-09-07T19:46:20.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:20 smithi080 ceph-mon[90124]: pgmap v59: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 166 KiB/s wr, 87 op/s 2022-09-07T19:46:20.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:20 smithi154 ceph-mon[96967]: pgmap v59: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 166 KiB/s wr, 87 op/s 2022-09-07T19:46:20.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:20 smithi155 ceph-mon[97606]: pgmap v59: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 166 KiB/s wr, 87 op/s 2022-09-07T19:46:22.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:22 smithi080 ceph-mon[90124]: pgmap v60: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2022-09-07T19:46:22.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:22 smithi154 ceph-mon[96967]: pgmap v60: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2022-09-07T19:46:22.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:22 smithi155 ceph-mon[97606]: pgmap v60: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2022-09-07T19:46:24.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:24 smithi080 ceph-mon[90124]: pgmap v61: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2022-09-07T19:46:24.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:24 smithi154 ceph-mon[96967]: pgmap v61: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2022-09-07T19:46:24.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:24 smithi155 ceph-mon[97606]: pgmap v61: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2022-09-07T19:46:26.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:26 smithi080 ceph-mon[90124]: pgmap v62: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 8 op/s 2022-09-07T19:46:26.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:26 smithi154 ceph-mon[96967]: pgmap v62: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 8 op/s 2022-09-07T19:46:26.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:26 smithi155 ceph-mon[97606]: pgmap v62: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 8 op/s 2022-09-07T19:46:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:46:27.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:27 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:46:27.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:27 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:46:27.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:27 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:46:27.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:46:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:27 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:46:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:46:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:27 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:46:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:46:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:27 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:46:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:46:27.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:27 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:46:28.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:28 smithi080 ceph-mon[90124]: pgmap v63: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:28.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:28 smithi154 ceph-mon[96967]: pgmap v63: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:28.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:28 smithi155 ceph-mon[97606]: pgmap v63: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:30.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:30 smithi080 ceph-mon[90124]: pgmap v64: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2022-09-07T19:46:30.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:30 smithi154 ceph-mon[96967]: pgmap v64: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2022-09-07T19:46:30.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:30 smithi155 ceph-mon[97606]: pgmap v64: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2022-09-07T19:46:32.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:32 smithi080 ceph-mon[90124]: pgmap v65: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:32.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:32 smithi154 ceph-mon[96967]: pgmap v65: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:32.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:32 smithi155 ceph-mon[97606]: pgmap v65: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:34.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:34 smithi080 ceph-mon[90124]: pgmap v66: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:34.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:34 smithi154 ceph-mon[96967]: pgmap v66: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:34.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:34 smithi155 ceph-mon[97606]: pgmap v66: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2022-09-07T19:46:36.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:36 smithi080 ceph-mon[90124]: pgmap v67: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2022-09-07T19:46:36.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:36 smithi154 ceph-mon[96967]: pgmap v67: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2022-09-07T19:46:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:36 smithi155 ceph-mon[97606]: pgmap v67: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2022-09-07T19:46:38.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:38 smithi080 ceph-mon[90124]: pgmap v68: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:38.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:38 smithi154 ceph-mon[96967]: pgmap v68: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:38.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:38 smithi155 ceph-mon[97606]: pgmap v68: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:40.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:40 smithi080 ceph-mon[90124]: pgmap v69: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:40.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:40 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:46:40.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:40 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:46:40.619 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:40 smithi080 ceph-mon[90124]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:46:40.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:40 smithi154 ceph-mon[96967]: pgmap v69: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:40 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:46:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:40 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:46:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:40 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:46:40.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:40 smithi155 ceph-mon[97606]: pgmap v69: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:40.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:40 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:46:40.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:40 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:46:40.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:40 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:46:42.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:41 smithi080 ceph-mon[90124]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:46:42.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:41 smithi080 ceph-mon[90124]: pgmap v70: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:42.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:41 smithi154 ceph-mon[96967]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:46:42.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:41 smithi154 ceph-mon[96967]: pgmap v70: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:42.196 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:41 smithi155 ceph-mon[97606]: from='mgr.15243 ' entity='mgr.x' 2022-09-07T19:46:42.197 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:41 smithi155 ceph-mon[97606]: pgmap v70: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:44.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:44 smithi080 ceph-mon[90124]: pgmap v71: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:44.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:44 smithi154 ceph-mon[96967]: pgmap v71: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:44.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:44 smithi155 ceph-mon[97606]: pgmap v71: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:46.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:46 smithi080 ceph-mon[90124]: pgmap v72: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:46 smithi154 ceph-mon[96967]: pgmap v72: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:46.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:46 smithi155 ceph-mon[97606]: pgmap v72: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:48.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:48 smithi080 ceph-mon[90124]: pgmap v73: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:48.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:48 smithi154 ceph-mon[96967]: pgmap v73: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:48.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:48 smithi155 ceph-mon[97606]: pgmap v73: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:50.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:50 smithi080 ceph-mon[90124]: pgmap v74: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:50.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:50 smithi154 ceph-mon[96967]: pgmap v74: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:50.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:50 smithi155 ceph-mon[97606]: pgmap v74: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:52.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:52 smithi080 ceph-mon[90124]: pgmap v75: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:52.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:52 smithi154 ceph-mon[96967]: pgmap v75: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:52.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:52 smithi155 ceph-mon[97606]: pgmap v75: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:54.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:54 smithi080 ceph-mon[90124]: pgmap v76: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:54.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:54 smithi154 ceph-mon[96967]: pgmap v76: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:54.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:54 smithi155 ceph-mon[97606]: pgmap v76: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:56.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:56 smithi080 ceph-mon[90124]: pgmap v77: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:56.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:56 smithi154 ceph-mon[96967]: pgmap v77: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:56.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:56 smithi155 ceph-mon[97606]: pgmap v77: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:46:58.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:46:58 smithi080 ceph-mon[90124]: pgmap v78: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:58.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:46:58 smithi154 ceph-mon[96967]: pgmap v78: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:46:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:46:58 smithi155 ceph-mon[97606]: pgmap v78: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:00.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:00 smithi080 ceph-mon[90124]: pgmap v79: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:00.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:00 smithi154 ceph-mon[96967]: pgmap v79: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:00 smithi155 ceph-mon[97606]: pgmap v79: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:04.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:04 smithi155 ceph-mon[97606]: pgmap v80: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:04.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:04 smithi155 ceph-mon[97606]: pgmap v81: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:47:04.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:04 smithi080 ceph-mon[90124]: pgmap v80: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:04.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:04 smithi080 ceph-mon[90124]: pgmap v81: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:47:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:04 smithi154 ceph-mon[96967]: pgmap v80: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:04 smithi154 ceph-mon[96967]: pgmap v81: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:47:07.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:07 smithi080 ceph-mon[90124]: pgmap v82: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 21 KiB/s wr, 11 op/s 2022-09-07T19:47:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:07 smithi154 ceph-mon[96967]: pgmap v82: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 21 KiB/s wr, 11 op/s 2022-09-07T19:47:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:07 smithi155 ceph-mon[97606]: pgmap v82: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 21 KiB/s wr, 11 op/s 2022-09-07T19:47:09.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:09 smithi080 ceph-mon[90124]: pgmap v83: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 21 KiB/s wr, 8 op/s 2022-09-07T19:47:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:09 smithi154 ceph-mon[96967]: pgmap v83: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 21 KiB/s wr, 8 op/s 2022-09-07T19:47:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:09 smithi155 ceph-mon[97606]: pgmap v83: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 21 KiB/s wr, 8 op/s 2022-09-07T19:47:11.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:11 smithi080 ceph-mon[90124]: pgmap v84: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2022-09-07T19:47:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:11 smithi154 ceph-mon[96967]: pgmap v84: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2022-09-07T19:47:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:11 smithi155 ceph-mon[97606]: pgmap v84: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2022-09-07T19:47:13.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:13 smithi080 ceph-mon[90124]: pgmap v85: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 KiB/s wr, 16 op/s 2022-09-07T19:47:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:13 smithi154 ceph-mon[96967]: pgmap v85: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 KiB/s wr, 16 op/s 2022-09-07T19:47:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:13 smithi155 ceph-mon[97606]: pgmap v85: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 KiB/s wr, 16 op/s 2022-09-07T19:47:15.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:15 smithi080 ceph-mon[90124]: pgmap v86: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2022-09-07T19:47:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:15 smithi154 ceph-mon[96967]: pgmap v86: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2022-09-07T19:47:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:15 smithi155 ceph-mon[97606]: pgmap v86: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2022-09-07T19:47:17.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:17 smithi080 ceph-mon[90124]: pgmap v87: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:47:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:17 smithi154 ceph-mon[96967]: pgmap v87: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:47:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:17 smithi155 ceph-mon[97606]: pgmap v87: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:47:19.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Sep 07 19:47:19 smithi080 ceph-mon[90124]: pgmap v88: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 170 B/s wr, 13 op/s 2022-09-07T19:47:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:19 smithi154 ceph-mon[96967]: pgmap v88: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 170 B/s wr, 13 op/s 2022-09-07T19:47:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:19 smithi155 ceph-mon[97606]: pgmap v88: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 170 B/s wr, 13 op/s 2022-09-07T19:47:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v89: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 170 B/s wr, 15 op/s 2022-09-07T19:47:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v90: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:47:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v91: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:47:35.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v92: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:35.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:47:35.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:47:35.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v93: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:35.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v94: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:35.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: mon.b calling monitor election 2022-09-07T19:47:35.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: mon.c calling monitor election 2022-09-07T19:47:35.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v95: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:35.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: pgmap v96: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:35.628 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2022-09-07T19:47:35.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:47:35.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2022-09-07T19:47:35.631 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: osdmap e94: 12 total, 12 up, 12 in 2022-09-07T19:47:35.632 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: mgrmap e25: x(active, since 3m), standbys: z, y 2022-09-07T19:47:35.632 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2022-09-07T19:47:35.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2022-09-07T19:47:35.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2022-09-07T19:47:35.634 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:35 smithi154 ceph-mon[96967]: mon.a (rank 0) addr [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] is down (out of quorum) 2022-09-07T19:47:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v89: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 170 B/s wr, 15 op/s 2022-09-07T19:47:35.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v90: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:47:35.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v91: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:47:35.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v92: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:35.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:47:35.699 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:47:35.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v93: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:35.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v94: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:35.700 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: mon.b calling monitor election 2022-09-07T19:47:35.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: mon.c calling monitor election 2022-09-07T19:47:35.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v95: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:35.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: pgmap v96: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:35.701 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2022-09-07T19:47:35.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0],c=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} 2022-09-07T19:47:35.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2022-09-07T19:47:35.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: osdmap e94: 12 total, 12 up, 12 in 2022-09-07T19:47:35.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: mgrmap e25: x(active, since 3m), standbys: z, y 2022-09-07T19:47:35.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2022-09-07T19:47:35.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2022-09-07T19:47:35.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2022-09-07T19:47:35.703 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:35 smithi155 ceph-mon[97606]: mon.a (rank 0) addr [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] is down (out of quorum) 2022-09-07T19:47:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:36 smithi154 ceph-mon[96967]: pgmap v97: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:36 smithi155 ceph-mon[97606]: pgmap v97: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:38.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:38 smithi155 ceph-mon[97606]: pgmap v98: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:38 smithi154 ceph-mon[96967]: pgmap v98: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:41.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:41 smithi154 ceph-mon[96967]: pgmap v99: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:41.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:41 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:47:41.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:41 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:47:41.375 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:41 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:47:41.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:41 smithi155 ceph-mon[97606]: pgmap v99: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:41.446 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:41 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-09-07T19:47:41.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:41 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-09-07T19:47:41.447 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:41 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-09-07T19:47:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:43 smithi154 ceph-mon[96967]: pgmap v100: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:43 smithi155 ceph-mon[97606]: pgmap v100: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:45 smithi154 ceph-mon[96967]: pgmap v101: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:45 smithi155 ceph-mon[97606]: pgmap v101: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:47 smithi154 ceph-mon[96967]: pgmap v102: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:47 smithi155 ceph-mon[97606]: pgmap v102: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:49 smithi154 ceph-mon[96967]: pgmap v103: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:49 smithi155 ceph-mon[97606]: pgmap v103: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:51 smithi154 ceph-mon[96967]: pgmap v104: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:51 smithi155 ceph-mon[97606]: pgmap v104: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:53 smithi154 ceph-mon[96967]: pgmap v105: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:53 smithi155 ceph-mon[97606]: pgmap v105: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:55 smithi154 ceph-mon[96967]: pgmap v106: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:55 smithi155 ceph-mon[97606]: pgmap v106: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:47:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:57 smithi154 ceph-mon[96967]: pgmap v107: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:57 smithi155 ceph-mon[97606]: pgmap v107: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:47:59 smithi154 ceph-mon[96967]: pgmap v108: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:47:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:47:59 smithi155 ceph-mon[97606]: pgmap v108: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:01 smithi154 ceph-mon[96967]: pgmap v109: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:01 smithi155 ceph-mon[97606]: pgmap v109: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:03 smithi154 ceph-mon[96967]: pgmap v110: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:03 smithi155 ceph-mon[97606]: pgmap v110: 129 pgs: 129 active+clean; 19 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:05 smithi154 ceph-mon[96967]: pgmap v111: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:48:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:05 smithi155 ceph-mon[97606]: pgmap v111: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:48:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:07 smithi154 ceph-mon[96967]: pgmap v112: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:48:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:07 smithi155 ceph-mon[97606]: pgmap v112: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:48:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:09 smithi154 ceph-mon[96967]: pgmap v113: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:48:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:09 smithi155 ceph-mon[97606]: pgmap v113: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:48:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:11 smithi154 ceph-mon[96967]: pgmap v114: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:48:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:11 smithi155 ceph-mon[97606]: pgmap v114: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:48:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:13 smithi154 ceph-mon[96967]: pgmap v115: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:48:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:13 smithi155 ceph-mon[97606]: pgmap v115: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:48:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:15 smithi154 ceph-mon[96967]: pgmap v116: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:48:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:15 smithi155 ceph-mon[97606]: pgmap v116: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:48:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:17 smithi154 ceph-mon[96967]: pgmap v117: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:48:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:17 smithi155 ceph-mon[97606]: pgmap v117: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:48:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:19 smithi154 ceph-mon[96967]: pgmap v118: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:48:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:19 smithi155 ceph-mon[97606]: pgmap v118: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:48:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:21 smithi154 ceph-mon[96967]: pgmap v119: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2022-09-07T19:48:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:21 smithi155 ceph-mon[97606]: pgmap v119: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2022-09-07T19:48:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:23 smithi154 ceph-mon[96967]: pgmap v120: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:48:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:23 smithi155 ceph-mon[97606]: pgmap v120: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:48:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:25 smithi154 ceph-mon[96967]: pgmap v121: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:48:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:25 smithi155 ceph-mon[97606]: pgmap v121: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:48:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:27 smithi154 ceph-mon[96967]: pgmap v122: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:27 smithi155 ceph-mon[97606]: pgmap v122: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:29 smithi154 ceph-mon[96967]: pgmap v123: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:29 smithi155 ceph-mon[97606]: pgmap v123: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:31 smithi154 ceph-mon[96967]: pgmap v124: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:31 smithi155 ceph-mon[97606]: pgmap v124: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:32.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:32 smithi154 ceph-mon[96967]: pgmap v125: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:32.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:32 smithi155 ceph-mon[97606]: pgmap v125: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:34 smithi154 ceph-mon[96967]: pgmap v126: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:34.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:34 smithi155 ceph-mon[97606]: pgmap v126: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:36 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:48:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:36 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:48:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:36 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:48:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:36 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:48:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:37 smithi154 ceph-mon[96967]: pgmap v127: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:37 smithi155 ceph-mon[97606]: pgmap v127: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:39 smithi154 ceph-mon[96967]: pgmap v128: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:39 smithi155 ceph-mon[97606]: pgmap v128: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:40 smithi154 ceph-mon[96967]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2022-09-07T19:48:40.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:40 smithi154 ceph-mon[96967]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 5 up:standby 2022-09-07T19:48:40.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:40 smithi155 ceph-mon[97606]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2022-09-07T19:48:40.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:40 smithi155 ceph-mon[97606]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 3 up:standby-replay 5 up:standby 2022-09-07T19:48:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:41 smithi154 ceph-mon[96967]: pgmap v129: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:41 smithi155 ceph-mon[97606]: pgmap v129: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:43 smithi154 ceph-mon[96967]: pgmap v130: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:43 smithi155 ceph-mon[97606]: pgmap v130: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:44 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:44 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:44 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:44 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:45 smithi154 ceph-mon[96967]: pgmap v131: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:45 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:45 smithi155 ceph-mon[97606]: pgmap v131: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:45.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:45 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:46 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:46.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:46 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:47 smithi154 ceph-mon[96967]: pgmap v132: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:47.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:47 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:47 smithi155 ceph-mon[97606]: pgmap v132: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:47 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:48.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:48 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:48.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:48 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:49 smithi154 ceph-mon[96967]: pgmap v133: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:49.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:49 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:49 smithi155 ceph-mon[97606]: pgmap v133: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:49.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:49 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:50 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:50.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:50 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:51 smithi154 ceph-mon[96967]: pgmap v134: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:51 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:51 smithi155 ceph-mon[97606]: pgmap v134: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:51 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:52.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:52 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:52.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:52 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:53 smithi154 ceph-mon[96967]: pgmap v135: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:53 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:53 smithi155 ceph-mon[97606]: pgmap v135: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:53 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:54.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:54 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:54.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:54 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:55 smithi154 ceph-mon[96967]: pgmap v136: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:55.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:55 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:55.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:55 smithi155 ceph-mon[97606]: pgmap v136: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:48:55.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:55 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:56.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:56 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:56.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:56 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:57 smithi154 ceph-mon[96967]: pgmap v137: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:57 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:57 smithi155 ceph-mon[97606]: pgmap v137: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:57.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:57 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:58.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:58 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:58.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:58 smithi154 ceph-mon[96967]: pgmap v138: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:58 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:58 smithi155 ceph-mon[97606]: pgmap v138: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:48:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:48:59 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:48:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:48:59 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:00.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:00 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:00.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:00 smithi154 ceph-mon[96967]: pgmap v139: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:00 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:00 smithi155 ceph-mon[97606]: pgmap v139: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:01 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:01 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:02.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:02 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:02.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:02 smithi154 ceph-mon[96967]: pgmap v140: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:02.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:02 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:02.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:02 smithi155 ceph-mon[97606]: pgmap v140: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:03 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:03 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:04.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:04 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:04.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:04 smithi154 ceph-mon[96967]: pgmap v141: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:49:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:04 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:04.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:04 smithi155 ceph-mon[97606]: pgmap v141: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:49:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:05 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:05 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:05 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:05 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:06 smithi154 ceph-mon[96967]: pgmap v142: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:49:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:06 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:06 smithi155 ceph-mon[97606]: pgmap v142: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:49:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:06 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:07 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:07 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:08 smithi154 ceph-mon[96967]: pgmap v143: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:49:08.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:08 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:08.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:08 smithi155 ceph-mon[97606]: pgmap v143: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:49:08.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:08 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:09 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:09 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:11 smithi154 ceph-mon[96967]: pgmap v144: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:49:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:11 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:11 smithi155 ceph-mon[97606]: pgmap v144: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:49:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:11 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:12.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:12 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:12.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:12 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:13 smithi154 ceph-mon[96967]: pgmap v145: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:49:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:13 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:13 smithi155 ceph-mon[97606]: pgmap v145: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:49:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:13 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:14.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:14 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:14.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:14 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:15 smithi154 ceph-mon[96967]: pgmap v146: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:49:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:15 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:15 smithi155 ceph-mon[97606]: pgmap v146: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:49:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:15 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:16 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:16 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:17 smithi154 ceph-mon[96967]: pgmap v147: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:49:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:17 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:17 smithi155 ceph-mon[97606]: pgmap v147: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:49:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:17 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:18.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:18 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:18.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:18 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:19 smithi154 ceph-mon[96967]: pgmap v148: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:49:19.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:19 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:19 smithi155 ceph-mon[97606]: pgmap v148: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:49:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:19 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:20.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:20 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:20.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:20 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:21 smithi154 ceph-mon[96967]: pgmap v149: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2022-09-07T19:49:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:21 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:21 smithi155 ceph-mon[97606]: pgmap v149: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2022-09-07T19:49:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:21 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:22.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:22 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:22.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:22 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:23 smithi154 ceph-mon[96967]: pgmap v150: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:49:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:23 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:23 smithi155 ceph-mon[97606]: pgmap v150: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:49:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:23 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:24.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:24 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:24.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:24 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:25 smithi154 ceph-mon[96967]: pgmap v151: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:49:25.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:25 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:25 smithi155 ceph-mon[97606]: pgmap v151: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:49:25.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:25 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:26.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:26 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:26.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:26 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:27 smithi154 ceph-mon[96967]: pgmap v152: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:27 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:27 smithi155 ceph-mon[97606]: pgmap v152: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:27 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:28.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:28 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:28.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:28 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:29 smithi154 ceph-mon[96967]: pgmap v153: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:29 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:29 smithi155 ceph-mon[97606]: pgmap v153: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:29 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:30.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:30 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:30.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:30 smithi154 ceph-mon[96967]: pgmap v154: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:30.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:30 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:30.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:30 smithi155 ceph-mon[97606]: pgmap v154: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:31 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:31 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:32.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:32 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:32.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:32 smithi154 ceph-mon[96967]: pgmap v155: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:32.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:32 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:32.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:32 smithi155 ceph-mon[97606]: pgmap v155: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:33 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:33 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:34 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:34.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:34 smithi154 ceph-mon[96967]: pgmap v156: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:34.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:34 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:34.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:34 smithi155 ceph-mon[97606]: pgmap v156: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:49:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:49:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:49:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:49:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:36 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:36.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:36 smithi154 ceph-mon[96967]: pgmap v157: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:36.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:36 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:36 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:36 smithi155 ceph-mon[97606]: pgmap v157: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:36 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:37 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:37 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:38.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:38 smithi154 ceph-mon[96967]: pgmap v158: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:38.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:38 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:38.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:38 smithi155 ceph-mon[97606]: pgmap v158: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:38.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:38 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:39 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:39 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:41 smithi154 ceph-mon[96967]: pgmap v159: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:41.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:41 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:41 smithi155 ceph-mon[97606]: pgmap v159: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:41 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:42.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:42 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:42.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:42 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:43 smithi154 ceph-mon[96967]: pgmap v160: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:43 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:43 smithi155 ceph-mon[97606]: pgmap v160: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:43 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:44 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:44 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:45 smithi154 ceph-mon[96967]: pgmap v161: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:45 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:45 smithi155 ceph-mon[97606]: pgmap v161: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:45 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:46.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:46 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:46.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:46 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:47.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:47 smithi154 ceph-mon[96967]: pgmap v162: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:47.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:47 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:47 smithi155 ceph-mon[97606]: pgmap v162: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:47.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:47 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:48.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:48 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:48.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:48 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:49 smithi154 ceph-mon[96967]: pgmap v163: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:49.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:49 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:49 smithi155 ceph-mon[97606]: pgmap v163: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:49.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:49 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:50.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:50 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:50.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:50 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:51 smithi154 ceph-mon[96967]: pgmap v164: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:51.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:51 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:51 smithi155 ceph-mon[97606]: pgmap v164: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:51 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:52.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:52 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:52.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:52 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:53 smithi154 ceph-mon[96967]: pgmap v165: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:53.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:53 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:53 smithi155 ceph-mon[97606]: pgmap v165: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:53 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:54.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:54 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:54.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:54 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:55.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:55 smithi154 ceph-mon[96967]: pgmap v166: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:55.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:55 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:55 smithi155 ceph-mon[97606]: pgmap v166: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:49:55.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:55 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:56.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:56 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:56.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:56 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:57 smithi154 ceph-mon[96967]: pgmap v167: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:57 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:57 smithi155 ceph-mon[97606]: pgmap v167: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:57.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:57 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:58 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:58 smithi154 ceph-mon[96967]: pgmap v168: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:58.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:58 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:58.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:58 smithi155 ceph-mon[97606]: pgmap v168: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:49:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:49:59 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:49:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:49:59 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:00.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:00 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:00.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:00 smithi154 ceph-mon[96967]: pgmap v169: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:00.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:00 smithi154 ceph-mon[96967]: overall HEALTH_WARN 1/3 mons down, quorum c,b 2022-09-07T19:50:00.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:00 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:00.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:00 smithi155 ceph-mon[97606]: pgmap v169: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:00.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:00 smithi155 ceph-mon[97606]: overall HEALTH_WARN 1/3 mons down, quorum c,b 2022-09-07T19:50:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:01 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:01 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:02.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:02 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:02.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:02 smithi154 ceph-mon[96967]: pgmap v170: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:02.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:02 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:02.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:02 smithi155 ceph-mon[97606]: pgmap v170: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:03 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:03 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:03 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:03.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:03 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:04.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:04 smithi154 ceph-mon[96967]: pgmap v171: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:50:04.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:04 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:04 smithi155 ceph-mon[97606]: pgmap v171: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2022-09-07T19:50:04.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:04 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:06.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:06 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:06.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:06 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:07 smithi154 ceph-mon[96967]: pgmap v172: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:50:07.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:07 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:07 smithi155 ceph-mon[97606]: pgmap v172: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:50:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:07 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:08.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:08 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:08.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:08 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:09 smithi154 ceph-mon[96967]: pgmap v173: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:50:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:09 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:09 smithi155 ceph-mon[97606]: pgmap v173: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:50:09.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:09 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2022-09-07T19:50:11.626 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:11 smithi154 ceph-mon[96967]: pgmap v174: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:50:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:11 smithi155 ceph-mon[97606]: pgmap v174: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:50:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:13 smithi154 ceph-mon[96967]: pgmap v175: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:50:13.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:13 smithi155 ceph-mon[97606]: pgmap v175: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2022-09-07T19:50:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:15 smithi154 ceph-mon[96967]: pgmap v176: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:50:15.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:15 smithi155 ceph-mon[97606]: pgmap v176: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2022-09-07T19:50:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:17 smithi154 ceph-mon[96967]: pgmap v177: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:50:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:17 smithi155 ceph-mon[97606]: pgmap v177: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:50:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:19 smithi154 ceph-mon[96967]: pgmap v178: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:50:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:19 smithi155 ceph-mon[97606]: pgmap v178: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2022-09-07T19:50:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:21 smithi154 ceph-mon[96967]: pgmap v179: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2022-09-07T19:50:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:21 smithi155 ceph-mon[97606]: pgmap v179: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2022-09-07T19:50:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:23 smithi154 ceph-mon[96967]: pgmap v180: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:50:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:23 smithi155 ceph-mon[97606]: pgmap v180: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:50:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:25 smithi154 ceph-mon[96967]: pgmap v181: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:50:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:25 smithi155 ceph-mon[97606]: pgmap v181: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:50:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:27 smithi154 ceph-mon[96967]: pgmap v182: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:27 smithi155 ceph-mon[97606]: pgmap v182: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:29 smithi154 ceph-mon[96967]: pgmap v183: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:29 smithi155 ceph-mon[97606]: pgmap v183: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:31 smithi154 ceph-mon[96967]: pgmap v184: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:31.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:31 smithi155 ceph-mon[97606]: pgmap v184: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:33 smithi154 ceph-mon[96967]: pgmap v185: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:33 smithi155 ceph-mon[97606]: pgmap v185: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:35 smithi154 ceph-mon[96967]: pgmap v186: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:50:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:50:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:35 smithi155 ceph-mon[97606]: pgmap v186: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:50:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:50:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:37 smithi154 ceph-mon[96967]: pgmap v187: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:37 smithi155 ceph-mon[97606]: pgmap v187: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:39 smithi154 ceph-mon[96967]: pgmap v188: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:39 smithi155 ceph-mon[97606]: pgmap v188: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:41 smithi154 ceph-mon[96967]: pgmap v189: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:41 smithi155 ceph-mon[97606]: pgmap v189: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:43 smithi154 ceph-mon[96967]: pgmap v190: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:43 smithi155 ceph-mon[97606]: pgmap v190: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:45 smithi154 ceph-mon[96967]: pgmap v191: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:45.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:45 smithi155 ceph-mon[97606]: pgmap v191: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:47 smithi154 ceph-mon[96967]: pgmap v192: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:47 smithi155 ceph-mon[97606]: pgmap v192: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:49 smithi154 ceph-mon[96967]: pgmap v193: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:49.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:49 smithi155 ceph-mon[97606]: pgmap v193: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:51 smithi154 ceph-mon[96967]: pgmap v194: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:51 smithi155 ceph-mon[97606]: pgmap v194: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:53 smithi154 ceph-mon[96967]: pgmap v195: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:53 smithi155 ceph-mon[97606]: pgmap v195: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:55 smithi154 ceph-mon[96967]: pgmap v196: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:55 smithi155 ceph-mon[97606]: pgmap v196: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:50:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:57 smithi154 ceph-mon[96967]: pgmap v197: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:57 smithi155 ceph-mon[97606]: pgmap v197: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:50:59 smithi154 ceph-mon[96967]: pgmap v198: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:50:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:50:59 smithi155 ceph-mon[97606]: pgmap v198: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:01.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:01 smithi154 ceph-mon[96967]: pgmap v199: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:01 smithi155 ceph-mon[97606]: pgmap v199: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:03 smithi154 ceph-mon[96967]: pgmap v200: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:03 smithi155 ceph-mon[97606]: pgmap v200: 129 pgs: 129 active+clean; 19 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:05 smithi154 ceph-mon[96967]: pgmap v201: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:51:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:05 smithi155 ceph-mon[97606]: pgmap v201: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:51:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:07 smithi154 ceph-mon[96967]: pgmap v202: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:51:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:07 smithi155 ceph-mon[97606]: pgmap v202: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:51:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:09 smithi154 ceph-mon[96967]: pgmap v203: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:51:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:09 smithi155 ceph-mon[97606]: pgmap v203: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:51:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:11 smithi154 ceph-mon[96967]: pgmap v204: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:51:11.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:11 smithi154 ceph-mon[96967]: osdmap e95: 12 total, 12 up, 12 in 2022-09-07T19:51:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:11 smithi155 ceph-mon[97606]: pgmap v204: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:51:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:11 smithi155 ceph-mon[97606]: osdmap e95: 12 total, 12 up, 12 in 2022-09-07T19:51:12.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:12 smithi155 ceph-mon[97606]: pgmap v206: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:51:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:12 smithi154 ceph-mon[96967]: pgmap v206: 129 pgs: 129 active+clean; 19 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:51:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:14 smithi154 ceph-mon[96967]: pgmap v207: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:51:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:14 smithi155 ceph-mon[97606]: pgmap v207: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:51:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:16 smithi154 ceph-mon[96967]: osdmap e96: 12 total, 12 up, 12 in 2022-09-07T19:51:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:16 smithi155 ceph-mon[97606]: osdmap e96: 12 total, 12 up, 12 in 2022-09-07T19:51:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:17 smithi154 ceph-mon[96967]: pgmap v209: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:51:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:17 smithi155 ceph-mon[97606]: pgmap v209: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:51:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:19 smithi154 ceph-mon[96967]: pgmap v210: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T19:51:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:19 smithi155 ceph-mon[97606]: pgmap v210: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T19:51:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:21 smithi154 ceph-mon[96967]: pgmap v211: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 225 B/s wr, 7 op/s 2022-09-07T19:51:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:21 smithi155 ceph-mon[97606]: pgmap v211: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 225 B/s wr, 7 op/s 2022-09-07T19:51:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:23 smithi154 ceph-mon[96967]: pgmap v212: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:51:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:23 smithi155 ceph-mon[97606]: pgmap v212: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:51:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:25 smithi154 ceph-mon[96967]: pgmap v213: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:51:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:25 smithi155 ceph-mon[97606]: pgmap v213: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:51:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:27 smithi154 ceph-mon[96967]: pgmap v214: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:51:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:27 smithi155 ceph-mon[97606]: pgmap v214: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:51:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:29 smithi154 ceph-mon[96967]: pgmap v215: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:51:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:29 smithi155 ceph-mon[97606]: pgmap v215: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:51:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:31 smithi154 ceph-mon[96967]: pgmap v216: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:51:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:31 smithi155 ceph-mon[97606]: pgmap v216: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:51:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:33 smithi154 ceph-mon[96967]: pgmap v217: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:33 smithi155 ceph-mon[97606]: pgmap v217: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:35 smithi154 ceph-mon[96967]: pgmap v218: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:51:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:51:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:35 smithi155 ceph-mon[97606]: pgmap v218: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:51:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:51:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:37 smithi154 ceph-mon[96967]: pgmap v219: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:37 smithi155 ceph-mon[97606]: pgmap v219: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:39 smithi154 ceph-mon[96967]: pgmap v220: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:39 smithi155 ceph-mon[97606]: pgmap v220: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:41 smithi154 ceph-mon[96967]: pgmap v221: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:41 smithi155 ceph-mon[97606]: pgmap v221: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:43 smithi154 ceph-mon[96967]: pgmap v222: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:43 smithi155 ceph-mon[97606]: pgmap v222: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:45 smithi154 ceph-mon[96967]: pgmap v223: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:45 smithi155 ceph-mon[97606]: pgmap v223: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:47 smithi154 ceph-mon[96967]: pgmap v224: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:47 smithi155 ceph-mon[97606]: pgmap v224: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:49 smithi154 ceph-mon[96967]: pgmap v225: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:49 smithi155 ceph-mon[97606]: pgmap v225: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:51 smithi154 ceph-mon[96967]: pgmap v226: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:51 smithi155 ceph-mon[97606]: pgmap v226: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:53 smithi154 ceph-mon[96967]: pgmap v227: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:53 smithi155 ceph-mon[97606]: pgmap v227: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:51:54.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:54 smithi154 ceph-mon[96967]: evicting unresponsive client smithi080:0 (25300), after 302.657 seconds 2022-09-07T19:51:54.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:54 smithi154 ceph-mon[96967]: Evicting (and blocklisting) client session 25300 (172.21.15.80:0/71549459) 2022-09-07T19:51:54.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:54 smithi154 ceph-mon[96967]: from='mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646]' entity='mds.a' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.80:0/71549459"}]: dispatch 2022-09-07T19:51:54.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:54 smithi154 ceph-mon[96967]: from='mds.? ' entity='mds.a' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.80:0/71549459"}]: dispatch 2022-09-07T19:51:54.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:54 smithi155 ceph-mon[97606]: evicting unresponsive client smithi080:0 (25300), after 302.657 seconds 2022-09-07T19:51:54.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:54 smithi155 ceph-mon[97606]: Evicting (and blocklisting) client session 25300 (172.21.15.80:0/71549459) 2022-09-07T19:51:54.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:54 smithi155 ceph-mon[97606]: from='mds.? [v2:172.21.15.80:6840/1430605646,v1:172.21.15.80:6841/1430605646]' entity='mds.a' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.80:0/71549459"}]: dispatch 2022-09-07T19:51:54.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:54 smithi155 ceph-mon[97606]: from='mds.? ' entity='mds.a' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.80:0/71549459"}]: dispatch 2022-09-07T19:51:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:55 smithi154 ceph-mon[96967]: pgmap v228: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:55 smithi154 ceph-mon[96967]: from='mds.? ' entity='mds.a' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.80:0/71549459"}]': finished 2022-09-07T19:51:55.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:55 smithi154 ceph-mon[96967]: osdmap e97: 12 total, 12 up, 12 in 2022-09-07T19:51:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:55 smithi155 ceph-mon[97606]: pgmap v228: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:51:55.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:55 smithi155 ceph-mon[97606]: from='mds.? ' entity='mds.a' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.80:0/71549459"}]': finished 2022-09-07T19:51:55.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:55 smithi155 ceph-mon[97606]: osdmap e97: 12 total, 12 up, 12 in 2022-09-07T19:51:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:57 smithi154 ceph-mon[96967]: pgmap v230: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:51:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:57 smithi155 ceph-mon[97606]: pgmap v230: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:51:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:51:59 smithi154 ceph-mon[96967]: pgmap v231: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:51:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:51:59 smithi155 ceph-mon[97606]: pgmap v231: 129 pgs: 129 active+clean; 19 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2022-09-07T19:52:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:01 smithi154 ceph-mon[96967]: pgmap v232: 129 pgs: 129 active+clean; 19 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2022-09-07T19:52:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:01 smithi155 ceph-mon[97606]: pgmap v232: 129 pgs: 129 active+clean; 19 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2022-09-07T19:52:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:03 smithi154 ceph-mon[96967]: pgmap v233: 129 pgs: 129 active+clean; 19 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2022-09-07T19:52:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:03 smithi155 ceph-mon[97606]: pgmap v233: 129 pgs: 129 active+clean; 19 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2022-09-07T19:52:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:05 smithi154 ceph-mon[96967]: pgmap v234: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2022-09-07T19:52:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:05 smithi155 ceph-mon[97606]: pgmap v234: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2022-09-07T19:52:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:07 smithi154 ceph-mon[96967]: pgmap v235: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 48 KiB/s wr, 22 op/s 2022-09-07T19:52:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:07 smithi155 ceph-mon[97606]: pgmap v235: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 48 KiB/s wr, 22 op/s 2022-09-07T19:52:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:09 smithi154 ceph-mon[96967]: pgmap v236: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 20 op/s 2022-09-07T19:52:09.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:09 smithi155 ceph-mon[97606]: pgmap v236: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 20 op/s 2022-09-07T19:52:10.631 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:10 smithi154 ceph-mon[96967]: osdmap e98: 12 total, 12 up, 12 in 2022-09-07T19:52:10.632 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:10 smithi154 ceph-mon[96967]: pgmap v238: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:52:10.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:10 smithi155 ceph-mon[97606]: osdmap e98: 12 total, 12 up, 12 in 2022-09-07T19:52:10.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:10 smithi155 ceph-mon[97606]: pgmap v238: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:52:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:12 smithi154 ceph-mon[96967]: pgmap v239: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:52:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:12 smithi155 ceph-mon[97606]: pgmap v239: 129 pgs: 129 active+clean; 19 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:52:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:14 smithi154 ceph-mon[96967]: pgmap v240: 129 pgs: 129 active+clean; 15 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2022-09-07T19:52:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:14 smithi155 ceph-mon[97606]: pgmap v240: 129 pgs: 129 active+clean; 15 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2022-09-07T19:52:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:16 smithi154 ceph-mon[96967]: osdmap e99: 12 total, 12 up, 12 in 2022-09-07T19:52:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:16 smithi155 ceph-mon[97606]: osdmap e99: 12 total, 12 up, 12 in 2022-09-07T19:52:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:17 smithi154 ceph-mon[96967]: pgmap v242: 129 pgs: 129 active+clean; 15 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2022-09-07T19:52:17.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:17 smithi155 ceph-mon[97606]: pgmap v242: 129 pgs: 129 active+clean; 15 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2022-09-07T19:52:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:19 smithi154 ceph-mon[96967]: pgmap v243: 129 pgs: 129 active+clean; 15 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 253 B/s wr, 3 op/s 2022-09-07T19:52:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:19 smithi155 ceph-mon[97606]: pgmap v243: 129 pgs: 129 active+clean; 15 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 253 B/s wr, 3 op/s 2022-09-07T19:52:21.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:21 smithi154 ceph-mon[96967]: pgmap v244: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2022-09-07T19:52:21.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:21 smithi155 ceph-mon[97606]: pgmap v244: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2022-09-07T19:52:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:23 smithi154 ceph-mon[96967]: pgmap v245: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2022-09-07T19:52:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:23 smithi155 ceph-mon[97606]: pgmap v245: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2022-09-07T19:52:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:25 smithi154 ceph-mon[96967]: pgmap v246: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:52:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:25 smithi155 ceph-mon[97606]: pgmap v246: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:52:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:27 smithi154 ceph-mon[96967]: pgmap v247: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:52:27.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:27 smithi155 ceph-mon[97606]: pgmap v247: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:52:29.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:29 smithi154 ceph-mon[96967]: pgmap v248: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:52:29.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:29 smithi155 ceph-mon[97606]: pgmap v248: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:52:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:31 smithi154 ceph-mon[96967]: pgmap v249: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:52:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:31 smithi155 ceph-mon[97606]: pgmap v249: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:52:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:33 smithi154 ceph-mon[96967]: pgmap v250: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:52:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:33 smithi155 ceph-mon[97606]: pgmap v250: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:52:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:35 smithi154 ceph-mon[96967]: pgmap v251: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:52:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:52:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:35 smithi155 ceph-mon[97606]: pgmap v251: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:52:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:52:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:37 smithi154 ceph-mon[96967]: pgmap v252: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:52:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:37 smithi155 ceph-mon[97606]: pgmap v252: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:52:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:39 smithi154 ceph-mon[96967]: pgmap v253: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:52:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:39 smithi155 ceph-mon[97606]: pgmap v253: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:52:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:41 smithi154 ceph-mon[96967]: pgmap v254: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:41 smithi155 ceph-mon[97606]: pgmap v254: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:43 smithi154 ceph-mon[96967]: pgmap v255: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:43 smithi155 ceph-mon[97606]: pgmap v255: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:44.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:44 smithi154 ceph-mon[96967]: pgmap v256: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:44.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:44 smithi155 ceph-mon[97606]: pgmap v256: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:47 smithi154 ceph-mon[96967]: pgmap v257: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:47 smithi155 ceph-mon[97606]: pgmap v257: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:49.627 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:49 smithi154 ceph-mon[96967]: pgmap v258: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:49 smithi155 ceph-mon[97606]: pgmap v258: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:51.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:51 smithi154 ceph-mon[96967]: pgmap v259: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:51 smithi155 ceph-mon[97606]: pgmap v259: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:53 smithi154 ceph-mon[96967]: pgmap v260: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:53 smithi155 ceph-mon[97606]: pgmap v260: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:55 smithi154 ceph-mon[96967]: pgmap v261: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:55 smithi155 ceph-mon[97606]: pgmap v261: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:52:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:57 smithi154 ceph-mon[96967]: pgmap v262: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:57.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:57 smithi155 ceph-mon[97606]: pgmap v262: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:52:59 smithi154 ceph-mon[96967]: pgmap v263: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:52:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:52:59 smithi155 ceph-mon[97606]: pgmap v263: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:01 smithi154 ceph-mon[96967]: pgmap v264: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:01 smithi155 ceph-mon[97606]: pgmap v264: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:03 smithi154 ceph-mon[96967]: pgmap v265: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:03 smithi155 ceph-mon[97606]: pgmap v265: 129 pgs: 129 active+clean; 15 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:05.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:05 smithi154 ceph-mon[96967]: pgmap v266: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:53:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:05 smithi155 ceph-mon[97606]: pgmap v266: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:53:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:07 smithi154 ceph-mon[96967]: pgmap v267: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:53:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:07 smithi155 ceph-mon[97606]: pgmap v267: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:53:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:09 smithi154 ceph-mon[96967]: pgmap v268: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:53:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:09 smithi155 ceph-mon[97606]: pgmap v268: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:53:10.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:10 smithi154 ceph-mon[96967]: osdmap e100: 12 total, 12 up, 12 in 2022-09-07T19:53:10.625 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:10 smithi154 ceph-mon[96967]: pgmap v270: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:53:10.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:10 smithi155 ceph-mon[97606]: osdmap e100: 12 total, 12 up, 12 in 2022-09-07T19:53:10.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:10 smithi155 ceph-mon[97606]: pgmap v270: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:53:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:12 smithi154 ceph-mon[96967]: pgmap v271: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:53:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:12 smithi155 ceph-mon[97606]: pgmap v271: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:53:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:14 smithi154 ceph-mon[96967]: pgmap v272: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:53:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:14 smithi155 ceph-mon[97606]: pgmap v272: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:53:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:16 smithi154 ceph-mon[96967]: osdmap e101: 12 total, 12 up, 12 in 2022-09-07T19:53:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:16 smithi155 ceph-mon[97606]: osdmap e101: 12 total, 12 up, 12 in 2022-09-07T19:53:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:17 smithi154 ceph-mon[96967]: pgmap v274: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:53:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:17 smithi155 ceph-mon[97606]: pgmap v274: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:53:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:19 smithi154 ceph-mon[96967]: pgmap v275: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:53:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:19 smithi155 ceph-mon[97606]: pgmap v275: 129 pgs: 129 active+clean; 15 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:53:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:21 smithi154 ceph-mon[96967]: pgmap v276: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:53:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:21 smithi155 ceph-mon[97606]: pgmap v276: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:53:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:23 smithi154 ceph-mon[96967]: pgmap v277: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:53:23.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:23 smithi155 ceph-mon[97606]: pgmap v277: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:53:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:25 smithi154 ceph-mon[96967]: pgmap v278: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:53:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:25 smithi155 ceph-mon[97606]: pgmap v278: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:53:27.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:27 smithi154 ceph-mon[96967]: pgmap v279: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:53:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:27 smithi155 ceph-mon[97606]: pgmap v279: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:53:29.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:29 smithi154 ceph-mon[96967]: pgmap v280: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:53:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:29 smithi155 ceph-mon[97606]: pgmap v280: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:53:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:31 smithi154 ceph-mon[96967]: pgmap v281: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:53:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:31 smithi155 ceph-mon[97606]: pgmap v281: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:53:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:33 smithi154 ceph-mon[96967]: pgmap v282: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:33 smithi155 ceph-mon[97606]: pgmap v282: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:34.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:34 smithi155 ceph-mon[97606]: pgmap v283: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:34 smithi154 ceph-mon[96967]: pgmap v283: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:53:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:53:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:53:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:53:36.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:36 smithi155 ceph-mon[97606]: pgmap v284: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:53:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:36 smithi154 ceph-mon[96967]: pgmap v284: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:53:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:38 smithi154 ceph-mon[96967]: pgmap v285: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:53:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:38 smithi155 ceph-mon[97606]: pgmap v285: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:53:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:41 smithi154 ceph-mon[96967]: pgmap v286: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:41 smithi155 ceph-mon[97606]: pgmap v286: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:43 smithi154 ceph-mon[96967]: pgmap v287: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:53:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:43 smithi155 ceph-mon[97606]: pgmap v287: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:53:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:45 smithi154 ceph-mon[96967]: pgmap v288: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:45 smithi155 ceph-mon[97606]: pgmap v288: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:47 smithi154 ceph-mon[96967]: pgmap v289: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:47 smithi155 ceph-mon[97606]: pgmap v289: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:49 smithi154 ceph-mon[96967]: pgmap v290: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:49 smithi155 ceph-mon[97606]: pgmap v290: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:51 smithi154 ceph-mon[96967]: pgmap v291: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:51 smithi155 ceph-mon[97606]: pgmap v291: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:53 smithi154 ceph-mon[96967]: pgmap v292: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:53 smithi155 ceph-mon[97606]: pgmap v292: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:55 smithi154 ceph-mon[96967]: pgmap v293: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:55 smithi155 ceph-mon[97606]: pgmap v293: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:53:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:57 smithi154 ceph-mon[96967]: pgmap v294: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:57 smithi155 ceph-mon[97606]: pgmap v294: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:59.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:53:59 smithi154 ceph-mon[96967]: pgmap v295: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:53:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:53:59 smithi155 ceph-mon[97606]: pgmap v295: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:01.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:01 smithi154 ceph-mon[96967]: pgmap v296: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:01 smithi155 ceph-mon[97606]: pgmap v296: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:02.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:02 smithi155 ceph-mon[97606]: pgmap v297: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:02.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:02 smithi154 ceph-mon[96967]: pgmap v297: 129 pgs: 129 active+clean; 15 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:04.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:04 smithi154 ceph-mon[96967]: pgmap v298: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:54:04.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:04 smithi155 ceph-mon[97606]: pgmap v298: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:54:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:07 smithi154 ceph-mon[96967]: pgmap v299: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:54:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:07 smithi155 ceph-mon[97606]: pgmap v299: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:54:09.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:09 smithi154 ceph-mon[96967]: pgmap v300: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:54:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:09 smithi155 ceph-mon[97606]: pgmap v300: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:54:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:11 smithi154 ceph-mon[96967]: pgmap v301: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:54:11.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:11 smithi154 ceph-mon[96967]: osdmap e102: 12 total, 12 up, 12 in 2022-09-07T19:54:11.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:11 smithi155 ceph-mon[97606]: pgmap v301: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:54:11.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:11 smithi155 ceph-mon[97606]: osdmap e102: 12 total, 12 up, 12 in 2022-09-07T19:54:13.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:13 smithi154 ceph-mon[96967]: pgmap v303: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:54:13.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:13 smithi155 ceph-mon[97606]: pgmap v303: 129 pgs: 129 active+clean; 15 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:54:15.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:15 smithi154 ceph-mon[96967]: pgmap v304: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:54:15.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:15 smithi154 ceph-mon[96967]: osdmap e103: 12 total, 12 up, 12 in 2022-09-07T19:54:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:15 smithi155 ceph-mon[97606]: pgmap v304: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:54:15.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:15 smithi155 ceph-mon[97606]: osdmap e103: 12 total, 12 up, 12 in 2022-09-07T19:54:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:17 smithi154 ceph-mon[96967]: pgmap v306: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:54:17.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:17 smithi155 ceph-mon[97606]: pgmap v306: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:54:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:19 smithi154 ceph-mon[96967]: pgmap v307: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T19:54:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:19 smithi155 ceph-mon[97606]: pgmap v307: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T19:54:21.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:21 smithi154 ceph-mon[96967]: pgmap v308: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2022-09-07T19:54:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:21 smithi155 ceph-mon[97606]: pgmap v308: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2022-09-07T19:54:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:23 smithi154 ceph-mon[96967]: pgmap v309: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:54:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:23 smithi155 ceph-mon[97606]: pgmap v309: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:54:25.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:25 smithi154 ceph-mon[96967]: pgmap v310: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:54:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:25 smithi155 ceph-mon[97606]: pgmap v310: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:54:26.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:26 smithi155 ceph-mon[97606]: pgmap v311: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:54:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:26 smithi154 ceph-mon[96967]: pgmap v311: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:54:28.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:28 smithi154 ceph-mon[96967]: pgmap v312: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:54:28.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:28 smithi155 ceph-mon[97606]: pgmap v312: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:54:29.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2022-09-07T19:54:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:31 smithi154 ceph-mon[96967]: pgmap v313: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:54:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:31 smithi155 ceph-mon[97606]: pgmap v313: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:54:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:33 smithi154 ceph-mon[96967]: pgmap v314: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:33 smithi155 ceph-mon[97606]: pgmap v314: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:35 smithi154 ceph-mon[96967]: pgmap v315: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:54:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:54:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:35 smithi155 ceph-mon[97606]: pgmap v315: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:54:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:54:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:37 smithi154 ceph-mon[96967]: pgmap v316: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:37 smithi155 ceph-mon[97606]: pgmap v316: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:39.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:39 smithi154 ceph-mon[96967]: pgmap v317: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:39 smithi155 ceph-mon[97606]: pgmap v317: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:41.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:41 smithi154 ceph-mon[96967]: pgmap v318: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:41 smithi155 ceph-mon[97606]: pgmap v318: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:43.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:43 smithi154 ceph-mon[96967]: pgmap v319: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:43 smithi155 ceph-mon[97606]: pgmap v319: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:45.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:45 smithi154 ceph-mon[96967]: pgmap v320: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:45 smithi155 ceph-mon[97606]: pgmap v320: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:47.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:47 smithi154 ceph-mon[96967]: pgmap v321: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:47.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:47 smithi155 ceph-mon[97606]: pgmap v321: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:49.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:49 smithi154 ceph-mon[96967]: pgmap v322: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:49 smithi155 ceph-mon[97606]: pgmap v322: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:51.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:51 smithi154 ceph-mon[96967]: pgmap v323: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:51 smithi155 ceph-mon[97606]: pgmap v323: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:53 smithi154 ceph-mon[96967]: pgmap v324: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:53 smithi155 ceph-mon[97606]: pgmap v324: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:55 smithi154 ceph-mon[96967]: pgmap v325: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:55 smithi155 ceph-mon[97606]: pgmap v325: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:54:57.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:57 smithi154 ceph-mon[96967]: pgmap v326: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:57.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:57 smithi155 ceph-mon[97606]: pgmap v326: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:59.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:54:59 smithi154 ceph-mon[96967]: pgmap v327: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:54:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:54:59 smithi155 ceph-mon[97606]: pgmap v327: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:01.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:01 smithi154 ceph-mon[96967]: pgmap v328: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:01.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:01 smithi155 ceph-mon[97606]: pgmap v328: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:03.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:03 smithi154 ceph-mon[96967]: pgmap v329: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:03 smithi155 ceph-mon[97606]: pgmap v329: 129 pgs: 129 active+clean; 15 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:05.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:05 smithi154 ceph-mon[96967]: pgmap v330: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:55:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:05 smithi155 ceph-mon[97606]: pgmap v330: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:55:07.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:07 smithi154 ceph-mon[96967]: pgmap v331: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:55:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:07 smithi155 ceph-mon[97606]: pgmap v331: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:55:09.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:09 smithi155 ceph-mon[97606]: pgmap v332: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:55:09.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:09 smithi154 ceph-mon[96967]: pgmap v332: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:55:10.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:10 smithi155 ceph-mon[97606]: osdmap e104: 12 total, 12 up, 12 in 2022-09-07T19:55:10.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:10 smithi155 ceph-mon[97606]: pgmap v334: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:55:10.881 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:10 smithi154 ceph-mon[96967]: osdmap e104: 12 total, 12 up, 12 in 2022-09-07T19:55:10.882 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:10 smithi154 ceph-mon[96967]: pgmap v334: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:55:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:12 smithi154 ceph-mon[96967]: pgmap v335: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:55:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:12 smithi155 ceph-mon[97606]: pgmap v335: 129 pgs: 129 active+clean; 15 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:55:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:14 smithi154 ceph-mon[96967]: pgmap v336: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:55:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:14 smithi155 ceph-mon[97606]: pgmap v336: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:55:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:16 smithi154 ceph-mon[96967]: osdmap e105: 12 total, 12 up, 12 in 2022-09-07T19:55:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:16 smithi155 ceph-mon[97606]: osdmap e105: 12 total, 12 up, 12 in 2022-09-07T19:55:17.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:17 smithi154 ceph-mon[96967]: pgmap v338: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:55:17.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:17 smithi155 ceph-mon[97606]: pgmap v338: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:55:19.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:19 smithi154 ceph-mon[96967]: pgmap v339: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:55:19.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:19 smithi155 ceph-mon[97606]: pgmap v339: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:55:21.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:21 smithi154 ceph-mon[96967]: pgmap v340: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:55:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:21 smithi155 ceph-mon[97606]: pgmap v340: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:55:23.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:23 smithi154 ceph-mon[96967]: pgmap v341: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:55:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:23 smithi155 ceph-mon[97606]: pgmap v341: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:55:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:25 smithi155 ceph-mon[97606]: pgmap v342: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:55:25.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:25 smithi154 ceph-mon[96967]: pgmap v342: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:55:27.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:27 smithi155 ceph-mon[97606]: pgmap v343: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:55:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:27 smithi154 ceph-mon[96967]: pgmap v343: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:55:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:29 smithi155 ceph-mon[97606]: pgmap v344: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:55:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:29 smithi154 ceph-mon[96967]: pgmap v344: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:55:31.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:31 smithi154 ceph-mon[96967]: pgmap v345: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:55:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:31 smithi155 ceph-mon[97606]: pgmap v345: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:55:33.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:33 smithi154 ceph-mon[96967]: pgmap v346: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:33 smithi155 ceph-mon[97606]: pgmap v346: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:35.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:35 smithi154 ceph-mon[96967]: pgmap v347: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:55:35.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:55:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:35 smithi155 ceph-mon[97606]: pgmap v347: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:55:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:55:37.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:37 smithi154 ceph-mon[96967]: pgmap v348: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:37.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:37 smithi155 ceph-mon[97606]: pgmap v348: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:39.624 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:39 smithi154 ceph-mon[96967]: pgmap v349: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:39.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:39 smithi155 ceph-mon[97606]: pgmap v349: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:41 smithi155 ceph-mon[97606]: pgmap v350: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:41 smithi154 ceph-mon[96967]: pgmap v350: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:43 smithi155 ceph-mon[97606]: pgmap v351: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:43 smithi154 ceph-mon[96967]: pgmap v351: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:45 smithi155 ceph-mon[97606]: pgmap v352: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:45 smithi154 ceph-mon[96967]: pgmap v352: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:47.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:47 smithi155 ceph-mon[97606]: pgmap v353: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:47.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:47 smithi154 ceph-mon[96967]: pgmap v353: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:48.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:48 smithi155 ceph-mon[97606]: pgmap v354: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:48.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:48 smithi154 ceph-mon[96967]: pgmap v354: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:51.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:51 smithi154 ceph-mon[96967]: pgmap v355: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:51 smithi155 ceph-mon[97606]: pgmap v355: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:53.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:53 smithi154 ceph-mon[96967]: pgmap v356: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:53 smithi155 ceph-mon[97606]: pgmap v356: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:55.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:55 smithi154 ceph-mon[96967]: pgmap v357: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:55 smithi155 ceph-mon[97606]: pgmap v357: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:55:57.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:57 smithi155 ceph-mon[97606]: pgmap v358: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:57.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:57 smithi154 ceph-mon[96967]: pgmap v358: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:55:59 smithi155 ceph-mon[97606]: pgmap v359: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:55:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:55:59 smithi154 ceph-mon[96967]: pgmap v359: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:01.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:01 smithi155 ceph-mon[97606]: pgmap v360: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:01 smithi154 ceph-mon[96967]: pgmap v360: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:03 smithi155 ceph-mon[97606]: pgmap v361: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:03 smithi154 ceph-mon[96967]: pgmap v361: 129 pgs: 129 active+clean; 15 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:05 smithi155 ceph-mon[97606]: pgmap v362: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:56:05.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:05 smithi154 ceph-mon[96967]: pgmap v362: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:56:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:06 smithi155 ceph-mon[97606]: pgmap v363: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:56:06.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:06 smithi154 ceph-mon[96967]: pgmap v363: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:56:08.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:08 smithi154 ceph-mon[96967]: pgmap v364: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:56:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:08 smithi155 ceph-mon[97606]: pgmap v364: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:56:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:10 smithi154 ceph-mon[96967]: pgmap v365: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:56:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:10 smithi154 ceph-mon[96967]: osdmap e106: 12 total, 12 up, 12 in 2022-09-07T19:56:10.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:10 smithi155 ceph-mon[97606]: pgmap v365: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:56:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:10 smithi155 ceph-mon[97606]: osdmap e106: 12 total, 12 up, 12 in 2022-09-07T19:56:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:12 smithi154 ceph-mon[96967]: pgmap v367: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:56:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:12 smithi155 ceph-mon[97606]: pgmap v367: 129 pgs: 129 active+clean; 15 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:56:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:14 smithi154 ceph-mon[96967]: pgmap v368: 129 pgs: 129 active+clean; 15 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:56:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:14 smithi155 ceph-mon[97606]: pgmap v368: 129 pgs: 129 active+clean; 15 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:56:16.623 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:16 smithi154 ceph-mon[96967]: osdmap e107: 12 total, 12 up, 12 in 2022-09-07T19:56:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:16 smithi155 ceph-mon[97606]: osdmap e107: 12 total, 12 up, 12 in 2022-09-07T19:56:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:17 smithi155 ceph-mon[97606]: pgmap v370: 129 pgs: 129 active+clean; 15 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:56:17.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:17 smithi154 ceph-mon[96967]: pgmap v370: 129 pgs: 129 active+clean; 15 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:56:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:19 smithi155 ceph-mon[97606]: pgmap v371: 129 pgs: 129 active+clean; 15 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T19:56:19.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:19 smithi154 ceph-mon[96967]: pgmap v371: 129 pgs: 129 active+clean; 15 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T19:56:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:21 smithi155 ceph-mon[97606]: pgmap v372: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 205 B/s wr, 6 op/s 2022-09-07T19:56:21.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:21 smithi154 ceph-mon[96967]: pgmap v372: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 205 B/s wr, 6 op/s 2022-09-07T19:56:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:23 smithi155 ceph-mon[97606]: pgmap v373: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:56:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:23 smithi154 ceph-mon[96967]: pgmap v373: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:56:24.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:24 smithi155 ceph-mon[97606]: pgmap v374: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2022-09-07T19:56:24.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:24 smithi154 ceph-mon[96967]: pgmap v374: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2022-09-07T19:56:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:27 smithi155 ceph-mon[97606]: pgmap v375: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 5 op/s 2022-09-07T19:56:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:27 smithi154 ceph-mon[96967]: pgmap v375: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 5 op/s 2022-09-07T19:56:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:29 smithi155 ceph-mon[97606]: pgmap v376: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2022-09-07T19:56:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:29 smithi154 ceph-mon[96967]: pgmap v376: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2022-09-07T19:56:31.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:31 smithi155 ceph-mon[97606]: pgmap v377: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:56:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:31 smithi154 ceph-mon[96967]: pgmap v377: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:56:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:33 smithi155 ceph-mon[97606]: pgmap v378: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:33.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:33 smithi154 ceph-mon[96967]: pgmap v378: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:35 smithi155 ceph-mon[97606]: pgmap v379: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:56:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:56:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:35 smithi154 ceph-mon[96967]: pgmap v379: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:56:35.875 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:56:37.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:37 smithi155 ceph-mon[97606]: pgmap v380: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:37.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:37 smithi154 ceph-mon[96967]: pgmap v380: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:38.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:38 smithi155 ceph-mon[97606]: pgmap v381: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:38.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:38 smithi154 ceph-mon[96967]: pgmap v381: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:41 smithi155 ceph-mon[97606]: pgmap v382: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:41 smithi154 ceph-mon[96967]: pgmap v382: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:43 smithi155 ceph-mon[97606]: pgmap v383: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:43 smithi154 ceph-mon[96967]: pgmap v383: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:45 smithi155 ceph-mon[97606]: pgmap v384: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:45 smithi154 ceph-mon[96967]: pgmap v384: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:47.640 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:47 smithi154 ceph-mon[96967]: pgmap v385: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:47.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:47 smithi155 ceph-mon[97606]: pgmap v385: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:49.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:49 smithi155 ceph-mon[97606]: pgmap v386: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:49.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:49 smithi154 ceph-mon[96967]: pgmap v386: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:51.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:51 smithi155 ceph-mon[97606]: pgmap v387: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:51 smithi154 ceph-mon[96967]: pgmap v387: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:53 smithi155 ceph-mon[97606]: pgmap v388: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:53 smithi154 ceph-mon[96967]: pgmap v388: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:54.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:54 smithi154 ceph-mon[96967]: pgmap v389: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:54.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:54 smithi155 ceph-mon[97606]: pgmap v389: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:56:57.702 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:57 smithi155 ceph-mon[97606]: pgmap v390: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:57.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:57 smithi154 ceph-mon[96967]: pgmap v390: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:59.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:56:59 smithi155 ceph-mon[97606]: pgmap v391: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:56:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:56:59 smithi154 ceph-mon[96967]: pgmap v391: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:01.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:01 smithi155 ceph-mon[97606]: pgmap v392: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:01 smithi154 ceph-mon[96967]: pgmap v392: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:03 smithi155 ceph-mon[97606]: pgmap v393: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:03 smithi154 ceph-mon[96967]: pgmap v393: 129 pgs: 129 active+clean; 15 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:05.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:05 smithi155 ceph-mon[97606]: pgmap v394: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:57:05.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:05 smithi154 ceph-mon[96967]: pgmap v394: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:57:07.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:07 smithi155 ceph-mon[97606]: pgmap v395: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:57:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:07 smithi154 ceph-mon[96967]: pgmap v395: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:57:08.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:08 smithi154 ceph-mon[96967]: pgmap v396: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:57:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:08 smithi155 ceph-mon[97606]: pgmap v396: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:57:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:10 smithi154 ceph-mon[96967]: osdmap e108: 12 total, 12 up, 12 in 2022-09-07T19:57:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:10 smithi154 ceph-mon[96967]: pgmap v398: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:57:10.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:10 smithi155 ceph-mon[97606]: osdmap e108: 12 total, 12 up, 12 in 2022-09-07T19:57:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:10 smithi155 ceph-mon[97606]: pgmap v398: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:57:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:12 smithi154 ceph-mon[96967]: pgmap v399: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:57:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:12 smithi155 ceph-mon[97606]: pgmap v399: 129 pgs: 129 active+clean; 15 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:57:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:14 smithi154 ceph-mon[96967]: pgmap v400: 129 pgs: 129 active+clean; 15 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:57:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:14 smithi155 ceph-mon[97606]: pgmap v400: 129 pgs: 129 active+clean; 15 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:57:16.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:16 smithi155 ceph-mon[97606]: osdmap e109: 12 total, 12 up, 12 in 2022-09-07T19:57:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:16 smithi154 ceph-mon[96967]: osdmap e109: 12 total, 12 up, 12 in 2022-09-07T19:57:17.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:17 smithi155 ceph-mon[97606]: pgmap v402: 129 pgs: 129 active+clean; 15 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:57:17.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:17 smithi154 ceph-mon[96967]: pgmap v402: 129 pgs: 129 active+clean; 15 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:57:19.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:19 smithi155 ceph-mon[97606]: pgmap v403: 129 pgs: 129 active+clean; 15 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:57:19.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:19 smithi154 ceph-mon[96967]: pgmap v403: 129 pgs: 129 active+clean; 15 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:57:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:21 smithi155 ceph-mon[97606]: pgmap v404: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:57:21.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:21 smithi154 ceph-mon[96967]: pgmap v404: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:57:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:23 smithi155 ceph-mon[97606]: pgmap v405: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:57:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:23 smithi154 ceph-mon[96967]: pgmap v405: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:57:24.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:24 smithi155 ceph-mon[97606]: pgmap v406: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2022-09-07T19:57:24.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:24 smithi154 ceph-mon[96967]: pgmap v406: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2022-09-07T19:57:27.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:27 smithi155 ceph-mon[97606]: pgmap v407: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 5 op/s 2022-09-07T19:57:27.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:27 smithi154 ceph-mon[96967]: pgmap v407: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 5 op/s 2022-09-07T19:57:29.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:29 smithi155 ceph-mon[97606]: pgmap v408: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2022-09-07T19:57:29.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:29 smithi154 ceph-mon[96967]: pgmap v408: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2022-09-07T19:57:31.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:31 smithi155 ceph-mon[97606]: pgmap v409: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:57:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:31 smithi154 ceph-mon[96967]: pgmap v409: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:57:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:33 smithi155 ceph-mon[97606]: pgmap v410: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:33.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:33 smithi154 ceph-mon[96967]: pgmap v410: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:35 smithi155 ceph-mon[97606]: pgmap v411: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:57:35.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:57:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:35 smithi154 ceph-mon[96967]: pgmap v411: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:57:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:57:36.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:36 smithi155 ceph-mon[97606]: pgmap v412: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:36 smithi154 ceph-mon[96967]: pgmap v412: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:38 smithi154 ceph-mon[96967]: pgmap v413: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:38 smithi155 ceph-mon[97606]: pgmap v413: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:41.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:41 smithi155 ceph-mon[97606]: pgmap v414: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:41 smithi154 ceph-mon[96967]: pgmap v414: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:43.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:43 smithi155 ceph-mon[97606]: pgmap v415: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:43 smithi154 ceph-mon[96967]: pgmap v415: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:45 smithi155 ceph-mon[97606]: pgmap v416: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:45 smithi154 ceph-mon[96967]: pgmap v416: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:46.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:46 smithi154 ceph-mon[96967]: pgmap v417: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:46.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:46 smithi155 ceph-mon[97606]: pgmap v417: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:48.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:48 smithi154 ceph-mon[96967]: pgmap v418: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:48.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:48 smithi155 ceph-mon[97606]: pgmap v418: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:51 smithi155 ceph-mon[97606]: pgmap v419: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:51 smithi154 ceph-mon[96967]: pgmap v419: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:53.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:53 smithi155 ceph-mon[97606]: pgmap v420: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:53.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:53 smithi154 ceph-mon[96967]: pgmap v420: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:55.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:55 smithi155 ceph-mon[97606]: pgmap v421: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:55 smithi154 ceph-mon[96967]: pgmap v421: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:57:57.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:57 smithi155 ceph-mon[97606]: pgmap v422: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:57.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:57 smithi154 ceph-mon[96967]: pgmap v422: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:59.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:57:59 smithi155 ceph-mon[97606]: pgmap v423: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:57:59.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:57:59 smithi154 ceph-mon[96967]: pgmap v423: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:01.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:01 smithi155 ceph-mon[97606]: pgmap v424: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:01 smithi154 ceph-mon[96967]: pgmap v424: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:03 smithi155 ceph-mon[97606]: pgmap v425: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:03.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:03 smithi154 ceph-mon[96967]: pgmap v425: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:05.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:05 smithi155 ceph-mon[97606]: pgmap v426: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:58:05.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:05 smithi154 ceph-mon[96967]: pgmap v426: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:58:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:07 smithi155 ceph-mon[97606]: pgmap v427: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:58:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:07 smithi154 ceph-mon[96967]: pgmap v427: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:58:08.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:08 smithi154 ceph-mon[96967]: pgmap v428: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:58:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:08 smithi155 ceph-mon[97606]: pgmap v428: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:58:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:10 smithi154 ceph-mon[96967]: osdmap e110: 12 total, 12 up, 12 in 2022-09-07T19:58:10.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:10 smithi154 ceph-mon[96967]: pgmap v430: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:58:10.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:10 smithi155 ceph-mon[97606]: osdmap e110: 12 total, 12 up, 12 in 2022-09-07T19:58:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:10 smithi155 ceph-mon[97606]: pgmap v430: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:58:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:12 smithi154 ceph-mon[96967]: pgmap v431: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:58:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:12 smithi155 ceph-mon[97606]: pgmap v431: 129 pgs: 129 active+clean; 15 MiB data, 314 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:58:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:14 smithi154 ceph-mon[96967]: pgmap v432: 129 pgs: 129 active+clean; 15 MiB data, 315 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:58:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:14 smithi155 ceph-mon[97606]: pgmap v432: 129 pgs: 129 active+clean; 15 MiB data, 315 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:58:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:16 smithi155 ceph-mon[97606]: osdmap e111: 12 total, 12 up, 12 in 2022-09-07T19:58:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:16 smithi154 ceph-mon[96967]: osdmap e111: 12 total, 12 up, 12 in 2022-09-07T19:58:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:17 smithi155 ceph-mon[97606]: pgmap v434: 129 pgs: 129 active+clean; 15 MiB data, 315 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:58:17.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:17 smithi154 ceph-mon[96967]: pgmap v434: 129 pgs: 129 active+clean; 15 MiB data, 315 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:58:18.698 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:18 smithi155 ceph-mon[97606]: pgmap v435: 129 pgs: 129 active+clean; 15 MiB data, 315 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:58:18.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:18 smithi154 ceph-mon[96967]: pgmap v435: 129 pgs: 129 active+clean; 15 MiB data, 315 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:58:21.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:21 smithi155 ceph-mon[97606]: pgmap v436: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:58:21.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:21 smithi154 ceph-mon[96967]: pgmap v436: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:58:23.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:23 smithi155 ceph-mon[97606]: pgmap v437: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:58:23.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:23 smithi154 ceph-mon[96967]: pgmap v437: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:58:25.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:25 smithi155 ceph-mon[97606]: pgmap v438: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:58:25.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:25 smithi154 ceph-mon[96967]: pgmap v438: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:58:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:26 smithi154 ceph-mon[96967]: pgmap v439: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:58:26.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:26 smithi155 ceph-mon[97606]: pgmap v439: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2022-09-07T19:58:28.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:28 smithi154 ceph-mon[96967]: pgmap v440: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:58:28.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:28 smithi155 ceph-mon[97606]: pgmap v440: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:58:31.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:31 smithi155 ceph-mon[97606]: pgmap v441: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:58:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:31 smithi154 ceph-mon[96967]: pgmap v441: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:58:33.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:33 smithi155 ceph-mon[97606]: pgmap v442: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:33.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:33 smithi154 ceph-mon[96967]: pgmap v442: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:35.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:35 smithi155 ceph-mon[97606]: pgmap v443: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:58:35.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:58:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:35 smithi154 ceph-mon[96967]: pgmap v443: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:58:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:58:36.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:36 smithi154 ceph-mon[96967]: pgmap v444: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:36.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:36 smithi155 ceph-mon[97606]: pgmap v444: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:38.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:38 smithi154 ceph-mon[96967]: pgmap v445: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:38 smithi155 ceph-mon[97606]: pgmap v445: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:41.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:41 smithi155 ceph-mon[97606]: pgmap v446: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:41.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:41 smithi154 ceph-mon[96967]: pgmap v446: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:43.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:43 smithi155 ceph-mon[97606]: pgmap v447: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:43.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:43 smithi154 ceph-mon[96967]: pgmap v447: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:45.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:45 smithi155 ceph-mon[97606]: pgmap v448: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:45.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:45 smithi154 ceph-mon[96967]: pgmap v448: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:46.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:46 smithi155 ceph-mon[97606]: pgmap v449: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:46.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:46 smithi154 ceph-mon[96967]: pgmap v449: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:48.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:48 smithi154 ceph-mon[96967]: pgmap v450: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:48.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:48 smithi155 ceph-mon[97606]: pgmap v450: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:58:51.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:51 smithi155 ceph-mon[97606]: pgmap v451: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:51.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:51 smithi154 ceph-mon[96967]: pgmap v451: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:53.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:53 smithi155 ceph-mon[97606]: pgmap v452: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:58:53.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:53 smithi154 ceph-mon[96967]: pgmap v452: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:58:55.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:55 smithi155 ceph-mon[97606]: pgmap v453: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:55.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:55 smithi154 ceph-mon[96967]: pgmap v453: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:58:56.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:56 smithi155 ceph-mon[97606]: pgmap v454: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:58:56.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:56 smithi154 ceph-mon[96967]: pgmap v454: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:58:58.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:58:58 smithi154 ceph-mon[96967]: pgmap v455: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:58:58.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:58:58 smithi155 ceph-mon[97606]: pgmap v455: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T19:59:01.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:01 smithi155 ceph-mon[97606]: pgmap v456: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:01.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:01 smithi154 ceph-mon[96967]: pgmap v456: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:03.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:03 smithi155 ceph-mon[97606]: pgmap v457: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:03.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:03 smithi154 ceph-mon[96967]: pgmap v457: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:04.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:04 smithi154 ceph-mon[96967]: pgmap v458: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:59:04.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:04 smithi155 ceph-mon[97606]: pgmap v458: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T19:59:07.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:07 smithi155 ceph-mon[97606]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:59:07.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:07 smithi154 ceph-mon[96967]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:59:08.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:08 smithi154 ceph-mon[96967]: pgmap v460: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:59:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:08 smithi155 ceph-mon[97606]: pgmap v460: 129 pgs: 129 active+clean; 15 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T19:59:10.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:10 smithi154 ceph-mon[96967]: osdmap e112: 12 total, 12 up, 12 in 2022-09-07T19:59:10.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:10 smithi154 ceph-mon[96967]: pgmap v462: 129 pgs: 129 active+clean; 15 MiB data, 317 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:59:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:10 smithi155 ceph-mon[97606]: osdmap e112: 12 total, 12 up, 12 in 2022-09-07T19:59:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:10 smithi155 ceph-mon[97606]: pgmap v462: 129 pgs: 129 active+clean; 15 MiB data, 317 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:59:12.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:12 smithi154 ceph-mon[96967]: pgmap v463: 129 pgs: 129 active+clean; 15 MiB data, 317 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:59:12.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:12 smithi155 ceph-mon[97606]: pgmap v463: 129 pgs: 129 active+clean; 15 MiB data, 317 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T19:59:14.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:14 smithi154 ceph-mon[96967]: pgmap v464: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:59:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:14 smithi155 ceph-mon[97606]: pgmap v464: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:59:16.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:16 smithi155 ceph-mon[97606]: osdmap e113: 12 total, 12 up, 12 in 2022-09-07T19:59:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:16 smithi154 ceph-mon[96967]: osdmap e113: 12 total, 12 up, 12 in 2022-09-07T19:59:17.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:17 smithi155 ceph-mon[97606]: pgmap v466: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:59:17.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:17 smithi154 ceph-mon[96967]: pgmap v466: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T19:59:18.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:18 smithi154 ceph-mon[96967]: pgmap v467: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:59:18.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:18 smithi155 ceph-mon[97606]: pgmap v467: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 126 B/s wr, 3 op/s 2022-09-07T19:59:21.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:21 smithi155 ceph-mon[97606]: pgmap v468: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:59:21.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:21 smithi154 ceph-mon[96967]: pgmap v468: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:59:22.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:22 smithi154 ceph-mon[96967]: pgmap v469: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:59:22.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:22 smithi155 ceph-mon[97606]: pgmap v469: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T19:59:24.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:24 smithi154 ceph-mon[96967]: pgmap v470: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:59:24.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:24 smithi155 ceph-mon[97606]: pgmap v470: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T19:59:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:26 smithi154 ceph-mon[96967]: pgmap v471: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T19:59:26.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:26 smithi155 ceph-mon[97606]: pgmap v471: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T19:59:28.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:28 smithi154 ceph-mon[96967]: pgmap v472: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:59:28.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:28 smithi155 ceph-mon[97606]: pgmap v472: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T19:59:29.281 INFO:teuthology.orchestra.run.smithi080.stderr:2022-09-07T19:59:29.281+0000 7fe43c5ff700 -1 monclient: get_monmap_and_config failed to get config 2022-09-07T19:59:31.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:31 smithi155 ceph-mon[97606]: pgmap v473: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:59:31.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:31 smithi154 ceph-mon[96967]: pgmap v473: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T19:59:32.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:32 smithi155 ceph-mon[97606]: pgmap v474: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:32.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:32 smithi154 ceph-mon[96967]: pgmap v474: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:34.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:34 smithi154 ceph-mon[96967]: pgmap v475: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:34 smithi155 ceph-mon[97606]: pgmap v475: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:35.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:59:35.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:59:35.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T19:59:35.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T19:59:36.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:36 smithi154 ceph-mon[96967]: pgmap v476: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:36.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:36 smithi155 ceph-mon[97606]: pgmap v476: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:38 smithi155 ceph-mon[97606]: pgmap v477: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:39.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:38 smithi154 ceph-mon[96967]: pgmap v477: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:40.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:40 smithi155 ceph-mon[97606]: pgmap v478: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:41.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:40 smithi154 ceph-mon[96967]: pgmap v478: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:42 smithi155 ceph-mon[97606]: pgmap v479: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:43.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:42 smithi154 ceph-mon[96967]: pgmap v479: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:44.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:44 smithi155 ceph-mon[97606]: pgmap v480: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:45.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:44 smithi154 ceph-mon[96967]: pgmap v480: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:46.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:46 smithi155 ceph-mon[97606]: pgmap v481: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:46.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:46 smithi154 ceph-mon[96967]: pgmap v481: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:48.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:48 smithi154 ceph-mon[96967]: pgmap v482: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:48.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:48 smithi155 ceph-mon[97606]: pgmap v482: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:50.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:50 smithi155 ceph-mon[97606]: pgmap v483: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:51.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:50 smithi154 ceph-mon[96967]: pgmap v483: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:52.952 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:52 smithi155 ceph-mon[97606]: pgmap v484: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:53.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:52 smithi154 ceph-mon[96967]: pgmap v484: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:54.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:54 smithi155 ceph-mon[97606]: pgmap v485: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:55.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:54 smithi154 ceph-mon[96967]: pgmap v485: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T19:59:56.696 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:56 smithi155 ceph-mon[97606]: pgmap v486: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:56.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:56 smithi154 ceph-mon[96967]: pgmap v486: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:58.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 19:59:58 smithi155 ceph-mon[97606]: pgmap v487: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T19:59:59.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 19:59:58 smithi154 ceph-mon[96967]: pgmap v487: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:00.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:00 smithi155 ceph-mon[97606]: pgmap v488: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:00 smithi155 ceph-mon[97606]: overall HEALTH_WARN 1/3 mons down, quorum c,b 2022-09-07T20:00:01.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:00 smithi154 ceph-mon[96967]: pgmap v488: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:01.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:00 smithi154 ceph-mon[96967]: overall HEALTH_WARN 1/3 mons down, quorum c,b 2022-09-07T20:00:02.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:02 smithi155 ceph-mon[97606]: pgmap v489: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:03.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:02 smithi154 ceph-mon[96967]: pgmap v489: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:04.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:04 smithi155 ceph-mon[97606]: pgmap v490: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:00:05.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:04 smithi154 ceph-mon[96967]: pgmap v490: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:00:06.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:06 smithi155 ceph-mon[97606]: pgmap v491: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:00:06.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:06 smithi154 ceph-mon[96967]: pgmap v491: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:00:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:08 smithi155 ceph-mon[97606]: pgmap v492: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:00:09.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:08 smithi154 ceph-mon[96967]: pgmap v492: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:00:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:10 smithi155 ceph-mon[97606]: pgmap v493: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:00:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:10 smithi155 ceph-mon[97606]: osdmap e114: 12 total, 12 up, 12 in 2022-09-07T20:00:11.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:10 smithi154 ceph-mon[96967]: pgmap v493: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:00:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:10 smithi154 ceph-mon[96967]: osdmap e114: 12 total, 12 up, 12 in 2022-09-07T20:00:12.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:12 smithi155 ceph-mon[97606]: pgmap v495: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T20:00:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:12 smithi154 ceph-mon[96967]: pgmap v495: 129 pgs: 129 active+clean; 15 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T20:00:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:14 smithi155 ceph-mon[97606]: pgmap v496: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:00:15.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:14 smithi154 ceph-mon[96967]: pgmap v496: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:00:16.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:16 smithi155 ceph-mon[97606]: osdmap e115: 12 total, 12 up, 12 in 2022-09-07T20:00:16.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:16 smithi155 ceph-mon[97606]: pgmap v498: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T20:00:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:16 smithi154 ceph-mon[96967]: osdmap e115: 12 total, 12 up, 12 in 2022-09-07T20:00:16.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:16 smithi154 ceph-mon[96967]: pgmap v498: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T20:00:18.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:18 smithi155 ceph-mon[97606]: pgmap v499: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T20:00:19.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:18 smithi154 ceph-mon[96967]: pgmap v499: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T20:00:20.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:20 smithi155 ceph-mon[97606]: pgmap v500: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 205 B/s wr, 6 op/s 2022-09-07T20:00:21.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:20 smithi154 ceph-mon[96967]: pgmap v500: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 205 B/s wr, 6 op/s 2022-09-07T20:00:22.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:22 smithi155 ceph-mon[97606]: pgmap v501: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:00:23.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:22 smithi154 ceph-mon[96967]: pgmap v501: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:00:24.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:24 smithi155 ceph-mon[97606]: pgmap v502: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T20:00:25.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:24 smithi154 ceph-mon[96967]: pgmap v502: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T20:00:26.697 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:26 smithi155 ceph-mon[97606]: pgmap v503: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T20:00:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:26 smithi154 ceph-mon[96967]: pgmap v503: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T20:00:28.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:28 smithi155 ceph-mon[97606]: pgmap v504: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T20:00:29.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:28 smithi154 ceph-mon[96967]: pgmap v504: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T20:00:30.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:30 smithi155 ceph-mon[97606]: pgmap v505: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T20:00:31.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:30 smithi154 ceph-mon[96967]: pgmap v505: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T20:00:32.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:32 smithi155 ceph-mon[97606]: pgmap v506: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:33.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:32 smithi154 ceph-mon[96967]: pgmap v506: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:34 smithi155 ceph-mon[97606]: pgmap v507: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:35.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:34 smithi154 ceph-mon[96967]: pgmap v507: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:35.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T20:00:35.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T20:00:36.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T20:00:36.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T20:00:36.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:36 smithi155 ceph-mon[97606]: pgmap v508: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:37.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:36 smithi154 ceph-mon[96967]: pgmap v508: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:38.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:38 smithi155 ceph-mon[97606]: pgmap v509: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:39.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:38 smithi154 ceph-mon[96967]: pgmap v509: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:40.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:40 smithi155 ceph-mon[97606]: pgmap v510: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:41.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:40 smithi154 ceph-mon[96967]: pgmap v510: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:42.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:42 smithi155 ceph-mon[97606]: pgmap v511: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:43.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:42 smithi154 ceph-mon[96967]: pgmap v511: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:44.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:44 smithi155 ceph-mon[97606]: pgmap v512: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:45.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:44 smithi154 ceph-mon[96967]: pgmap v512: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:46.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:46 smithi154 ceph-mon[96967]: pgmap v513: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:46.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:46 smithi155 ceph-mon[97606]: pgmap v513: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:48.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:48 smithi155 ceph-mon[97606]: pgmap v514: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:49.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:48 smithi154 ceph-mon[96967]: pgmap v514: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:50.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:50 smithi155 ceph-mon[97606]: pgmap v515: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:51.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:50 smithi154 ceph-mon[96967]: pgmap v515: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:52.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:52 smithi155 ceph-mon[97606]: pgmap v516: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:53.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:52 smithi154 ceph-mon[96967]: pgmap v516: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:00:54.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:54 smithi155 ceph-mon[97606]: pgmap v517: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:55.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:54 smithi154 ceph-mon[96967]: pgmap v517: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:00:56.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:56 smithi154 ceph-mon[96967]: pgmap v518: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T20:00:56.948 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:56 smithi155 ceph-mon[97606]: pgmap v518: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T20:00:58.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:00:58 smithi155 ceph-mon[97606]: pgmap v519: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T20:00:59.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:00:58 smithi154 ceph-mon[96967]: pgmap v519: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T20:01:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:00 smithi155 ceph-mon[97606]: pgmap v520: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:01.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:00 smithi154 ceph-mon[96967]: pgmap v520: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:02.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:02 smithi155 ceph-mon[97606]: pgmap v521: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T20:01:03.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:02 smithi154 ceph-mon[96967]: pgmap v521: 129 pgs: 129 active+clean; 15 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2022-09-07T20:01:04.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:04 smithi155 ceph-mon[97606]: pgmap v522: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2022-09-07T20:01:05.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:04 smithi154 ceph-mon[96967]: pgmap v522: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2022-09-07T20:01:06.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:06 smithi154 ceph-mon[96967]: pgmap v523: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:01:06.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:06 smithi155 ceph-mon[97606]: pgmap v523: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:01:08.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:08 smithi155 ceph-mon[97606]: pgmap v524: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:01:09.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:08 smithi154 ceph-mon[96967]: pgmap v524: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:01:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:10 smithi155 ceph-mon[97606]: pgmap v525: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:01:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:10 smithi155 ceph-mon[97606]: osdmap e116: 12 total, 12 up, 12 in 2022-09-07T20:01:11.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:10 smithi154 ceph-mon[96967]: pgmap v525: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:01:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:10 smithi154 ceph-mon[96967]: osdmap e116: 12 total, 12 up, 12 in 2022-09-07T20:01:12.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:12 smithi155 ceph-mon[97606]: pgmap v527: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T20:01:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:12 smithi154 ceph-mon[96967]: pgmap v527: 129 pgs: 129 active+clean; 15 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T20:01:14.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:14 smithi155 ceph-mon[97606]: pgmap v528: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:01:15.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:14 smithi154 ceph-mon[96967]: pgmap v528: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:01:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:16 smithi154 ceph-mon[96967]: osdmap e117: 12 total, 12 up, 12 in 2022-09-07T20:01:16.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:16 smithi154 ceph-mon[96967]: pgmap v530: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T20:01:16.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:16 smithi155 ceph-mon[97606]: osdmap e117: 12 total, 12 up, 12 in 2022-09-07T20:01:16.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:16 smithi155 ceph-mon[97606]: pgmap v530: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T20:01:18.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:18 smithi155 ceph-mon[97606]: pgmap v531: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T20:01:19.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:18 smithi154 ceph-mon[96967]: pgmap v531: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T20:01:20.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:20 smithi155 ceph-mon[97606]: pgmap v532: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 205 B/s wr, 6 op/s 2022-09-07T20:01:21.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:20 smithi154 ceph-mon[96967]: pgmap v532: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 205 B/s wr, 6 op/s 2022-09-07T20:01:22.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:22 smithi155 ceph-mon[97606]: pgmap v533: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:01:23.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:22 smithi154 ceph-mon[96967]: pgmap v533: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:01:24.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:24 smithi155 ceph-mon[97606]: pgmap v534: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T20:01:25.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:24 smithi154 ceph-mon[96967]: pgmap v534: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T20:01:26.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:26 smithi154 ceph-mon[96967]: pgmap v535: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T20:01:26.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:26 smithi155 ceph-mon[97606]: pgmap v535: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T20:01:28.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:28 smithi155 ceph-mon[97606]: pgmap v536: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T20:01:29.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:28 smithi154 ceph-mon[96967]: pgmap v536: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-07T20:01:30.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:30 smithi155 ceph-mon[97606]: pgmap v537: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T20:01:31.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:30 smithi154 ceph-mon[96967]: pgmap v537: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2022-09-07T20:01:32.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:32 smithi155 ceph-mon[97606]: pgmap v538: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:33.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:32 smithi154 ceph-mon[96967]: pgmap v538: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:34.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:34 smithi155 ceph-mon[97606]: pgmap v539: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:35.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:34 smithi154 ceph-mon[96967]: pgmap v539: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:35.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T20:01:35.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:35 smithi155 ceph-mon[97606]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T20:01:36.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2022-09-07T20:01:36.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:35 smithi154 ceph-mon[96967]: from='mgr.15243 172.21.15.80:0/3504524963' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2022-09-07T20:01:36.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:36 smithi155 ceph-mon[97606]: pgmap v540: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:37.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:36 smithi154 ceph-mon[96967]: pgmap v540: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:38.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:38 smithi155 ceph-mon[97606]: pgmap v541: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:39.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:38 smithi154 ceph-mon[96967]: pgmap v541: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:40.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:40 smithi155 ceph-mon[97606]: pgmap v542: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:41.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:40 smithi154 ceph-mon[96967]: pgmap v542: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:42.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:42 smithi155 ceph-mon[97606]: pgmap v543: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:43.125 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:42 smithi154 ceph-mon[96967]: pgmap v543: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:44.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:44 smithi155 ceph-mon[97606]: pgmap v544: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:45.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:44 smithi154 ceph-mon[96967]: pgmap v544: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:46.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:46 smithi154 ceph-mon[96967]: pgmap v545: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:46.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:46 smithi155 ceph-mon[97606]: pgmap v545: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:48.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:48 smithi155 ceph-mon[97606]: pgmap v546: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:49.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:48 smithi154 ceph-mon[96967]: pgmap v546: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:50.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:50 smithi155 ceph-mon[97606]: pgmap v547: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:51.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:50 smithi154 ceph-mon[96967]: pgmap v547: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:52.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:52 smithi155 ceph-mon[97606]: pgmap v548: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:53.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:52 smithi154 ceph-mon[96967]: pgmap v548: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:54.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:54 smithi155 ceph-mon[97606]: pgmap v549: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:55.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:54 smithi154 ceph-mon[96967]: pgmap v549: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:01:56.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:56 smithi154 ceph-mon[96967]: pgmap v550: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:56.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:56 smithi155 ceph-mon[97606]: pgmap v550: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:58.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:01:58 smithi155 ceph-mon[97606]: pgmap v551: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:01:59.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:01:58 smithi154 ceph-mon[96967]: pgmap v551: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:02:00.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:00 smithi155 ceph-mon[97606]: pgmap v552: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:02:01.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:00 smithi154 ceph-mon[96967]: pgmap v552: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2022-09-07T20:02:02.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:02 smithi155 ceph-mon[97606]: pgmap v553: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:02:03.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:02 smithi154 ceph-mon[96967]: pgmap v553: 129 pgs: 129 active+clean; 15 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2022-09-07T20:02:04.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:04 smithi155 ceph-mon[97606]: pgmap v554: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:02:05.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:04 smithi154 ceph-mon[96967]: pgmap v554: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:02:06.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:06 smithi154 ceph-mon[96967]: pgmap v555: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:02:06.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:06 smithi155 ceph-mon[97606]: pgmap v555: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:02:08.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:08 smithi155 ceph-mon[97606]: pgmap v556: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:02:09.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:08 smithi154 ceph-mon[96967]: pgmap v556: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2022-09-07T20:02:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:10 smithi155 ceph-mon[97606]: pgmap v557: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:02:10.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:10 smithi155 ceph-mon[97606]: osdmap e118: 12 total, 12 up, 12 in 2022-09-07T20:02:11.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:10 smithi154 ceph-mon[96967]: pgmap v557: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2022-09-07T20:02:11.124 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:10 smithi154 ceph-mon[96967]: osdmap e118: 12 total, 12 up, 12 in 2022-09-07T20:02:12.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:12 smithi155 ceph-mon[97606]: pgmap v559: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T20:02:13.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:12 smithi154 ceph-mon[96967]: pgmap v559: 129 pgs: 129 active+clean; 15 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2022-09-07T20:02:14.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:14 smithi155 ceph-mon[97606]: pgmap v560: 129 pgs: 129 active+clean; 15 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:02:15.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:14 smithi154 ceph-mon[96967]: pgmap v560: 129 pgs: 129 active+clean; 15 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:02:16.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:16 smithi154 ceph-mon[96967]: osdmap e119: 12 total, 12 up, 12 in 2022-09-07T20:02:16.874 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:16 smithi154 ceph-mon[96967]: pgmap v562: 129 pgs: 129 active+clean; 15 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T20:02:16.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:16 smithi155 ceph-mon[97606]: osdmap e119: 12 total, 12 up, 12 in 2022-09-07T20:02:16.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:16 smithi155 ceph-mon[97606]: pgmap v562: 129 pgs: 129 active+clean; 15 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2022-09-07T20:02:18.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:18 smithi155 ceph-mon[97606]: pgmap v563: 129 pgs: 129 active+clean; 15 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T20:02:19.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:18 smithi154 ceph-mon[96967]: pgmap v563: 129 pgs: 129 active+clean; 15 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2022-09-07T20:02:20.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:20 smithi155 ceph-mon[97606]: pgmap v564: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2022-09-07T20:02:21.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:20 smithi154 ceph-mon[96967]: pgmap v564: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2022-09-07T20:02:22.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:22 smithi155 ceph-mon[97606]: pgmap v565: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:02:23.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:22 smithi154 ceph-mon[96967]: pgmap v565: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2022-09-07T20:02:24.947 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:24 smithi155 ceph-mon[97606]: pgmap v566: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T20:02:25.123 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:24 smithi154 ceph-mon[96967]: pgmap v566: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2022-09-07T20:02:26.873 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:26 smithi154 ceph-mon[96967]: pgmap v567: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T20:02:26.946 INFO:journalctl@ceph.mon.c.smithi155.stdout:Sep 07 20:02:26 smithi155 ceph-mon[97606]: pgmap v567: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2022-09-07T20:02:28.974 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 07 20:02:28 smithi154 ceph-mon[96967]: pgmap v568: 129 pgs: 129 active+clean; 15 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2022-09-08T07:14:15.943 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-09-08T07:14:15.968 DEBUG:teuthology.task.console_log:Killing console logger for smithi080 2022-09-08T07:14:15.970 DEBUG:teuthology.task.console_log:Killing console logger for smithi154 2022-09-08T07:14:15.970 DEBUG:teuthology.task.console_log:Killing console logger for smithi155 2022-09-08T07:14:15.971 DEBUG:teuthology.exit:Finished running handlers